Our client are a top tier consultancy looking for x3 Data Engineers on a 6 months contract.

Key Responsibilities:

• Design, develop, and maintain scalable data pipelines for Real Time and batch processing.
• Implement Kafka-based streaming solutions for efficient data ingestion and processing.
• Build and manage infrastructure on AWS using ECS, Terraform, and other cloud services.
• Develop and optimize Python-based data applications and workflows.
• Ensure data quality, integrity, and security across all pipelines.
• Collaborate with cross-functional teams, including Data Scientists, Engineers, and Analysts, to support business objectives.
• Monitor and troubleshoot data pipeline issues to ensure system reliability and performance.

Required Skills & Experience:

Strong experience in Kafka for Real Time data streaming and event-driven architectures.
Hands-on experience with AWS services (ECS, S3, Lambda, RDS, IAM, etc.).
Expertise in Terraform for infrastructure as code (IaC) deployment and management.
Proficiency in Python for data processing, automation, and Scripting.
Experience with containerization and orchestration (Docker, ECS, Kubernetes).
Strong understanding of ETL processes, data warehousing, and data lakes.
Knowledge of SQL and NoSQL databases.
Ability to optimize and scale large-scale distributed systems.