1 joburi disponibile

About the Role Scrumconnect Consulting is looking for a Software Engineer to work on a Strategic Data Platform with expertise in Azure Data Factory (ADF), Python, PySpark, Java, Terraform, and Azure DevOps. The ideal candidate will have experience in cloud-based data engineering, automation, and infrastructure provisioning while working in an Azure environment. You will be responsible for developing scalable data pipelines, integrating cloud services, automating deployments, and supporting DevOps workflows. Key Responsibilities : 1. Software Engineer Develop, test, and deploy scalable data pipelines using Azure Data Factory (ADF), Python, PySpark, and Java. Implement data transformation, ETL/ELT workflows, and data integration solutions. Optimize data flow and performance for cloud-based data processing. 2. Cloud & Infrastructure Automation Use Terraform to provision and manage Azure resources Implement infrastructure as code (IaC) best practices for automated cloud deployments. Ensure efficient resource scaling and cost optimization 3. DevOps & CI/CD Automation Collaborate with DevOps teams to build automated CI/CD pipelines in Azure DevOps Deploy and manage containerized applications using Docker & Kubernetes Monitor and troubleshoot build, deployment, and infrastructure issues 4. Performance Optimisation & Security Optimise data pipeline performance in Azure. Implement cloud security best practices and ensure compliance with data governance policies. Troubleshoot data and infrastructure-related performance issues 5. Collaboration & Documentation Work closely with data engineers, cloud architects, and DevOps teams to design solutions. Participate in agile ceremonies, sprint planning, and technical discussions Maintain technical documentation and best practices Required Skills & Experience: Software Development & Data Engineering Strong experience in: Python, PySpark, Java, Azure Data Factory (ADF). Data Processing & Pipelines: ETL/ELT development, big data frameworks. Cloud Services: Hands-on experience with Azure Data Lake, Synapse, and Azure Functions Infrastructure as Code (IaC) & Automation Terraform expertise for Azure resource provisioning. Experience in cloud infrastructure automation and DevOps workflows DevOps & CI/CD Experience with Azure DevOps, Git, YAML pipelines Ability to work with Docker, Kubernetes, and containerized applications. Other Skills Strong problem-solving and debugging skills. Experience working in Agile/Scrum environments Excellent communication and collaboration skills. Nice to Have: Experience with Databricks, Apache Spark, or ML workloads Knowledge of security best practices in cloud environments Azure, Terraform, or DevOps-related certifications