Role: Lead Data Engineer (Hands-on) Rate: £425.00 - £470.00 Inside Ir35 Clearance: SC Cleared (actice, used within last 12 months) Location: Hybrid/London (once every month) Start date: ASAP Company Overview: Recruiting for a leading cloud solutions provider specialising in digital transformation and data engineering services. The mission is to empower organisations to unlock their data's full potential through innovative cloud solutions. Seeking a Lead Data Engineer to support the data engineering team in designing and implementing solutions for complex migration projects. Job Overview: The Lead Data Engineer will oversee the design and implementation of data engineering solutions, leading a team in migrating Legacy Oracle databases to AWS managed databases. Expertise in AWS services like AWS Glue, AWS Managed Flink, S3, AWS RDS, and Lambda is essential for mentoring, troubleshooting, and optimizing data solutions. Key Responsibilities: Lead ETL processes using AWS Glue to migrate data from Legacy Oracle databases to AWS managed databases, document databases, and data lakes. Oversee development and maintenance of scalable data pipelines. Provide technical leadership and mentorship to Data Engineers. Collaborate with solution architects, data scientists, and stakeholders. Optimize data workflows using AWS services. Ensure adherence to data quality, security, and governance standards. Automate and monitor data pipelines with proactive alerting mechanisms. Drive continuous improvement and stay updated with emerging AWS services. Lead technical discussions and ensure alignment on design and implementation. Provide regular updates on project status and challenges to senior leadership. Qualifications: Proven expertise in designing and developing ETL processes using AWS Glue. Experience migrating Legacy Oracle databases to AWS managed databases. Strong knowledge of AWS services (S3, AWS Managed Flink, Lambda, CloudWatch). Expertise in building and maintaining data lakes, document databases, and relational databases. Hands-on experience with data pipeline architecture and development. Proficiency in SQL and Python. Strong understanding of data governance, quality, and security. Desirable - AWS certifications (AWS Certified Data Analytics, AWS Certified Solutions Architect). Preferred Skills: Experience with big data processing technologies (Apache Spark, PySpark). Knowledge of DevOps practices and tools. Familiarity with data warehousing, dimensional modelling, and data architecture best practices.
08/01/2025
Project-based
Role: Lead Data Engineer (Hands-on) Rate: £425.00 - £470.00 Inside Ir35 Clearance: SC Cleared (actice, used within last 12 months) Location: Hybrid/London (once every month) Start date: ASAP Company Overview: Recruiting for a leading cloud solutions provider specialising in digital transformation and data engineering services. The mission is to empower organisations to unlock their data's full potential through innovative cloud solutions. Seeking a Lead Data Engineer to support the data engineering team in designing and implementing solutions for complex migration projects. Job Overview: The Lead Data Engineer will oversee the design and implementation of data engineering solutions, leading a team in migrating Legacy Oracle databases to AWS managed databases. Expertise in AWS services like AWS Glue, AWS Managed Flink, S3, AWS RDS, and Lambda is essential for mentoring, troubleshooting, and optimizing data solutions. Key Responsibilities: Lead ETL processes using AWS Glue to migrate data from Legacy Oracle databases to AWS managed databases, document databases, and data lakes. Oversee development and maintenance of scalable data pipelines. Provide technical leadership and mentorship to Data Engineers. Collaborate with solution architects, data scientists, and stakeholders. Optimize data workflows using AWS services. Ensure adherence to data quality, security, and governance standards. Automate and monitor data pipelines with proactive alerting mechanisms. Drive continuous improvement and stay updated with emerging AWS services. Lead technical discussions and ensure alignment on design and implementation. Provide regular updates on project status and challenges to senior leadership. Qualifications: Proven expertise in designing and developing ETL processes using AWS Glue. Experience migrating Legacy Oracle databases to AWS managed databases. Strong knowledge of AWS services (S3, AWS Managed Flink, Lambda, CloudWatch). Expertise in building and maintaining data lakes, document databases, and relational databases. Hands-on experience with data pipeline architecture and development. Proficiency in SQL and Python. Strong understanding of data governance, quality, and security. Desirable - AWS certifications (AWS Certified Data Analytics, AWS Certified Solutions Architect). Preferred Skills: Experience with big data processing technologies (Apache Spark, PySpark). Knowledge of DevOps practices and tools. Familiarity with data warehousing, dimensional modelling, and data architecture best practices.
Role: Lead Data Engineer (Hands-on) Rate: £425.00 - £470.00 Inside Ir35 Clearance: SC Cleared (actice, used within last 12 months) Location: Hybrid/London (once every month) Start date: ASAP Company Overview: Recruiting for a leading cloud solutions provider specialising in digital transformation and data engineering services. The mission is to empower organisations to unlock their data's full potential through innovative cloud solutions. Seeking a Lead Data Engineer to support the data engineering team in designing and implementing solutions for complex migration projects. Job Overview: The Lead Data Engineer will oversee the design and implementation of data engineering solutions, leading a team in migrating Legacy Oracle databases to AWS managed databases. Expertise in AWS services like AWS Glue, AWS Managed Flink, S3, AWS RDS, and Lambda is essential for mentoring, troubleshooting, and optimizing data solutions. Key Responsibilities: Lead ETL processes using AWS Glue to migrate data from Legacy Oracle databases to AWS managed databases, document databases, and data lakes. Oversee development and maintenance of scalable data pipelines. Provide technical leadership and mentorship to Data Engineers. Collaborate with solution architects, data scientists, and stakeholders. Optimize data workflows using AWS services. Ensure adherence to data quality, security, and governance standards. Automate and monitor data pipelines with proactive alerting mechanisms. Drive continuous improvement and stay updated with emerging AWS services. Lead technical discussions and ensure alignment on design and implementation. Provide regular updates on project status and challenges to senior leadership. Qualifications: Proven expertise in designing and developing ETL processes using AWS Glue. Experience migrating Legacy Oracle databases to AWS managed databases. Strong knowledge of AWS services (S3, AWS Managed Flink, Lambda, CloudWatch). Expertise in building and maintaining data lakes, document databases, and relational databases. Hands-on experience with data pipeline architecture and development. Proficiency in SQL and Python. Strong understanding of data governance, quality, and security. Desirable - AWS certifications (AWS Certified Data Analytics, AWS Certified Solutions Architect). Preferred Skills: Experience with big data processing technologies (Apache Spark, PySpark). Knowledge of DevOps practices and tools. Familiarity with data warehousing, dimensional modelling, and data architecture best practices.
08/01/2025
Project-based
Role: Lead Data Engineer (Hands-on) Rate: £425.00 - £470.00 Inside Ir35 Clearance: SC Cleared (actice, used within last 12 months) Location: Hybrid/London (once every month) Start date: ASAP Company Overview: Recruiting for a leading cloud solutions provider specialising in digital transformation and data engineering services. The mission is to empower organisations to unlock their data's full potential through innovative cloud solutions. Seeking a Lead Data Engineer to support the data engineering team in designing and implementing solutions for complex migration projects. Job Overview: The Lead Data Engineer will oversee the design and implementation of data engineering solutions, leading a team in migrating Legacy Oracle databases to AWS managed databases. Expertise in AWS services like AWS Glue, AWS Managed Flink, S3, AWS RDS, and Lambda is essential for mentoring, troubleshooting, and optimizing data solutions. Key Responsibilities: Lead ETL processes using AWS Glue to migrate data from Legacy Oracle databases to AWS managed databases, document databases, and data lakes. Oversee development and maintenance of scalable data pipelines. Provide technical leadership and mentorship to Data Engineers. Collaborate with solution architects, data scientists, and stakeholders. Optimize data workflows using AWS services. Ensure adherence to data quality, security, and governance standards. Automate and monitor data pipelines with proactive alerting mechanisms. Drive continuous improvement and stay updated with emerging AWS services. Lead technical discussions and ensure alignment on design and implementation. Provide regular updates on project status and challenges to senior leadership. Qualifications: Proven expertise in designing and developing ETL processes using AWS Glue. Experience migrating Legacy Oracle databases to AWS managed databases. Strong knowledge of AWS services (S3, AWS Managed Flink, Lambda, CloudWatch). Expertise in building and maintaining data lakes, document databases, and relational databases. Hands-on experience with data pipeline architecture and development. Proficiency in SQL and Python. Strong understanding of data governance, quality, and security. Desirable - AWS certifications (AWS Certified Data Analytics, AWS Certified Solutions Architect). Preferred Skills: Experience with big data processing technologies (Apache Spark, PySpark). Knowledge of DevOps practices and tools. Familiarity with data warehousing, dimensional modelling, and data architecture best practices.
Qualient Technology Solutions UK Limited
Reading, Berkshire
Location: Reading/Croydon, UK (Hybrid Role) Employment Type: Permanent Security Clearance: Active SC Clearance Required About Qualient Technology Solutions At Qualient Technology Solutions, we specialize in delivering cutting-edge technology solutions tailored to our clients' needs. We are currently seeking a highly skilled Senior Infrastructure Engineer to join our team. This role is pivotal in supporting and enhancing infrastructure and environment management for a high-profile, secure solution. This hybrid role offers an exciting opportunity to work with innovative technologies and complex systems in a dynamic environment. Key Responsibilities Manage desktop operations, including user account creation, patch management, and fault resolution. Perform server maintenance, backups, capacity tuning, and license management. Develop and implement infrastructure automation using the Puppet Framework. Configure and manage networking (DNS, DHCP, VLAN, SSL) and Firewall settings. Ensure security protocols with tools like Nessus and AlienVault. Collaborate with cross-functional teams and provide technical support. Skills & Experience Required Extensive Experience: At least 15 years in infrastructure management and environment provisioning. Technical Expertise: Proficient in Puppet Framework, Docker, VMware, SAN, and hardware asset management. Programming Skills: Strong knowledge of Ubuntu OS (19.0+), Shell Scripting, Python, and YAML. Tools Knowledge: Hands-on experience with JIRA, Confluence, Git, Jenkins, and Nexus. Networking Proficiency: Expertise in managing DNS, DHCP, VLAN, HTTP, and SSL protocols. Security Focus: Familiarity with tools like Nessus, AlienVault, and antivirus software such as ClamAV and SOPHOS. Cloud Experience: Knowledge of AWS infrastructure and cloud technologies (desirable). Agile Practices: Solid understanding of Agile methodologies and workflows. Technologies Involved Mandatory: Puppet Framework, Ubuntu OS, Shell Scripting, Python, VMware Desirable: AWS Infrastructure, OpenLDAP, ClamAV, SOPHOS What We Offer A competitive salary and benefits package. The opportunity to work in a secure, high-impact environment. Access to cutting-edge tools and technologies. Professional development and growth opportunities. Note: Due to the nature of this role, only candidates with active SC Clearance will be considered.
08/01/2025
Location: Reading/Croydon, UK (Hybrid Role) Employment Type: Permanent Security Clearance: Active SC Clearance Required About Qualient Technology Solutions At Qualient Technology Solutions, we specialize in delivering cutting-edge technology solutions tailored to our clients' needs. We are currently seeking a highly skilled Senior Infrastructure Engineer to join our team. This role is pivotal in supporting and enhancing infrastructure and environment management for a high-profile, secure solution. This hybrid role offers an exciting opportunity to work with innovative technologies and complex systems in a dynamic environment. Key Responsibilities Manage desktop operations, including user account creation, patch management, and fault resolution. Perform server maintenance, backups, capacity tuning, and license management. Develop and implement infrastructure automation using the Puppet Framework. Configure and manage networking (DNS, DHCP, VLAN, SSL) and Firewall settings. Ensure security protocols with tools like Nessus and AlienVault. Collaborate with cross-functional teams and provide technical support. Skills & Experience Required Extensive Experience: At least 15 years in infrastructure management and environment provisioning. Technical Expertise: Proficient in Puppet Framework, Docker, VMware, SAN, and hardware asset management. Programming Skills: Strong knowledge of Ubuntu OS (19.0+), Shell Scripting, Python, and YAML. Tools Knowledge: Hands-on experience with JIRA, Confluence, Git, Jenkins, and Nexus. Networking Proficiency: Expertise in managing DNS, DHCP, VLAN, HTTP, and SSL protocols. Security Focus: Familiarity with tools like Nessus, AlienVault, and antivirus software such as ClamAV and SOPHOS. Cloud Experience: Knowledge of AWS infrastructure and cloud technologies (desirable). Agile Practices: Solid understanding of Agile methodologies and workflows. Technologies Involved Mandatory: Puppet Framework, Ubuntu OS, Shell Scripting, Python, VMware Desirable: AWS Infrastructure, OpenLDAP, ClamAV, SOPHOS What We Offer A competitive salary and benefits package. The opportunity to work in a secure, high-impact environment. Access to cutting-edge tools and technologies. Professional development and growth opportunities. Note: Due to the nature of this role, only candidates with active SC Clearance will be considered.
Westhouse is one of the leading international recruitment agencies for the procurement of highly qualified experts in fields such as IT life cycle management, SAP, engineering, commerce and specialist consultancy. For our client we are currently looking for a Senior DevOps for mobile Payment Systems (m/f/d) General information Reference: 172121 Location: Limerick Start: 01.01.2025 (ASAP) Volume: Full time (100%) Duration: 31.12.2025 + Option Languages: English Your Skills - Track record in Service and Incident Management - Cloud Platforms: Proficiency in AWS, Azure, or Google Cloud. (AWS preferred) - Continuous Integration/Continuous Deployment (CI/CD): Expertise in tools like Jenkins, GitLab CI, or CircleCI. - Infrastructure as Code (IaC): Experience with Terraform, Ansible, or CloudFormation. - Scripting Languages: Competence in Python, Bash, or PowerShell. - Containerisation: Knowledge of Docker and orchestration tools like Kubernetes. - Monitoring and Logging: Familiarity with tools such as Prometheus, Grafana, ELK Stack, or Splunk. - Version Control Systems: Proficient in using Git and understanding branching strategies. - Security Best Practices: Implementing security measures in cloud and deployment pipelines. Your Tasks - Leadership: Ability to guide and mentor team members, ensuring alignment with technical goals. - Problem-Solving: Aptitude for diagnosing and resolving complex issues efficiently. - Collaboration: Strong teamwork skills to work effectively with other departments. - Adaptability: Flexibility to adjust to changing project requirements and new technologies. - Attention to Detail: Meticulous in configuring environments and automating processes. - Communication: Clear and effective verbal and written communication skills. - Proactiveness: Initiative to identify areas for improvement and drive changes proactively. - Customer Focus: Understanding the end-user needs and ensuring the delivery of high-quality solutions. Interested? We look forward to receiving your application documents in electronic form. Your Contact: Tobias Gollmann
08/01/2025
Project-based
Westhouse is one of the leading international recruitment agencies for the procurement of highly qualified experts in fields such as IT life cycle management, SAP, engineering, commerce and specialist consultancy. For our client we are currently looking for a Senior DevOps for mobile Payment Systems (m/f/d) General information Reference: 172121 Location: Limerick Start: 01.01.2025 (ASAP) Volume: Full time (100%) Duration: 31.12.2025 + Option Languages: English Your Skills - Track record in Service and Incident Management - Cloud Platforms: Proficiency in AWS, Azure, or Google Cloud. (AWS preferred) - Continuous Integration/Continuous Deployment (CI/CD): Expertise in tools like Jenkins, GitLab CI, or CircleCI. - Infrastructure as Code (IaC): Experience with Terraform, Ansible, or CloudFormation. - Scripting Languages: Competence in Python, Bash, or PowerShell. - Containerisation: Knowledge of Docker and orchestration tools like Kubernetes. - Monitoring and Logging: Familiarity with tools such as Prometheus, Grafana, ELK Stack, or Splunk. - Version Control Systems: Proficient in using Git and understanding branching strategies. - Security Best Practices: Implementing security measures in cloud and deployment pipelines. Your Tasks - Leadership: Ability to guide and mentor team members, ensuring alignment with technical goals. - Problem-Solving: Aptitude for diagnosing and resolving complex issues efficiently. - Collaboration: Strong teamwork skills to work effectively with other departments. - Adaptability: Flexibility to adjust to changing project requirements and new technologies. - Attention to Detail: Meticulous in configuring environments and automating processes. - Communication: Clear and effective verbal and written communication skills. - Proactiveness: Initiative to identify areas for improvement and drive changes proactively. - Customer Focus: Understanding the end-user needs and ensuring the delivery of high-quality solutions. Interested? We look forward to receiving your application documents in electronic form. Your Contact: Tobias Gollmann
Senior Backend Java Developer Salary: $140k-$150k + bonus Location: Chicago, IL Hybrid: 3 days onsite, 2 days remote *We are unable to provide sponsorship for this role* Qualifications Bachelor's degree 7-10+ years of related experience Must have 5 years tenure in current or previous role Experience (including internal workings of Java) in Java 11+ is required. Experience with app development in Golang. Experience developing software using Object Oriented Designs, advance patterns (like AOP) and multi-threading is required. Experience with distributed message brokers like Kafka, IBM MQ, Amazon Kinesis, etc. is desirable. Experience with cloud technologies and migrations. Experience preferred with AWS foundational services like VPCs, Security groups, EC2, RDS, S3 ACLs, KMS, AWS CLI and IAM etc. Must be able to write good quality code with 80% or above unit and integration tests coverage. Experience with testing frameworks like Junit and Citrus is desirable. Experience working with various types of databases like Relational, NoSQL, Object-based, Graph. Experience following Git workflows is required. Familiarity with DevOps tools: Terraform, Ansible, Jenkins, Kubernetes, Docker, Helm and CI/CD pipeline etc. Responsibilities Actively participates in design of highly performing, scalable, secure, reliable and cost optimized solutions. Primary responsibility is application design and development of next gen clearing applications for business requirements in agreed architecture framework and Agile environment. Thoroughly analyzes requirements, develops, tests, and documents software quality to ensure proper implementation. Follows agreed upon SDLC procedures to ensure that all information system products and services meet: both explicit and implicit quality standards, end-user functional requirements, architectural standards, performance requirements, audit requirements, security rules are upheld, and external facing reporting is properly represented. Participates in code-reviews based on high engineering standards Writes unit and integration tests based on chosen test frameworks. Assists Production Support by providing advice on system functionality and fixes as required.
07/01/2025
Full time
Senior Backend Java Developer Salary: $140k-$150k + bonus Location: Chicago, IL Hybrid: 3 days onsite, 2 days remote *We are unable to provide sponsorship for this role* Qualifications Bachelor's degree 7-10+ years of related experience Must have 5 years tenure in current or previous role Experience (including internal workings of Java) in Java 11+ is required. Experience with app development in Golang. Experience developing software using Object Oriented Designs, advance patterns (like AOP) and multi-threading is required. Experience with distributed message brokers like Kafka, IBM MQ, Amazon Kinesis, etc. is desirable. Experience with cloud technologies and migrations. Experience preferred with AWS foundational services like VPCs, Security groups, EC2, RDS, S3 ACLs, KMS, AWS CLI and IAM etc. Must be able to write good quality code with 80% or above unit and integration tests coverage. Experience with testing frameworks like Junit and Citrus is desirable. Experience working with various types of databases like Relational, NoSQL, Object-based, Graph. Experience following Git workflows is required. Familiarity with DevOps tools: Terraform, Ansible, Jenkins, Kubernetes, Docker, Helm and CI/CD pipeline etc. Responsibilities Actively participates in design of highly performing, scalable, secure, reliable and cost optimized solutions. Primary responsibility is application design and development of next gen clearing applications for business requirements in agreed architecture framework and Agile environment. Thoroughly analyzes requirements, develops, tests, and documents software quality to ensure proper implementation. Follows agreed upon SDLC procedures to ensure that all information system products and services meet: both explicit and implicit quality standards, end-user functional requirements, architectural standards, performance requirements, audit requirements, security rules are upheld, and external facing reporting is properly represented. Participates in code-reviews based on high engineering standards Writes unit and integration tests based on chosen test frameworks. Assists Production Support by providing advice on system functionality and fixes as required.
Senior Cloud Engineer - Artifact Management 7 Months Galway - 1 week in the office per month required €400 - €490 per day Are you passionate about cloud technologies and thrive on developing cutting-edge solutions? Do you enjoy collaborating with a global team of talented engineers? If so, we have the perfect opportunity for you! Join our Artifact Management Squad as a Senior Cloud Engineer and help shape the future of our digital services. Key Responsibilities: Design, configure, and deploy applications in cloud environments such as AWS or Azure. Develop and implement systems using two or more programming languages (eg, Python, Java, Go). Oversee deployment and operations of platforms like GitHub, Artifactory, X-Ray, Jenkins, and SonarQube. Create and manage Infrastructure as Code using tools such as Terraform. Collaborate in a DevOps-focused setting with an emphasis on software security scanning tools. Provide mentorship to junior engineers and foster a culture of agility and innovation. Key Skills required: Expertise in Unix/Linux and public cloud platforms (AWS, Azure). Hands-on experience in DevOps and Infrastructure as Code practices. Familiarity with security scanning (SAST, SCA) tools and CI/CD platforms. A proactive approach to learning new technologies and trends in cloud engineering. Excellent communication and collaboration skills, with experience in distributed teams. Preferred Skills: Certifications in AWS, Azure, or Kubernetes. Background in Linux system administration.
02/01/2025
Project-based
Senior Cloud Engineer - Artifact Management 7 Months Galway - 1 week in the office per month required €400 - €490 per day Are you passionate about cloud technologies and thrive on developing cutting-edge solutions? Do you enjoy collaborating with a global team of talented engineers? If so, we have the perfect opportunity for you! Join our Artifact Management Squad as a Senior Cloud Engineer and help shape the future of our digital services. Key Responsibilities: Design, configure, and deploy applications in cloud environments such as AWS or Azure. Develop and implement systems using two or more programming languages (eg, Python, Java, Go). Oversee deployment and operations of platforms like GitHub, Artifactory, X-Ray, Jenkins, and SonarQube. Create and manage Infrastructure as Code using tools such as Terraform. Collaborate in a DevOps-focused setting with an emphasis on software security scanning tools. Provide mentorship to junior engineers and foster a culture of agility and innovation. Key Skills required: Expertise in Unix/Linux and public cloud platforms (AWS, Azure). Hands-on experience in DevOps and Infrastructure as Code practices. Familiarity with security scanning (SAST, SCA) tools and CI/CD platforms. A proactive approach to learning new technologies and trends in cloud engineering. Excellent communication and collaboration skills, with experience in distributed teams. Preferred Skills: Certifications in AWS, Azure, or Kubernetes. Background in Linux system administration.
Senior Data DevOps Engineer (AWS Python Amazon Web Services Data DevOps SRE Site Reliability Engineer Developer Software Engineer Programmer Technical Lead Front Office ECS Lambda Kafka Airflow Spark PySpark Dremio Ignite DBT Iceberg Arrow Glue Athena Docker Terraform OpenShift Kubernetes KOPS Artifactory Trading Finance Java Asset Manager Investment Manager) required by our asset management client in London. You MUST have the following: Experience as a Senior DevOps Engineer/SRE/Python Developer in an Agile environment Strong experience delivering solutions in the AWS (Amazon Web Services) cloud Advanced ability in CI/CD DevOps tools Good experience with open-source Kubernetes - lower-level engineering and tweaks Experience working with data engineering teams Python Experience with 2 or more of the following: Kafka Airflow Spark PySpark Dremio Ignite DBT Iceberg Arrow Glue Athena Agile The following is DESIRABLE not essential: Java (J2EE or Core Java) Golang Role: Senior Data DevOps Engineer (AWS Python Amazon Web Services Data DevOps SRE Site Reliability Engineer Developer Software Engineer Programmer Technical Lead Front Office ECS Lambda Kafka Airflow Spark PySpark Dremio Ignite DBT Iceberg Arrow Glue Athena Docker Terraform OpenShift Kubernetes KOPS Artifactory Trading Finance Java Asset Manager Investment Manager) required by our asset management client in London. You will join a team of 6/7 Data DevOps Engineers that are operating in a central team that support a number of data engineering teams. The data engineering teams are working with a very modern tech stack that includes AWS, Glue, Athena, Airflow, PySpark, Spark, Dremio, DBT, Iceberg and Apache Arrow. The ideal candidate will come from a similar environment and have experience setting up automated processes for the data engineers. There is a very flexible working from home policy. Duration: 12-24 months Rate: £650-900/day
23/12/2024
Project-based
Senior Data DevOps Engineer (AWS Python Amazon Web Services Data DevOps SRE Site Reliability Engineer Developer Software Engineer Programmer Technical Lead Front Office ECS Lambda Kafka Airflow Spark PySpark Dremio Ignite DBT Iceberg Arrow Glue Athena Docker Terraform OpenShift Kubernetes KOPS Artifactory Trading Finance Java Asset Manager Investment Manager) required by our asset management client in London. You MUST have the following: Experience as a Senior DevOps Engineer/SRE/Python Developer in an Agile environment Strong experience delivering solutions in the AWS (Amazon Web Services) cloud Advanced ability in CI/CD DevOps tools Good experience with open-source Kubernetes - lower-level engineering and tweaks Experience working with data engineering teams Python Experience with 2 or more of the following: Kafka Airflow Spark PySpark Dremio Ignite DBT Iceberg Arrow Glue Athena Agile The following is DESIRABLE not essential: Java (J2EE or Core Java) Golang Role: Senior Data DevOps Engineer (AWS Python Amazon Web Services Data DevOps SRE Site Reliability Engineer Developer Software Engineer Programmer Technical Lead Front Office ECS Lambda Kafka Airflow Spark PySpark Dremio Ignite DBT Iceberg Arrow Glue Athena Docker Terraform OpenShift Kubernetes KOPS Artifactory Trading Finance Java Asset Manager Investment Manager) required by our asset management client in London. You will join a team of 6/7 Data DevOps Engineers that are operating in a central team that support a number of data engineering teams. The data engineering teams are working with a very modern tech stack that includes AWS, Glue, Athena, Airflow, PySpark, Spark, Dremio, DBT, Iceberg and Apache Arrow. The ideal candidate will come from a similar environment and have experience setting up automated processes for the data engineers. There is a very flexible working from home policy. Duration: 12-24 months Rate: £650-900/day
