We are seeking an experienced senior Informatica IDMC Data Engineer to join our dynamic team. This is a key role within their data team that will see you driving forward exciting new data initiatives.
You will help the organisation to implement what is needed to deliver strategic data platforms. This will include, but not limited to the end-to-end support for acquisition, organisation, integration, transformation, and secure storage of mission-critical data.
Key Responsibilities:
Informatica IDMC Management:
Design, develop, and maintain data integration solutions using Informatica Intelligent Data Management Cloud (IDMC).
Optimize IDMC pipelines for performance and reliability.
Ensure data integrity and quality across various data sources and targets.
Unix Systems:
Develop and maintain scripts and processes on Unix/Linux systems to support data integration workflows.
AWS Cloud Services would be added advantage:
Implement and manage data solutions on AWS, including S3, EC2 services.
Utilize AWS RDS databases for storing and managing structured data.
Batch Orchestration:
Design, implement, and manage batch job workflows using tools like AutoSys and Apache Airflow.
Schedule and monitor batch jobs, ensuring timely and successful execution.
Troubleshoot and resolve issues related to batch processing.
Collaboration and Communication:
Work closely with data analysts, data scientists, and other stakeholders to understand requirements and deliver solutions.
Document data integration processes, workflows, and best practices.
Provide support and training to team members as needed.
Qualifications:
Experience:
10+ years of experience in data engineering or related roles.
Proven experience with Informatica IDMC, minimum 5 years of experience using IDMC.
Strong Unix/Linux skills, including Scripting and system administration.
Proficiency with AWS cloud services and RDS databases.
Proficiency in batch orchestration tools such as AutoSys and Apache Airflow.
Excellent problem-solving and analytical skills.
Strong understanding of data integration and ETL processes.
Ability to work in a fast-paced, dynamic environment.
Strong communication and interpersonal skills.
Proficiency with CI/CD pipelines and DevOps practices.
30 Jan 2025
Edinburgh, Midlothian
Full time
Tehnologia informaţiei, Telecomunicaţii