Lead Big Data Engineer
Salary: £94,000 DOE
Location: London (4 days a week on site)

* MUST HOLD AN ACTIVE DV CLEARANCE.*

Benefits: Health care, dental, flexible working, critical illness cover, health assessments and annual incentive programme.
As the Lead Big Data Engineer, you will play a pivotal role in designing, implementing, and maintaining our big data architecture. You will work with the wider teams to ensure seamless data integration


Responsibilities:

• Develop and maintain scripts for automation processes and work flows
• Conduct thorough testing to ensure seamless integration
• Data pipeline support by managing and optimising
• Utilise detailed knowledge of Linux internals
• Troubleshooting by diagnosing and resolving technical issues
• Following network protocols
• Design scalable big data systems
• Data pipeline support
• Hybrid cloud management
• Implement and support Business Intelligence and visualisation tools
• Utilise big data NoSQL engines and platforms

Requirements:

• Experience with Python/Bash
• Strong troubleshooting skills
• Strong understanding of TCP/IP and OSI Models proven experience with integration testing
• Strong knowledge of Linux internals
• Experience working in AWS Cloud environment's
• Big data NoSQL
• Experience AI tools such as Jupyter/Spacy
• Business intelligence tools like Tableau/Power BI
• AWS Certification (desirable)
• Big data tools and technologies. Hadoop/Cloudera (desirable)

If you have the required skills set, and this role is of interest please apply online or email