Brabers Consultancy
16/05/2024
Project-based
As a Hadoop Administrator, you will play a crucial role in managing and maintaining our Hadoop ecosystem to ensure optimal performance, reliability, and security. You will collaborate closely with our data engineers, analysts, and other stakeholders to understand their requirements and provide efficient solutions. Your responsibilities will include but are not limited to: Installing, configuring, and maintaining Hadoop clusters, including HDFS, YARN, Hive, HBase, Kafka, Spark, and other related technologies. Monitoring cluster health and performance, diagnosing and troubleshooting issues, and implementing solutions to minimize downtime. Capacity planning and scaling the Hadoop infrastructure to accommodate growing data volumes and user demands. Implementing and enforcing security policies, access controls, and data governance measures to protect sensitive information. Performing regular backups, disaster recovery planning, and data retention policies to ensure data integrity and availability. Collaborating with cross-functional teams to design and implement data pipelines, ETL processes, and data workflows. Evaluating new technologies and upgrades, conducting performance tuning, and optimizing resource utilization for cost efficiency. Providing technical guidance, training, and support to junior team members and end-users to promote best practices and knowledge sharing.