Posted 13 June, 2026
Hadoop Admin
Diverse Lynx
Bangalore,Karnataka
Full Time
Reference: 365_569689_23-01556
Job Description:-
- Proven experience as a Hadoop Administrator, with a focus on cloud migrations.
- Strong expertise in managing Hadoop clusters (HDFS, YARN, Hive, Spark, etc.)
- Strong understanding of various schedular inside resource manager
- Proficiency in cloud platforms such as AWS and Google Cloud.
- Solid understanding of Big Data technologies and best practices.
- Experience with automation and scripting (e.g., Bash, Python).
- Excellent problem-solving skills and attention to detail.
- Strong communication and teamwork skills.
- Relevant certifications (e.g., Cloudera Certified Administrator, AWS Certified Solutions Architect) is a plus.
- Deploy, configure, and maintain Hadoop clusters in a cloud environment (e.g., AWS, Azure, Google Cloud).
- Monitor cluster performance, health, and resource utilization.
- Implement best practices for Hadoop cluster security and data governance.
- Optimize Hadoop clusters for maximum performance and resource utilization.
- Should be able to identify right sizing of the cluster for specific jobs
- Identify and resolve performance bottlenecks.
- Implement and maintain automation scripts for routine tasks.
- Implement security measures, including access controls, encryption, and authentication mechanisms, to safeguard data in the cloud
- Develop and maintain backup and disaster recovery strategies for Hadoop data in the cloud.
- Conduct regular data backups and perform recovery tests.
- Create and maintain documentation for Hadoop configurations, procedures, and best practices.