Hadoop Admin

Role: Hadoop Admin

Location: Chennai/Kolkata/Pune/Hyderabad

Exp: 4-8 yrs

Mode of interview : Virtual

Must Have Skills:

Minimum 5 mandate details are mandate with two or 3 liners

Cluster Management:

• Install, configure, and maintain Hadoop clusters (HDFS, YARN, MapReduce)
• Manage multi-node cluster deployments across development, staging, and production environments
• Perform cluster upgrades, patches, and version migrations
• Monitor cluster health, performance metrics, and resource utilization
• Implement and manage high availability (HA) configurations for NameNode and ResourceManager

Security & Governance:

• Configure and manage Kerberos authentication
• Implement HDFS encryption (at-rest and in-transit)
• Manage user access controls, ACLs, and permissions
• Integrate with LDAP/Active Directory for centralized authentication
• Implement data governance policies and compliance requirements

Performance Optimization:

• Tune HDFS parameters (block size, replication factor, balancing)
• Optimize YARN resource allocation and scheduling
• Monitor and resolve cluster bottlenecks
• Implement capacity scheduler and fair scheduler configurations
• Manage disk space, data retention, and archival policies

Backup & Recovery:

• Implement disaster recovery strategies
• Manage HDFS snapshots and backups
• Perform cluster failover testing
• Document recovery procedures