Number of Openings* |
1 |
Approved ECMS RQ# * |
530226 |
Duration of contract* |
2 years |
Total Yrs. of Experience* |
6+years |
Relevant Yrs. of experience* |
5+years |
Detailed JD *(Roles and Responsibilities) |
- Proficiency in Hadoop core components, including HDFS , MapReduce, and YARN
- Set up, configure, and manage Hadoop clusters using tools like Ambari, Cloudera Manager, or manual configurations
- Knowledge of distributed computing principles and the ability to design and implement distributed algorithms and data processing workflows.
- Proficiency in programming languages commonly used in the Hadoop ecosystem, such as Java, Scala, Python
- and scripting
- Optimizing Hadoop cluster for performance and scalability.
- Troubleshooting and resolving performance bottlenecks
- Experience with monitoring tools like Grafana or Ambari Metrics
- Familiarity with log analysis tools to identify and address issues
- Understanding of cluster security, including authentication and authorization mechanisms
- Proficiency in scripting languages (e.g., Shell, Python) for automation of cluster management tasks
- Knowledge of deploying Hadoop clusters and Big Data Ecosystem components
- Knowledge of data compression techniques for efficient storage and retrieval
- Participate in on-call rotations to respond to incidents and outages promptly
- Conduct post-incident reviews (PIRs) to identify root causes and prevent future incidents
- Experience with setting up CI/CD pipelines and maintaing dev-ops set up for Big Data Platform
- Design, build, and maintain a robust and scalable big data platform that can handle large volumes of data from various sources
|
skills* |
Hadoop,Hive, Spark,Ambari, Grafana, SQL, Nifi, Iceberg,Druid, Oozie, Airflow, Hbase, Linux/OS Services and server administration and shell scripting
Cloudera/Hortonworks/Hadoop Admistror cerifcation preferred
|
Domain* |
Manufacturing |
vendor billing rate* (INR/day) |
8700 INR/day |
Work Location* |
Any location (Bangalore is preferable) |
|
Background check process to be followed: *
Before onboarding / After onboarding: *
BGV Agency: *
|
Before |
Mode of Interview: Telephonic/Face to Face/Skype Interview* |
Skype |
