Bigdata Hadoop Engineer -- Pune

Job Summary:

We are seeking a highly skilled and motivated Big Data Hadoop Engineer to join our data engineering team. The ideal candidate will be responsible for designing, developing, and maintaining big data solutions using the Hadoop ecosystem. You will work closely with data scientists, analysts, and other engineers to support scalable and efficient data pipelines.

Key Responsibilities:

• Design and implement big data solutions using the Hadoop ecosystem (HDFS, MapReduce, Hive, Pig, HBase, etc.)

• Develop data ingestion pipelines using tools such as Sqoop, Flume, Kafka, and NiFi.

• Build and maintain ETL jobs using Apache Spark or Hive.

• Optimize data processing performance and manage large-scale data infrastructure.

• Ensure data quality, integrity, and security in all big data operations.

• Collaborate with cross-functional teams to understand data requirements and deliver solutions.

• Monitor and troubleshoot production systems and data pipelines.

• Maintain and improve the scalability and performance of big data environments.

• Automate operational workflows using scripts (Python, Shell, etc.)