Senior Data Engineer

Job Title: Senior Data Engineer

location: Bangalore (Offshore)

Duration: 3 Months

Role Summary

We are seeking an experienced Senior Data Engineer to lead the design, development, and delivery of large-scale Big Data solutions. The ideal candidate will possess strong expertise in Hadoop ecosystem technologies, distributed data processing, data modeling, SQL optimization, and team leadership. The role requires hands-on technical leadership while managing a team of data engineers and collaborating with business stakeholders.

Required Qualifications

• Education
• Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, Data Science, or a related field.
• Technical Skills
• Strong hands-on experience with:
• Hadoop Ecosystem (HDFS, MapReduce, Hive, Pig, HBase, Flume, Sqoop)
• Apache Spark and distributed computing frameworks
• Big Data querying tools such as Hive, Pig, and Impala
• NoSQL databases including Cassandra and HBase
• Relational databases such as PostgreSQL
• Strong programming experience in:
• Java
• Python
• Scala
• Advanced SQL development and performance tuning expertise.
• Experience with stream-processing technologies such as:
• Spark Streaming
• Apache Storm
• Strong Linux/Unix operating system knowledge.
• Experience in designing scalable data architectures and dimensional data models.
• Leadership & Soft Skills
• Proven experience leading backend/distributed data systems teams while remaining hands-on.
• Strong project planning, execution, and organizational skills.
• Excellent analytical and problem-solving abilities.
• Effective verbal and written communication skills.
• Ability to collaborate across teams and mentor junior engineers.
• Strong stakeholder and vendor management experience.

Preferred Skills

• Experience with Azure Cloud services and cloud-based data platforms.
• Knowledge of Data Science and Machine Learning tools and technologies.
• Experience with Cloudera Hadoop distribution.
• Exposure to programming/scripting languages such as:
• C++
• Ruby
• PHP
• R
• Familiarity with modern data engineering practices including CI/CD, DataOps, and DevOps.
• Experience contributing to open-source Big Data technologies.