Lead Data Engineer
Job Description
This role is for one of the Weekday's clients
\nSalary range: Rs - Rs (ie INR 12-25 LPA)
\nExperience: 7+ yrs
\nLocation: Pune, Bangalore, Chennai, Coimbatore
\nJob Type: full-time
\nWe are looking for a skilled Data Engineer who is passionate about building scalable data platforms and enabling data-driven decision-making. This role involves designing, developing, and maintaining robust data pipelines, processing large-scale datasets, and ensuring the availability, reliability, and performance of data systems.
\nThe ideal candidate will have strong expertise in cloud-based data engineering, backend development, and modern data processing technologies. You will work closely with cross-functional teams to create efficient data solutions that support analytics, reporting, machine learning, and business intelligence initiatives.
\nRequirements
Key Responsibilities \n- \n
- Design, develop, and maintain scalable data pipelines for processing structured and unstructured data. \n
- Build and optimize cloud-based data solutions using modern data engineering best practices. \n
- Develop and manage data ingestion, transformation, validation, and orchestration workflows. \n
- Create reliable ETL/ELT pipelines to support analytics, reporting, and operational use cases. \n
- Work with large datasets to ensure data quality, consistency, and accessibility across systems. \n
- Develop and optimize backend services and data processing applications using Java. \n
- Implement data governance, monitoring, and performance optimization practices. \n
- Collaborate with product, analytics, and engineering teams to understand data requirements and deliver scalable solutions. \n
- Troubleshoot data pipeline issues and proactively identify opportunities for improvement. \n
- Ensure high availability, security, and scalability of data infrastructure. \n
- Participate in architecture discussions and contribute to data platform modernization initiatives. \n
- Support business intelligence, advanced analytics, and machine learning teams with reliable data assets. \n
- \n
- Strong experience in Data Engineering and building scalable data processing systems. \n
- Proficiency in Java and cloud-native data engineering practices. \n
- Hands-on experience with Google Cloud Platform (GCP) and its data ecosystem. \n
- Strong understanding of data warehousing, data modeling, and distributed data processing concepts. \n
- Experience building and maintaining high-performance ETL/ELT pipelines. \n
- Familiarity with BigQuery, Dataflow, and other cloud-based data processing technologies is highly desirable. \n
- Strong SQL skills and experience working with large-scale datasets. \n
- Understanding of data architecture, data governance, and data quality frameworks. \n
- Experience with workflow orchestration, monitoring, and automation tools. \n
- Strong analytical thinking and problem-solving abilities. \n
- Ability to collaborate effectively with cross-functional stakeholders and communicate technical concepts clearly. \n
- Self-driven mindset with a focus on ownership, scalability, and continuous improvement. \n