Posted 25 July, 2026
Lead Data Engineer
ClifyX
Bengaluru,Karnataka,India
Full Time
Reference: 365_594563_26-07407
Job Description
We are looking for an experienced Lead Data Engineer with strong expertise in Azure Databricks, Azure Data Factory (ADF), PySpark, and SQL to design, develop, and optimize scalable data engineering solutions. The ideal candidate should have hands-on experience building modern data platforms on Azure and leading technical teams.
Key Responsibilities
We are looking for an experienced Lead Data Engineer with strong expertise in Azure Databricks, Azure Data Factory (ADF), PySpark, and SQL to design, develop, and optimize scalable data engineering solutions. The ideal candidate should have hands-on experience building modern data platforms on Azure and leading technical teams.
Key Responsibilities
- Design and develop scalable data pipelines using Azure Databricks and Azure Data Factory (ADF).
- Build and optimize ETL/ELT workflows using PySpark.
- Develop complex SQL queries, stored procedures, and performance tuning.
- Implement data integration solutions from multiple structured and unstructured data sources.
- Design and maintain data lakes and modern data warehouse solutions.
- Ensure data quality, governance, security, and performance optimization.
- Collaborate with business stakeholders, architects, and cross-functional teams to understand requirements.
- Lead code reviews, mentor junior engineers, and drive engineering best practices.
- Troubleshoot production issues and implement scalable solutions.
- Work in Agile/Scrum development environments.
