Job Title: Data Engineer – PySpark & Azure Databricks
Experience: 5+ Years
Location: Gurugram
Job Summary
We are seeking an experienced Data Engineer with 5+ years of expertise in PySpark and Azure Databricks to build, optimize, and maintain scalable data pipelines and ETL solutions on the Azure cloud platform.
Key Responsibilities
- Develop and optimize ETL/ELT pipelines using PySpark and Azure Databricks.
- Build scalable data solutions using Azure Data Factory and ADLS.
- Write efficient SQL queries and optimize Spark jobs for performance.
- Collaborate with cross-functional teams to deliver reliable data solutions.
- Ensure data quality, security, and best practices.
Required Skills
- 5+ years of Data Engineering experience.
- Strong hands-on experience with PySpark, Azure Databricks, SQL, Azure Data Factory (ADF), and ADLS.
- Good understanding of Delta Lake, Spark optimization, and Azure data ecosystem.
- Experience with Git and CI/CD is a plus.
