Senior Azure Data Engineer (ADF, Databricks, PySpark)
Job Description
Exciting Opportunity Alert! HTC Global Services is hiring Senior Azure Data Engineer (ADF, Databricks, PySpark) for one of our premium projects.
Job Summary
We are looking for a skilled Senior Azure Data Engineer with strong experience in building scalable data pipelines using Azure services. The ideal candidate should have hands-on expertise in Azure Data Factory (ADF), Databricks, PySpark, and SQL , along with exposure to modern data engineering practices.
Key Responsibilities
- Design, develop, and maintain scalable data pipelines using ADF and Azure Databricks
- Implement data transformation workflows using PySpark
- Work with structured and unstructured data in Azure data platforms
- Optimize data pipelines for performance, reliability, and cost efficiency
- Develop and manage Spark-based data processing frameworks
- Collaborate with stakeholders to understand data requirements and deliver solutions
- Ensure data quality, governance, and security standards are maintained
- Troubleshoot and resolve production issues in data workflows
Required Skills
- Strong experience in Azure Data Engineering stack Azure Data Factory (ADF)
- Azure Data bricks
- Hands-on experience with PySpark and Spark
- Strong SQL skills
- Experience with data warehousing concepts and ETL/ELT processes
- Good understanding of distributed data processing
Good to Have
- Exposure to Spark Declarative Pipelines / Lakeflow (Delta Live Tables concept)
- Experience with Delta Lake
- Knowledge of CI/CD pipelines in Azure
- Experience with data modeling and optimization techniques
#HTCGlobalServices #ITJobs #hiring #lookingforjob #careers #jobs #immediatejoiner #recruitment #technology #jobseekers #interview #lookingforjobchange #newjob #Azuredataengineer #ADF #ADB #Databricks #Lakeflow #DLT #DeltaLake #pyspark #spark
