Azure Synapse with Pyspark

Description

"Job Description – Data Engineer (Azure Synapse | PySpark)
Role: Data Engineer
Experience: 5–12 years
Location: [Pune / India / Hybrid ]
Engagement Type: Contract

Role Summary
We are seeking a highly skilled Data Engineer with strong handson experience in Azure Synapse Analytics and PySpark to design, develop, and optimize scalable cloudbased data pipelines. The role involves working on largescale analytical platforms, enabling advanced reporting, analytics, and datadriven decisionmaking in enterprise (preferably banking or financial services) environments.

Key Responsibilities
1. Data Engineering & Pipeline Development

Design, build, and maintain scalable data pipelines using Azure Synapse Analytics and PySpark.
Develop batch and incremental ingestion pipelines from multiple source systems (RDBMS, flat files, APIs, cloud sources).
Implement robust data transformation frameworks following ELT/ETL best practices.

2. Azure Synapse & Spark Development

Develop highperformance data transformations using PySpark (DataFrames, Spark SQL).
Work with Synapse Dedicated SQL Pools and Serverless SQL Pools for analytical workloads.
Optimize Spark jobs through partitioning, caching, and performance tuning techniques."