Azure databricks_python-pyspark

Description:

Skills: Databricks, PySpark,Python ( Good to have Azure/AWS data services knowledge)
Role: Lead a team of data engineers and do data migration from AWS to Databricks.
Responsibilities
Lead and mentor the data engineering team.
Design and develop data pipelines using Databricks (and identify underlying AWS Data Services).
Usage of DBX DLT in migration.
Develop automation and transformation logic using Python.
Build and optimize data models, ETL/ELT workflows, and Lakehouse/Delta Lake solutions.
Ensure data quality, performance, and adherence to governance and security standards.
Collaborate with stakeholders and ensure timely project delivery.
Required Skills
Strong handson experience with Databricks, SQL, and pySpark/ Python.
2+ years leading teams or owning endtoend delivery.
Strong communication, problemsolving skills.

ECMS REQ ID

BP1150

Project Location 1

KRNK | BANGALORE

Project Location 2

TELANGANA | HYDERABAD

Project Location 3

TN | CHENNAI

Project Location 4

MAH | PUNE

Delivery SPOC

Saptarshi Biswas

Relevant Experience

8+Years

Mandatory skills

Databricks, Python, Pyspark ,

Desired skills

Databricks, ADF, Python, AWS Data services like Glue

Domain (Industry)

Energy

BGC (Before onboarding / After onboarding)

PostOB

Total Experience (Ex. 5-7 Years)

6+Years

BGC Details

Any

BGC Vendor

Any

Mode of Interview

Video Interview

WFO / WFH / Hybrid

Hybrid

Please enter shift timings

As Per Client

Shift Timings

Others