Description:
Skills: Databricks, PySpark,Python ( Good to have Azure/AWS data services knowledge)
Role: Lead a team of data engineers and do data migration from AWS to Databricks.
Responsibilities
Lead and mentor the data engineering team.
Design and develop data pipelines using Databricks (and identify underlying AWS Data Services).
Usage of DBX DLT in migration.
Develop automation and transformation logic using Python.
Build and optimize data models, ETL/ELT workflows, and Lakehouse/Delta Lake solutions.
Ensure data quality, performance, and adherence to governance and security standards.
Collaborate with stakeholders and ensure timely project delivery.
Required Skills
Strong hands on experience with Databricks, SQL, and pySpark/ Python.
2+ years leading teams or owning end to end delivery.
Strong communication, problem solving skills.
