Develop, maintain, and optimize ETL/ELT pipelines using Apache Spark on the Databricks platform.
Implement data lakehouse architecture leveraging Delta Lake, Unity Catalog, and Medallion architecture (bronze, silver, gold layers).
Work with data architects and analysts to understand business requirements and translate them into scalable data solutions.
Automate data workflows and ensure robust data quality and governance across all stages of the pipeline.
