Databricks - Principal Data Engineer
Core Responsibilities:
Databricks Architecture - Design, optimize, and manage endtoend data pipelines using Databricks (Spark, Delta Lake, Unity Catalog).
ETL/ELT Pipelines - Build scalable ingestion and transformation frameworks for structured and semistructured data.
Cloud Platforms - Implement solutions on Azure/AWS/GCP with strong understanding of compute, storage, and networking.
Data Warehouse Modernization - Lead migration from legacy systems to modern lakehouse architectures.
Team Leadership - Mentor engineers, conduct design reviews, and drive delivery excellence.
Customer Engagement - Lead technical discussions, requirement workshops, and solution walkthroughs.
Required Skills & Qualifications"
Databricks Expertise: Deep knowledge of Unity Catalog, Photon engine, Databricks SQL, and optimization.
Cloud Infrastructure: Proven experience architecting scalable data solutions on Azure, AWS, or GCP.
Data Warehousing: Advanced mastery of ETL/ELT pipeline design, data modeling, and performance tuning.
Soft Skills: Exceptional analytical thinking, stakeholder management, and clear technical articulation.
Strong command of Spark, Delta Lake, Python/Scala, SQL, CI/CD, DevOps.
Experience with largescale DWH, performance tuning, and data modeling.
Proven ability to lead multiteam delivery in enterprise environments.
Total Experience: 12 years
Relevant Experience: 7 years in Databricks and cloud data engineering
Location: Hybrid
Employment Type: Full-time