Databricks Arhitect

Job Title: Architect

Location: Chennai

Key Responsibilities

l Architect and implement enterprise-grade Lakehouse solutions using Databricks

l Design and deliver scalable batch and real-time data pipelines using Apache Spark (PySpark/SQL)

l Build ETL/ELT pipelines, incremental data loads, and metadata-driven ingestion frameworks

l Implement and optimize Databricks components: Delta Lake, Delta Live Tables, Autoloader, Structured Streaming, and Workflows

l Design large-scale data warehousing solutions with 3NF and dimensional modeling

l Establish data governance, security, and data quality frameworks, including Unity Catalog

l Lead ML lifecycle management using MLflow and drive AI use cases (RAG, AI/BI)

l Manage cloud-native deployments on Microsoft Azure and integrate with enterprise systems (e.g., ServiceNow)

l Drive CI/CD, DevOps practices, and performance optimization of Spark workloads

l Provide technical leadership, mentor teams, and ensure successful delivery

l Collaborate with stakeholders to translate business requirements into scalable solutions