Solution Architect - Databricks (India)

As a Solution Architect – Databricks , you will design and deliver enterprise‑grade data solutions on Azure Databricks, leading a large‑scale data modernisation programme for a telecommunications client. You will architect migration strategies, define governance frameworks, and provide technical leadership to ensure seamless transformation from legacy data warehousing systems to a modern lakehouse architecture.\n\nWhat You’ll Do and How You’ll Succeed\n\nArchitecture & Design\nDesign and architect end‑to‑end data pipelines using Azure Databricks with Medallion Architecture (Bronze Silver Gold Semantic layers).\nLead hybrid orchestration frameworks combining DLT‑Lakeflow for CDC ingestion and metadata‑driven frameworks for transformation layers.\nDefine and implement Unity Catalog governance strategies for data access, security, and lineage.\nArchitect Databricks Workflows for job scheduling, dependency management, and replacing legacy Control‑M orchestration.\nDesign SCD Type 2 implementations and complex transformation patterns for EDW migration.\n\nTechnical Leadership\nProvide guidance on PySpark and Spark SQL best practices for large‑scale data processing.\nDefine coding standards, modular notebook organisation, and configuration‑driven development approaches.\nLead technical decisions on schema evolution, data quality frameworks, and reconciliation strategies.\nRecommend approaches for surrogate key generation, batch control mechanisms, and selective reprocessing.\n\nMigration & Modernisation\nArchitect migration strategies from legacy systems (ODS, EDW, Informatica PowerCenter) to Azure Databricks lakehouse.\nDesign CDC ingestion patterns using Oracle GoldenGate and Informatica IDR integration.\nDefine approaches for historical data migration and parallel run strategies.\nEnsure minimal refactoring of existing SQL/PySpark code through metadata‑driven frameworks.\n\nOperational Excellence\nDesign solutions supporting BAU operations including manual data patching, hold/resume/skip controls, and entity‑level reprocessing.\nArchitect job/cycle/batch auditing frameworks aligned with existing operational patterns.\nDefine monitoring, alerting, and logging strategies across all pipeline layers.\nEnsure solutions support targeted fixes without requiring full refreshes.\n\nStakeholder Engagement\nCollaborate with Amdocs and customer architecture teams on design approvals and technical alignment.\nParticipate in discovery sessions for EDW entities (DDS, SDS, DNF).\nPresent technical solutions and trade‑off analyses to leadership and steering committees.\nWork closely with delivery teams to translate designs into implementable solutions.\n\nWe’d Love to Hear From You If…\n\nExperience\nYou have 8+ years in data engineering and architecture roles.\nYou have 4+ years of hands‑on experience with Databricks (Delta Lake, Spark, Unity Catalog).\nYou have 3+ years of experience with Azure cloud services (ADLS Gen2, Azure DevOps, Azure Data Factory).\nYou have proven experience in large‑scale data migration projects, ideally EDW modernisation.\n\nTechnical Expertise\nYou are expert in Azure Databricks (Delta Lake, DLT/Lakeflow, Databricks Workflows, Unity Catalog).\nYou are proficient in PySpark and Spark SQL for optimised transformations.\nYou have hands‑on experience with Medallion Architecture (Bronze/Silver/Gold).\nYou are skilled in dimensional modelling, SCD implementations, and surrogate key strategies.\nYou are experienced in metadata‑driven ETL/ELT frameworks.\nYou have worked with CDC tools such as Oracle GoldenGate or Kafka.\nYou are familiar with data quality frameworks, reconciliation, and exception handling.\nYou are experienced with Git, CI/CD pipelines, and Databricks Asset Bundles (DAB).\nPreferred: Power BI, Informatica PowerCenter/IDR, Control‑M, Terraform/IaC, telecommunications domain.\n\nWays of Working\nYou have strong analytical and problem‑solving abilities.\nYou communicate complex technical concepts clearly to diverse audiences.\nYou collaborate effectively across distributed teams and time zones.\nYou mentor and guide junior team members.\nYou document design decisions thoroughly (HLSD, LLD).\nYou bring a collaborative mindset when working with customer stakeholders.\n\nCertifications (Preferred)\nDatabricks Certified Data Engineer Professional\nDatabricks Certified Solution Architect Professional\nMicrosoft Azure Data Engineer Associate (DP‑203)\nMicrosoft Azure Solutions Architect Expert (AZ‑305)\n\n---\n\nWho We Are\n\nThakral One is a consulting and technology services company headquartered in Singapore, with a pan-Asian presence. We focus primarily around technology-driven consulting, adoption of value-added bespoke solutions, enabling enhanced decision support through data analytics, and embracing possibilities in the cloud.