Posted 09 July, 2026
Databricks Lead
Veracity
Gurgaon,Haryana,India
Full Time
Reference: 365_621153_25-02568
Databricks Lead (8-10 years):
Location – Gurugram ( No Noida profiles to be considered. Gurgaon and Delhi Client is fine. )
Location – Gurugram ( No Noida profiles to be considered. Gurgaon and Delhi Client is fine. )
- Conceptualize and communicate Data architecture strategy, technical design and technology roadmap for data platform solutions and services.
- Lead design and development of data architecture to support implementation of large-scale data solutions in Databricks to support multiple use cases (delta lake, cloud Datawarehouse migrations, reporting and analytics).
- Guiding the organization and development teams on the overall data processes, architectural approaches for data strategy design and implementation.
- Providing data solutions that enable business intelligence data integrations, data services, self-service analytics, and data-driven digital products and services.
- Articulating the value proposition of cloud modernization/transformation to stakeholders; creating detailed documentation that empowers other engineers and customers.
- Architecting the solutions for Databricks-specific use cases (streaming and batch) as well as integrating it into other solution components in the customer architecture landscape.
- Translating the advanced business data, integration and analytics problems into technical approaches that yield actionable recommendations, across multiple, diverse domains.
- Implement architectural improvements for existing solutions using legacy modernization and cloud adoptions strategies.
- Creating Azure Data Factory processes for SQL and NoSQL data pipelines, and work in Azure SQL, to create tables, views, stored procedures, and other database objects.
- Creating applications through Scala, Python, and Java.
- Developing Spark tasks for data aggregation and transformation
- Writing Scala style documents with each code.
- Identifying technical issues (performance bottlenecks, data discrepancies, system defects) in data and software, perform root cause analysis, and communicate results effectively to the development team and other stakeholders
- Providing recommendations on opportunities and improvements and participating in technology and analytics proof-of-concepts
- 8 years of experience with Azure Databricks, Azure Data Factory, and Pyspark
- 5 years' experience with deployment and builds using Azure DevOps
- 3 years' experience with Python to extract data from unstructured files, such as XML, PDF, HTML
- Experience in an agile development environment, or an understanding of the concepts of Agile software development
- Excellent communication, organization, technical, and project management skills
- Experience in leading projects relating to cloud modernization, data migration, data warehousing experience with cloud-based data platforms (Databricks/Apache Spark); preferably Databricks certified; experience driving technical workshops with technical and business clients to derive value added services and implementation.
- Hands-on working knowledge of topics such as data security, messaging patterns, ELT, Data wrangling and cloud computing and proficiency in data integration/EAI and DB technologies, sophisticated analytics tools, programming languages or visualization platforms
