Data Engineer

This role is for one of the Weekday's clients

Salary range: Rs 1300000 - Rs 2600000 (ie INR 13-26 LPA)

Experience: 5+ yrs

Location: Pune, Maharashtra, India

Job Type: Full-Time

We are seeking an experienced Azure Databricks Engineer to design, develop, and optimize scalable cloud-based data engineering solutions. This role is ideal for professionals with strong expertise in Azure Databricks, SQL, and ETL development, who are passionate about building high-performance data pipelines and enabling data-driven business decisions.

As an Azure Databricks Engineer, you will work closely with data architects, analysts, and cross-functional teams to develop robust ETL workflows, optimize data processing, and ensure reliable data availability for analytics and reporting. You will play a key role in modernizing data platforms, improving pipeline performance, and implementing best practices for cloud-based data engineering.

Requirements

Key Responsibilities

• Design, develop, and maintain scalable ETL/ELT pipelines using Azure Databricks and cloud-native technologies.
• Build and optimize data ingestion, transformation, and processing workflows for structured and semi-structured data.
• Develop complex SQL queries, stored procedures, and data transformation logic to support reporting and analytics.
• Collaborate with business stakeholders, data architects, and analytics teams to understand data requirements and deliver scalable solutions.
• Optimize Azure Databricks workloads for performance, scalability, and cost efficiency.
• Implement data quality checks, validation processes, and monitoring to ensure data accuracy and reliability.
• Troubleshoot data pipeline failures, resolve performance bottlenecks, and support production environments.
• Integrate data from multiple sources while ensuring consistency, governance, and security standards.
• Participate in data modeling, documentation, and continuous improvement initiatives across the data platform.
• Follow best practices for version control, deployment, testing, and cloud-based data engineering.

What Makes You a Great Fit

• Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field.
• Strong hands-on experience with Azure Databricks, SQL, and ETL development.
• Experience designing and developing cloud-based data pipelines and large-scale data processing solutions.
• Proficiency in writing and optimizing complex SQL queries for high-performance data processing.
• Strong understanding of data warehousing concepts, data modeling, and ETL/ELT best practices.
• Experience working with Azure cloud services and modern data engineering architectures.
• Knowledge of data integration, workflow orchestration, and cloud storage solutions.
• Strong analytical, troubleshooting, and performance optimization skills.
• Experience implementing data quality, governance, and security best practices.
• Excellent communication and collaboration skills with the ability to work effectively across cross-functional teams.
• A proactive mindset with a passion for building scalable, reliable, and efficient cloud data solutions while continuously improving engineering processes.