Azure Data Engineer

Key Responsibilities

• Design, develop, and maintain scalable data pipelines using Azure Databricks, Azure Data Factory (ADF), and Apache Airflow.
• Build and optimize ETL/ELT workflows for processing large-scale datasets.
• Develop data transformation logic using Python and SQL.
• Integrate data from multiple sources into Snowflake and Azure-based data platforms.
• Monitor, troubleshoot, and optimize data pipeline performance and reliability.
• Collaborate with data analysts, data scientists, and business stakeholders to deliver data solutions.
• Implement data quality, governance, and security best practices.
• Participate in code reviews, testing, deployment, and production support.
• Work in Agile/Scrum teams to deliver high-quality data engineering solutions.

Required Skills

• 5+ years of experience in Data Engineering.
• Hands-on experience with Azure Databricks.
• Strong experience with Azure Data Factory (ADF).
• Hands-on experience with Apache Airflow for workflow orchestration.
• Strong proficiency in SQL.
• Hands-on experience with Python.
• Experience working with Snowflake Data Warehouse.
• Good understanding of ETL/ELT processes and data modeling.
• Experience with Azure cloud services and data architecture.
• Strong analytical, problem-solving, and communication skills.

Preferred Skills

• Experience with Azure Data Lake Storage (ADLS), Delta Lake, or Spark.
• Knowledge of CI/CD pipelines and Azure DevOps.
• Familiarity with Git version control.
• Exposure to Power BI or other BI/reporting tools is an added advantage.