Data engineering Leader

Company Name: Our client a new GCC in Bangalore.

Role : Data engineering Leader

Location : Bangalore (Work from Office)

Key Responsibilities

\n
• Lead a technical team effectively while fostering collaboration across onshore and offshore teams.
\n
• Maintain a hands-on approach by actively writing and reviewing code daily.
\n
• Ensure team adherence to established data governance policies and standards.
\n
• Oversee the design, development, and maintenance of new and existing data pipelines.
\n
• Conduct regular code reviews and provide mentorship to the data engineering team.
\n
• Collaborate with the Head of Engineering to align with platform strategy and roadmap.
\n
• Support the Head of Engineering in managing software engineers as needed.
\n

Qualifications and Skills

\n
• Bachelor's, Master's, or Ph.D. in Computer Science or a related discipline.
\n
• A minimum of 8 years of experience in data engineering or related fields.
\n
• Proven expertise in working with Databricks.
\n
• Advanced knowledge of Azure Data Lake, Parquet, and Delta tables.
\n
• Strong experience with structured and semi-structured datasets.
\n
• Comprehensive understanding of ELT/ETL processes and their implementation in data pipelines.
\n
• Proficiency in developing, implementing, and integrating notebooks within data pipelines.
\n
• Expertise in configuring and managing data ingestion pipelines using Azure Data Factory or Databricks.
\n
• Extensive experience in programming languages such as Python, R, and SQL.
\n
• Familiarity with consuming and processing data from secure REST APIs.
\n
• Experience with data visualization tools like Power BI or Spotfire.
\n
• Knowledge of Azure DevOps (or similar tools) and CI/CD methodologies.
\n
• Strong communication skills with the ability to propose and discuss solutions effectively with both technical and business stakeholders.
\n
• Capability to present project updates and metrics to senior management.
\n