Azure Data Engineer

TCS Hiring for Azure Data Engineer- Azure Databricks

Experience Range: - 06 To 10 Years (Mandatory)

(Note: Candidates below 6 years of IT experience shall not be considered)

Job Locations : Mumbai

JOB DESCRIPTION

Must have Skills: Azure Data Factory, Azure Databricks

Good to have Skills: Python, Pyspark

Responsibilities or Expectations from the Role:

• Implementing highly performant, scalable and re-usable data ingestion and transformation pipelines across Azure components and services
• Strong experience using Logic Apps, Functions & Data Factory
• Strong experience of development using Microsoft Azure as well as experience of developing integrations for large, complex pieces of software.
• Strong understanding of the technical side of CI / CD
• Strong understanding of Agile
• Designing and implementing a data warehouse on Azure using Azure HDInsight, Azure Data Factory, ADLS, Databricks, SQL Server, SQL DWH, Analytics Service, Event Hubs, KeyVault and other Azure services
• Designing, orchestrating and implementing highly performant, scalable and re-usable data ingestion and transformation pipelines across Azure components and services
• Designing and implementing Event based and streaming data ingestion and processing using Azure PaaS services
• Data ingestion, data engineering and/or data curation using native Azure services or tools available in Azure Marketplace
• Designing and implementing data governance, data cataloguing and data lineage solutions using tools such as Azure Data Catalog/Informatica Data Catalog
• Developing physical data models in MongoDB, SQL DWH , ...etc.
• Developing APIs
• Have worked in agile delivery teams with DevOps ways of working to continuously deliver iterative deployments with experience in using Jira, Git Repositories, Confluence, or similar
• Have had experience in data migration activities in the past including migration strategy and approach, source and target system discovery, analysis, mapping, development and reconciliation

Minimum Qualification:

15 years of Full Time Education