Design, develop, and maintain Azure Data Factory pipelines for data ingestion, transformation, and orchestration.
Work with various data sources including Azure Blob Storage, Data Lake, SQL Server, APIs, and on-premise systems.
Build and maintain data integration and ELT/ETL processes using ADF, Data Flows, and other Azure components.
Collaborate with data architects, analysts, and stakeholders to gather requirements and translate them into technical specifications.
Implement data validation, error handling, and logging mechanisms in ADF.
Optimize pipeline performance, monitor execution, and troubleshoot issues.
Work with Azure Data Lake Storage Gen2, Azure Synapse Analytics, and Azure SQL Database for end-to-end data workflows.
Ensure adherence to data governance, security, and compliance standards.
