Azure Data Brick
Key Responsibilities:
Design, develop, and optimize data pipelines and ETL processes using Azure Data Factory (ADF), Databricks, Azure Synapse Analytics, and related services.
Develop and maintain data lakes, data warehouses, and relational/non-relational databases in Azure.
Implement data ingestion, transformation, and integration workflows from various sources (structured, semi-structured, and unstructured).
Ensure data quality, data governance, and security best practices across all data platforms.
Collaborate with data scientists, analysts, architects, and business stakeholders to understand data requirements and deliver solutions.
Monitor performance and troubleshoot issues in Azure data infrastructure.
Automate workflows using scripting tools such as PowerShell, Python, or SQL.
Participate in Agile development processes and provide input for continuous improvement.