Data Engineer
Objective: Build and maintain data pipelines and infrastructure to support data storage and processing.
Key Responsibilities:
- Design, develop, and optimize data pipelines using Azure Databricks.
- Ensure data reliability, scalability, and quality.
- Integrate data sources into a unified platform.
- Monitor and troubleshoot data workflows.
Skills Required:
- Expertise in Azure Databricks, Spark, and big data tools.
- Strong programming skills (e.g., Python, Scala, SQL).
- Knowledge of ETL processes and cloud technologies.
- Familiarity with CI/CD practices for data pipelines.
