Algotale-Delphi( Azure Databricks Developer)

Company: Algotale
Location: Bangalore / Pune, India
Experience: 6+ Years

Algotale is seeking a skilled Azure Databricks Developer to design, develop, and optimize scalable data solutions on the Azure cloud platform. The ideal candidate will have strong expertise in big data processing, ETL pipelines, and distributed computing using Databricks.

\n
• Develop and maintain scalable data pipelines using Azure Databricks
\n
• Design and implement ETL/ELT workflows using PySpark / Spark SQL
\n
• Work with Azure Data Lake Storage (ADLS) , Azure Synapse , and other Azure services
\n
• Optimize performance of Spark jobs and data workflows
\n
• Collaborate with data engineers, analysts, and business stakeholders
\n
• Implement data quality checks, monitoring, and logging
\n
• Ensure data security and governance best practices
\n
• Troubleshoot and resolve data pipeline issues
\n

\n
• Strong experience with Azure Databricks
\n
• Proficiency in Python (PySpark) and SQL
\n
• Experience with Apache Spark and distributed data processing
\n
• Hands-on experience with Azure ecosystem : \n
  \n
  • Azure Data Factory (ADF)
  \n
  • Azure Data Lake Storage (ADLS)
  \n
  • Azure Synapse Analytics
  \n
\n
• Understanding of data warehousing concepts
\n
• Experience in building batch and streaming pipelines
\n
• Familiarity with version control tools like Git
\n

\n
• Experience with Delta Lake
\n
• Knowledge of CI/CD pipelines (Azure DevOps)
\n
• Exposure to Kafka / Event Hubs for streaming
\n
• Understanding of data modeling techniques
\n
• Certifications in Azure (e.g., DP-203) are a plus
\n

\n
• Strong problem-solving and analytical skills
\n
• Good communication and collaboration abilities
\n
• Ability to work in an agile environment
\n

\n
• Opportunity to work on cutting-edge cloud data technologies
\n
• Collaborative and growth-oriented environment
\n
• Exposure to large-scale data engineering projects
\n