Skip to main content
Posted 13 June, 2026

Azure Data Engineer

Diverse Lynx
Pune,Maharashtra,411057 Full Time
Reference: 365_569689_22-02165
Job Description
Scala/Python Standalone:
  • For processes such as SFTP, S3 Data Transfer or any process standing outside Spark Based Runs
Databricks:
  • Notebook Development for Data Ingestion, Data Transformation and Enhancements using Spark with Scala/Pyspark.
  • Delta table utilization for DataWarehousing
  • Compute Instance Utilization
  • Databricks Job Utilization for ETL Pipeline stages
Airflow:
  • Automation of Data Processing Pipelines, with knowledge of Connectors to SSH, SFTP, Databricks
Azure Log Analytics:
  • Logging tool to capture Logging from Applications
Elastic Search:
  • Utilization for Log Analytics and Dashboard to support Pipeline Stage View based on Logs in Azure Log Analytics
Azure:
  • Comfortable with services setup and management such as Azure Storage Containers, Virtual Machines, Key Vault, Identity Access Management.
Terraform:
  • Utilize Terraform for automated Infrastructure Setup
Apply to this Job

Sign up for Job Alerts

By clicking Create Alert, you agree to the Global Terms of Use Agreement and acknowledge that you have read and understand the Global Privacy Policy.