Azure Data Engineer

We are looking to hire Azure Data Engineers for a client who is a leader in the AI and Analytics solution. You will work on a broad range of cutting-edge data analytics problems.

\n
• Design and build scalable & metadata driven data ingestion pipelines (For Batch and Streaming Datasets)
\n
• Execute high-performance data processing for structured and unstructured data, and data harmonization
\n
• Schedule, orchestrate, and validate pipelines
\n
• Design exception handling and log monitoring for debugging
\n
• Make tech stack and tools related decisions
\n
• Collaborate with business consultants, data scientists, and application developers to develop analytics solutions
\n

\n
• 4 to 8 years of total IT experience with 2+ years on big data engineering and Microsoft Azure.
\n
• Strong Hands-on experience in implementing Data Lake with technologies like:
\n
• Mandatory: Azure Data Factory (ADF), PySpark, Databricks, ADLS, Azure SQL Database
\n
• Strong programming, unit testing & debugging skills in SQL, Python or Scala/Java.
\n
• Some experience of using big data technologies like Hadoop, Spark, Airflow, NiFi, Kafka, Hive, Neo4J, Elastic Search.
\n
• Good Understanding of different file formats like Delta Lake, Avro, Parquet, JSON and CSV.
\n
• Experience of working in Agile projects and following DevOps processes with technologies like Git, Jenkins & Azure DevOps.
\n

Location: Delhi/ NCR/ Gurgaon/ Pune

Availability: Available to Join within 30 to 45 Days