Job Description:
· At least 8-10 years of experience in development of data solutions using cloud platforms
· Strong programming skills in Python, Spark, Databricks
· Strong SQL skills and experience writing complex yet efficient SPROCs/Functions/Views using T-SQL
· Solid understand of spark architecture and experience with performance tuning big data workloads in spark
· Building complex data transformations on both structure and semi-structured data (XML/JSON) using Spark & SQL
· Familiarity with Azure Databricks environment
· Good understanding of Azure cloud ecosystem; Azure data certification of DP-200/201/203 will be an advantage
· Proficient source control using GIT
· Good understanding of Agile, DevOps and CI-CD automated deployment (e.g. Azure DevOps, Jenkins)
· Good understanding of Servicenow, BAU process, ready to work in shifts
Essential Skills:
Azure, Python/Spark, SQL, Databricks
Desirable Skills:
Azure, Python/Spark, SQL, Databricks
