Minimum 5 years of PySpark Development experience, especially in Spark SQL and Complex TransformationsMinimum 3 years of Python development experienceMinimum 2 years of experience in Azure Databricks, Azure DatabasesPySpark, Databricks, Azure ADLS, Experience in working with Azure cloud, Delta Lake, SQLCandidate must have 3 years of hand on experience in above skillsCandidate must have good communication, which need to be accessed by sharing problem scenarios and his solutioning skillspyspark hands on complex transformations and important conceptsTransformations, aggregations, window functionsfile formats and handling, schema handling, data handling, data type conversionsDelta Lake - versioning, recovering conceptscheck coding skills with tricky programming scenariosproblemsBig Data handling, performancecomplex sql problems
