| Job Description: |
Req ID- 10470865
Job Title: Developer
Work Location: Hyderabad
Skill Required: Azure Databricks
Experience : 4-10 years
Job Description:
Associate must have 4+ years' Python & Linux Bash script Development experience. Azure Databricks, pyspark, Python, Linux Bash Script, blob storage, azure key vault, GitHub, Git Actions, data lake.
Must Have exp - Azure Databricks, pyspark, Python, Linux Bash Script, blob storage, azure key vault, GitHub, Git Actions.
Strong development experience in PySpark/Databricks.
Basic knowledge on Python.
Should have knowledge on Medallion Architecture.
Should have end to end data ingestion development through Medallion Architecture.
Strong knowledge on Delta table.
Databricks Performance optimization
Handling Data skewness.
Partitions and cluster in Databricks
Pyspark transformations
Advanced topic
------------------------
Should have knowledge and hands on experience on Unity Catalog.
Knowledge on auto Loader.
Knowledge on Delta Live table (DLT)
Should have worked on unity catalog
Good to have knowledge on CICD pipelines and deployment process
Nice to have - develop Kafka topics and pub and subs |
