ECMS Req # |
527070 |
Relevant and Total years of experience |
Relevant 5+ years and Total 6 + years |
Detailed job description - Skill Set: |
- Strong Data Engineer with 5+ Years exp in Data Bricks , Pyspark , SQL
- Design and develop data processing pipelines and analytics solutions using Databricks.
- Architect scalable and efficient data models and storage solutions on the Databricks platform.
- Collaborate with architects and other teams to migrate current solution to use Databricks.
- Optimize performance and reliability of Databricks clusters and jobs to meet SLAs and business requirements.
- Use best practices for data governance, security, and compliance on the Databricks platform.
- Mentor junior engineers and provide technical guidance.
- Stay current with emerging technologies and trends in data engineering and analytics to drive continuous improvement.
- Strong understanding of distributed computing principles and experience with big data technologies such as Apache Spark.
- Experience with cloud platforms such as AWS, Azure, or GCP, and their associated data services.
- Proven track record of delivering scalable and reliable data solutions in a fast-paced environment.
- Excellent problem-solving skills and attention to detail.
- Strong communication and collaboration skills with the ability to work effectively in cross-functional teams.
- Good to have experience with containerization technologies such as Docker and Kubernetes.
- Knowledge of DevOps practices for automated deployment and monitoring of data pipelines.
|
Mandatory Skills |
- Strong Data Engineer with 5+ Years exp in Data Bricks , Pyspark , SQL
- Design and develop data processing pipelines and analytics solutions using Databricks.
- Architect scalable and efficient data models and storage solutions on the Databricks platform.
- Collaborate with architects and other teams to migrate current solution to use Databricks.
- Optimize performance and reliability of Databricks clusters and jobs to meet SLAs and business requirements.
- Use best practices for data governance, security, and compliance on the Databricks platform.
- Mentor junior engineers and provide technical guidance.
- Stay current with emerging technologies and trends in data engineering and analytics to drive continuous improvement.
- Strong understanding of distributed computing principles and experience with big data technologies such as Apache Spark.
- Experience with cloud platforms such as AWS, Azure, or GCP, and their associated data services.
|
Vendor Billing range in local currency (per day) |
INR 8000/Day |
Work Location |
Bangalore, Hyderabad (Preferred) |
Notice period |
15 days |
WFO/WFH/Hybrid WFO |
Hybrid
|
BGCHECK before or After onboarding |
Post onboarding |
