Databricks Engineer (Immediate Joiners Only- 3 to 15 Years)
Job Description
Databricks Engineer / Consultant
\nAbout GyanSys
\nGyanSys is a global systems integrator and technology consulting company that helps enterprises accelerate digital transformation through SAP, Cloud, Data & Analytics, AI, and Intelligent Automation solutions. We partner with leading technology providers to deliver innovative, scalable, and business-driven solutions across diverse industries worldwide.
\nDatabricks Engineer / Consultant
\nLocation: Bengaluru | Pune | Hyderabad
\nEmployment Type: Full-Time
\nJob Summary
\nGyanSys is looking for skilled Databricks Engineers/Consultants to join our growing Data & Analytics practice. The ideal candidate will have hands-on experience in designing, developing, and optimizing scalable data engineering solutions using the Databricks Lakehouse Platform. You will work closely with solution architects, business stakeholders, and cross-functional teams to build robust data pipelines that support enterprise analytics, reporting, and AI initiatives.
\nKey Responsibilities
\n- \n
- Design, develop, and maintain scalable ETL/ELT pipelines using Databricks and PySpark. \n
- Build and optimize data pipelines for structured, semi-structured, and unstructured data. \n
- Develop data transformation workflows using Databricks Notebooks, Spark SQL, and Delta Lake. \n
- Optimize Spark jobs and Databricks clusters for performance and cost efficiency. \n
- Integrate data from multiple enterprise sources, including databases, APIs, cloud storage, and ERP systems. \n
- Collaborate with data architects, business analysts, and data scientists to deliver business-focused data solutions. \n
- Ensure data quality, governance, security, and compliance across data platforms. \n
- Implement CI/CD best practices and support deployment of Databricks solutions. \n
- Troubleshoot production issues and continuously improve platform performance. \n
- Create technical documentation and support knowledge-sharing initiatives. \n
Required Technical Skills
\n- \n
- Hands-on experience with Databricks Lakehouse Platform \n
- Strong expertise in PySpark, Apache Spark, Spark SQL, and Python \n
- Experience with Delta Lake, Databricks Workflows, and Unity Catalog \n
- Strong understanding of ETL/ELT, Data Warehousing, and Data Modeling \n
- Experience with Azure, AWS, or GCP cloud platforms \n
- Knowledge of Git, Azure DevOps/GitHub, and CI/CD practices \n
- Experience working with SQL Server, Oracle, PostgreSQL, Snowflake, or similar databases \n
Preferred Skills
\n- \n
- Experience with Medallion Architecture and Lakehouse concepts \n
- Exposure to Kafka, Event Hubs, or other streaming technologies \n
- Knowledge of Power BI or Tableau \n
- Understanding of Agile/Scrum methodologies \n
- Exposure to Microsoft Fabric is an added advantage \n
Qualifications
\n- \n
- Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, or a related field. \n
Experience
\n- \n
- Domain Experience: 3–5 Years \n
- Relevant Experience: 0–8+ Years \n
Preferred Certifications
\n- \n
- Databricks Certified Data Engineer (Associate/Professional) \n
- Microsoft Azure Data Engineer Associate \n
- AWS Certified Data Analytics – Specialty \n
- Google Professional Data Engineer \n
Why Join GyanSys?
\nAt GyanSys, you'll work on enterprise-scale digital transformation programs leveraging modern cloud and data technologies. We provide a collaborative environment, continuous learning opportunities, and exposure to global clients, enabling you to build innovative solutions while accelerating your professional growth.