Posted 15 July, 2026
Spark Scala Data Engineer
Diverse Lynx India
Bangalore, Karnataka, IN
Full Time
Reference: 26-01579-575-2
Role Descriptions:
Essential Skills: Spark Scala
Copilot said: Job Summary – Developer (Spark Scala Data Engineer)
Role: Developer – Spark Scala Data Engineer
Experience: 5–8 Years
Open Positions: 1
Locations: Chennai, Kochi, Bhubaneswar (BBSR), Bangalore, Pune
Reporting To: Tech Lead
Team Size: 10 Members
Core Technical Requirements
Must-Have Skills
Apache Spark
Scala
Hive
Hadoop
Big Data Engineering
Data Pipeline Development
Spark/Scala-based Data Transformations and Analytics
Functional Programming using Scala and/or Python
Application Design, Development, Optimization, and Maintenance
Strong communication and stakeholder management skills
Good-to-Have Skills
Agile Development Methodology
JIRA
ALM/ADLM tools
Team collaboration
Multi-tasking and prioritization skills
Key Responsibilities
Design and develop scalable Big Data solutions using Spark, Scala, Hive, and Hadoop.
Build, optimize, and maintain data processing applications and pipelines.
Develop, test, debug, and modify applications independently.
Integrate existing software into new or modified systems.
Collaborate with business analysts, developers, and QA teams to deliver high-quality solutions.
Work with business users on acceptance testing and requirement validation.
Participate in continuous process improvement initiatives.
Ideal Candidate Profile
5–8 years of experience in Data Engineering.
Strong hands-on expertise in Spark and Scala.
Experience handling large-scale data processing and ETL pipelines.
Good understanding of distributed computing frameworks.
Strong coding and problem-solving abilities.
Experience interacting directly with clients and business stakeholders.
Familiarity with Agile delivery models.
Project Overview
The client is a leading American information, data, and market measurement company operating in more than 100 countries. The organization helps consumer goods companies, retailers, and financial analysts understand consumer purchasing behavior across categories, brands, and products.
USP of the Role
Opportunity to build cloud-native applications using modern technologies.
Exposure to large-scale data platforms and enterprise-grade Big Data solutions.
Work with a globally recognized market intelligence organization.
Interview Focus Areas
Spark Architecture & Performance Tuning
Scala Programming & Functional Concepts
Data Pipeline Design
Hive & Hadoop Ecosystem
ETL Frameworks
Distributed Computing Concepts
Optimization Techniques
Agile and Stakeholder Management
This role is best suited for an experienced Spark Scala Data Engineer with strong Big Data development expertise and customer-facing communication skills.
Essential Skills: Spark Scala
Copilot said: Job Summary – Developer (Spark Scala Data Engineer)
Role: Developer – Spark Scala Data Engineer
Experience: 5–8 Years
Open Positions: 1
Locations: Chennai, Kochi, Bhubaneswar (BBSR), Bangalore, Pune
Reporting To: Tech Lead
Team Size: 10 Members
Core Technical Requirements
Must-Have Skills
Apache Spark
Scala
Hive
Hadoop
Big Data Engineering
Data Pipeline Development
Spark/Scala-based Data Transformations and Analytics
Functional Programming using Scala and/or Python
Application Design, Development, Optimization, and Maintenance
Strong communication and stakeholder management skills
Good-to-Have Skills
Agile Development Methodology
JIRA
ALM/ADLM tools
Team collaboration
Multi-tasking and prioritization skills
Key Responsibilities
Design and develop scalable Big Data solutions using Spark, Scala, Hive, and Hadoop.
Build, optimize, and maintain data processing applications and pipelines.
Develop, test, debug, and modify applications independently.
Integrate existing software into new or modified systems.
Collaborate with business analysts, developers, and QA teams to deliver high-quality solutions.
Work with business users on acceptance testing and requirement validation.
Participate in continuous process improvement initiatives.
Ideal Candidate Profile
5–8 years of experience in Data Engineering.
Strong hands-on expertise in Spark and Scala.
Experience handling large-scale data processing and ETL pipelines.
Good understanding of distributed computing frameworks.
Strong coding and problem-solving abilities.
Experience interacting directly with clients and business stakeholders.
Familiarity with Agile delivery models.
Project Overview
The client is a leading American information, data, and market measurement company operating in more than 100 countries. The organization helps consumer goods companies, retailers, and financial analysts understand consumer purchasing behavior across categories, brands, and products.
USP of the Role
Opportunity to build cloud-native applications using modern technologies.
Exposure to large-scale data platforms and enterprise-grade Big Data solutions.
Work with a globally recognized market intelligence organization.
Interview Focus Areas
Spark Architecture & Performance Tuning
Scala Programming & Functional Concepts
Data Pipeline Design
Hive & Hadoop Ecosystem
ETL Frameworks
Distributed Computing Concepts
Optimization Techniques
Agile and Stakeholder Management
This role is best suited for an experienced Spark Scala Data Engineer with strong Big Data development expertise and customer-facing communication skills.
