Posted 12 June, 2026
Sr Data Engineer - Spark-Scala - Chennai
Photon
Remote Nationwide, IN
Full Time
Reference: 8a5a361ee4b53b9c
Job Description
Develop, test, and deploy data processing applications using Apache Spark and Scala.
Optimize and tune Spark applications for better...
Job Description
- Develop, test, and deploy data processing applications using Apache Spark and Scala.
- Optimize and tune Spark applications for better performance on large-scale data sets.
- Work with the Cloudera Hadoop ecosystem (., HDFS, Hive, Impala, HBase, Kafka) to build data pipelines and storage solutions.
- Collaborate with data scientists, business analysts, and other developers to understand data requirements and deliver solutions.
- Design and implement high-performance data processing and analytics solutions.
- Ensure data integrity, accuracy, and security across all processing tasks.
- Troubleshoot and resolve performance issues in Spark, Cloudera, and related technologies.
- Implement version control and CI/CD pipelines for Spark applications.
- Minimum 8 years of experience in application development.
- Strong hands on experience in Apache Spark, Scala, and Spark SQL for distributed data processing.
- Hands-on experience with Cloudera Hadoop (CDH) components such as HDFS, Hive, Impala, HBase, Kafka, and Sqoop.
- Familiarity with other Big Data technologies, including Apache Kafka, Flume, Oozie, and Nifi.
- Experience building and optimizing ETL pipelines using Spark and working with structured and unstructured data.
- Experience with SQL and NoSQL databases such as HBase, Hive, and PostgreSQL.
- Knowledge of data warehousing concepts, dimensional modeling, and data lakes.
- Ability to troubleshoot and optimize Spark and Cloudera platform performance.
-
Familiarity with version control tools like Git and CI/CD tools (., Jenkins, GitLab).
Compensation, Benefits and DurationMinimum Compensation: USD
Maximum Compensation: USD
Compensation is based on actual experience and qualifications of the candidate. The above is a reasonable and a good faith estimate for the role.
Medical, vision, and dental benefits, 401k retirement plan, variable pay/incentives, paid time off, and paid holidays are available for full time employees.
This position is not available for independent contractors
No applications will be considered if received more than 120 days after the date of this post
Required Skills & Experience:
This listing expired on 15 Jun. Applications are no longer accepted.
Below are some other jobs we think you might be interested in.
-
Sr Data Engineer - Spark-Scala - Chennai
- Photon
- Chennai,Tamil Nadu,IN,600089
Develop, test, and deploy data processing applications using Apache Spark and Scala. Optimize and tune Spark applications for better...12 Jun -
Scala/Spark Developer - Chennai
- Photon
- Chennai,Tamil Nadu,IN,600089
Develop, test, and deploy data processing applications using Apache Spark and Scala. Optimize and tune Spark applications for better...19 May -
Spark, Scala Data engineer (Bangalore/Pune/Chennai/Gurugram) 7+
- Tata Consultancy Services
- Bengaluru, KA, IN
Job Description Greetings from Tata Consulting Services TCS is Hiring for Spark, Scala Data engineer Experience : 7 to 12 years Location:...11 Jun -
Lead Data Engineer - Scala/Spark
- Xebia
- Bengaluru, KA, IN
Job Description Job Title : Lead Data Engineer - Scala/Spark\nJob location : Bengaluru\nExp Range : 5-14 years\nNotice Period : immediate - 15...16 Jun -
Spark-Scala Developer (Big Data Engineer)
- startechsinc
- Bengaluru, Karnataka, IN
🚀 We’re Hiring: Spark-Scala Developer (Big Data Engineer) 📍 Location: Bangalore (Day 1 Onsite) ⏳ Notice Period: Immediate to 2–3 Weeks 🎯 Experience: 5+...16 Jun -
SPARK Data Onboarding Engineer - Chennai
- Photon
- India
Job Title: PySpark Data EngineerSummary:We are seeking a skilled PySpark Data Engineer to join our team and drive the development of robust data...12 Jun -
SPARK Data Reconciliation Engineer - Chennai
- Photon
- India
Job Title: PySpark Data Reconciliation Engineer 7+ years of relevant experience in technology and development. Technical skillset required: (1)...12 Jun -
Data Engineer (Senior Data Developer Scala, Spark)
- VARITE INDIA PRIVATE LIMITED
- Gurgaon, Haryana, IN
Company Name: VARITE India Private Limited About The Client: Client is a pioneering Software Engineering and IT consultancy company, transforming and...12 Jun -
Scala /Spark
- eTeam
- Bangalore,Karnataka,411033
Key Qualifications 3+ years of experience working in software development building modern and scalable big data applications ...26 May -
Spark Scala
- Diverse Lynx
- Bangalore,Karnataka
Job description Position: Spark,Scala Location – Bangalore JD- Work experience in Spark & Scala Development. Must Have- Good understanding of...13 Jun -
13 Jun
-
Software Engineer - Spark, Scala - BLR/CHN
- Photon
- India
AWS services - S3, EMR, KMS, IAM Spark - basics Python - basics, functions Map Lambda Filter Flatmap reduce list Array groupby aggregate reducebykey...12 Jun -
Spark Scala, AWS_KOLKATA&HYDERABAD
- Diverse Lynx
- Chennai
Hiring for Spark Scala, AWS_KOLKATA&HYDERABAD Design and develop robust, scalable data pipelines using Apache Spark (Core, SQL, Streaming, MLlib,...29 May -
Data Engineers (Big Data Hadoop, Scala, Spark, Ozone/Iceberg/Airflow)
- Zensar Technologies
- Pune,Maharashtra,IN,411014
To excel as a Data Engineer specialized in this modern, high-performance big data stack, you need to master a specific blend of distributed computing,...16 Jun -
Scala with Spark
- Tranzeal Inc.
- Hyderabad, Telangana, IN
Billrate: 23-25 LPA Exp:5 Yrs Customer: Apple Work Location: Hyderabad, Financial District, Nanakramguda Work Mode: Hybrid Mode (Apple Hyderabad...29 May -
SAP Spark/Scala
- NR Consulting - India
- Noida, Bangalore, Hyderabad Gurugram, Pune, Kochi, BBSR, IN
Title: SAP Spark/Scala Location: Noida, Bangalore, Hyderabad Gurugram, Pune, Kochi, BBSR Exp: 5+ years Job Description: Skills Required: • Apache...25 May -
Sr Developer - Data Engineering - Chennai
- Photon
- Chennai,Tamil Nadu,IN,600089
Key Responsibilities: Develop, test, and deploy data processing applications using Apache Spark and Scala. Optimize and tune Spark...26 May -
Sr Data Engineer - Apache DolphinScheduler - Chennai
- Photon
- Chennai,Tamil Nadu,IN,600089
Key Responsibilities: Develop, configure, and optimize Apache DolphinScheduler workflows for data processing and automation. Design and implement ETL...12 Jun -
Sr Data Engineer- Databricks
- Aptus Data Labs
- Bangalore,Karnataka,India
Exp- 5+ yrs Location- Remote (Preferred candidates to be in bangalore) Notice- Looking candidates with to be joining within 30 Days Key...12 Jun -
Algotale - Intelliatech (Spark/Scala Developer)
- Nexthire
- chennai;bangalore;hyderabad;gurugram;pune,IN
Role** Spark/Scala Developer Required Technical Skill Set** Hadoop, Hive, Impala, Advanced SQL, Spark, Scala, OS (Unix), CI/CD Tools (Git,...12 Jun