Posted 14 July, 2026
Pyspark Developer
Diverse Lynx
Karnataka
Full Time
Reference: 365_569689_26-01369
Job Title: PySpark Developer
Experience:
5+ Years
Location:
Pune / Bangalore / Hyderabad / Chennai / Mumbai
Job Description:
We are looking for a skilled PySpark Developer with 5+ years of experience in designing, developing, and optimizing large-scale data processing applications. The ideal candidate should have strong hands-on expertise in PySpark, Python, SQL, and Data Engineering concepts, with experience building scalable ETL pipelines and processing large volumes of data. Relevant skills from enterprise JD templates include PySpark development, SQL, data warehousing, and cloud-based data engineering environments. [TCS_JD_Tem...Databricks | Word], [TCS_JD_Tem...Developer | Word], [TCS_JD_Tem...pr aws TRP | Word]
Must-Have Skills:
Experience:
5+ Years
Location:
Pune / Bangalore / Hyderabad / Chennai / Mumbai
Job Description:
We are looking for a skilled PySpark Developer with 5+ years of experience in designing, developing, and optimizing large-scale data processing applications. The ideal candidate should have strong hands-on expertise in PySpark, Python, SQL, and Data Engineering concepts, with experience building scalable ETL pipelines and processing large volumes of data. Relevant skills from enterprise JD templates include PySpark development, SQL, data warehousing, and cloud-based data engineering environments. [TCS_JD_Tem...Databricks | Word], [TCS_JD_Tem...Developer | Word], [TCS_JD_Tem...pr aws TRP | Word]
Must-Have Skills:
- Strong hands-on experience in PySpark
- Proficiency in Python Programming
- Strong SQL skills
- Experience in ETL/ELT development
- Knowledge of Data Warehousing concepts
- Experience with data modeling and large-scale data processing
- Understanding of Spark architecture and performance tuning
- Git/GitHub version control
- Strong debugging and troubleshooting skills
- AWS (S3, EMR, Glue)
- Databricks
- Airflow
- Snowflake
- dbt
- Redshift
- CI/CD pipelines
- Agile/Scrum methodology
- Develop and maintain scalable data pipelines using PySpark and Python.
- Design and implement ETL/ELT workflows for enterprise data platforms.
- Process and analyze large structured and unstructured datasets.
- Optimize Spark jobs for performance, scalability, and efficiency.
- Develop reusable frameworks and components for data processing.
- Collaborate with data architects, business analysts, and application teams.
- Perform data validation, reconciliation, and quality checks.
- Troubleshoot production issues and provide timely resolutions.
- Participate in code reviews and follow coding best practices.
- 5+ years of overall IT experience.
- Minimum 3 years of hands-on PySpark development experience.
- Experience in data engineering and data warehouse projects.
- Exposure to cloud-based data platforms is preferred. [TCS_JD_Tem...Databricks | Word], [TCS_JD_Tem...Developer | Word]
- BE / B.Tech / MCA / M.Tech or equivalent.
