Lumiq- Data Engineer
Job Description
Experience: 3 – 6 Years
Location: Noida
Employment Type: Full-Time
We are looking for a skilled and motivated Data Engineer to join our team in Noida. The ideal candidate will have strong experience in building scalable data pipelines, working with big data technologies, and managing cloud-based data solutions.
Key Responsibilities \n- \n
- \n
Design, develop, and maintain scalable data pipelines .
\n - \n
Work extensively with PySpark for data processing and transformation.
\n - \n
Write optimized and complex queries using SQL .
\n - \n
Develop and manage data solutions on AWS (S3, EMR, Glue, Redshift, etc.).
\n - \n
Handle large datasets using Hadoop ecosystem tools.
\n - \n
Ensure data quality, integrity, and security across systems.
\n - \n
Collaborate with data analysts, data scientists, and cross-functional teams.
\n - \n
Troubleshoot and optimize existing data workflows.
\n
- \n
- \n
Strong hands-on experience in PySpark
\n - \n
Proficiency in SQL
\n - \n
Experience with AWS Cloud Services
\n - \n
Strong understanding of Data Pipeline architecture
\n - \n
Working knowledge of Hadoop ecosystem
\n - \n
Good understanding of ETL processes
\n - \n
Strong problem-solving and analytical skills
\n
