Data Engineer

Job Title- Pyspark (Data Engineer)

Location- Chennai / Kolkata / Hyderabad / Pune

Experience Required- 5-10 years.

Job Description:

We are looking for a skilled and experienced professional to join our team. The ideal candidate should have 5-10 year of relevant experience and to be comfortable working in dynamic, fast-paced environment.

Key Responsibilities:

\n
• Lead the team from offshore by owning project deliverables & provide technical oversight (For Tech Lead)
\n
• Experienced in architecting & Developing Big Data solutions (For Tech Lead)
\n
• Strong understanding of Big Data tools and Apache projects (For Tech Lead, Sr. Developer)
\n
• Good understanding on performance tuning on Big data technologies (For Tech Lead, Sr. Developer)
\n
• Good to have Python and Java background (For Tech Lead, Sr. Developer)
\n
• Experience in relational database and data warehousing concept
\n
• Well versed in Hive QL, Spark QL
\n
• Create ETL transformation using Hive, Spark
\n
• Support development team and testing team in implementing and testing the ETL respectively
\n
• Build data quality rule and orchestrate using in house framework
\n
• Work with Cloudera/Big Data support for root cause analysis and resolutions
\n
• Good team player and collaborate with other team
\n