Job Title Data Engineer

Location PCS CHE, Chennai

Years of Experience 5-7 Years

Job Summary We are seeking a highly motivated and detail-oriented Data Engineer who is flexible, proactive, and capable of working independently. The ideal candidate will possess strong communication and coordination skills, with a high level of diligence and attention to detail. A strong ownership mindset is essential for this role.

Responsibilities

• Collaborate effectively with cross-functional teams to ensure seamless project execution.
• Demonstrate strong ownership by working independently with minimal supervision.
• Proactively identify issues and implement timely solutions.
• Maintain high standards of accuracy and attention to detail in all deliverables.
• Utilize SQL and data warehousing concepts to manage and analyze data.
• Work hands-on with Amazon Redshift and workflow orchestration tools such as Airflow (DAGs).
• Leverage AWS services including Glue Jobs, Step Functions, RDS, and SageMaker.
• Develop and maintain data pipelines using PySpark and Python.
• Implement MLOps practices to streamline machine learning workflows.
• Utilize version control tools such as GitHub, including Copilot, for CI/CD processes.
• Architect and design data solutions while troubleshooting issues as they arise.

Mandatory Skills

• Strong experience in SQL and data warehousing concepts.
• Hands-on experience with Amazon Redshift.
• Expertise in workflow orchestration tools such as Airflow (DAGs).
• Experience with AWS services including Glue Jobs, Step Functions, RDS, and SageMaker.
• Proficiency in PySpark and Python.
• Understanding of MLOps practices.
• Familiarity with version control tools such as GitHub (including Copilot).

Preferred Skills

• Experience with AWS Glue, Lambda, S3, IAM.
• Knowledge of CI/CD processes and GitHub.
• Familiarity with M365 Copilot.
• Experience with SSIS, Netezza, and BMO Process knowledge, including any CDKs.

Qualifications Bachelor's degree in Computer Science, Information Technology, or a related field.