Python Data Engineer
Job Description
Position: Python Data Engineer
\nLocation: Chennai
\nWorking Type: WFO (Full time)
\nResource Count: 1
\nShift: UK Shift (2:00 – 11:00 PM)
\nExperience : 6+ years overall
\nInterviews: Assessment || 2 Interview rounds.
\nKey Responsibilities
\n- \n
- \n
Design, develop, and maintain scalable, resilient data pipelines and ETL frameworks in cloud environments to support advanced analytics and AI/ML initiatives.
\n - \n
Build optimized data processing solutions, database architectures, and reusable frameworks for large-scale data ingestion, transformation, and validation.
\n - \n
Develop high-performance Python- and SQL-based solutions for complex data processing and analytical workloads.
\n - \n
Collaborate with cross-functional teams to translate business requirements into scalable technical solutions and actionable insights.
\n - \n
Ensure data quality, governance, reliability, and operational efficiency through robust testing, monitoring, and engineering best practices.
\n
Technical Skills and Experience Requirements
\n- \n
- \n
Minimum 6+ years of hands-on experience designing, building, deploying, testing, maintaining, monitoring, and owning scalable, resilient, distributed data pipelines.
\n - \n
Strong proficiency in Python for large-scale distributed data processing.
\n - \n
Advanced Python development experience including Python 3.x, OOP, asynchronous programming, performance optimization, Airflow orchestration, REST APIs, cloud SDK integrations (Azure), testing frameworks, and Python packaging/dependency management.
\n - \n
Hands-on experience with Pandas, SQLAlchemy and PyODBC for data processing and database interactions.
\n - \n
Expert-level ability to write complex, optimized queries on large-scale datasets.
\n - \n
Experience with RDBMS and OLAP systems such as MySQL and Snowflake.
\n - \n
Familiarity with Agile methodologies and architectural best practices for scalable data lake solutions.
\n
