Data Engineer (Mid-Senior Level)

Role: Data Engineer (Mid-Senior Level)
Position Type: Full-Time Contract (40hrs/week)
Contract Duration: 6 Months+
Location: 100% Remote - Candidates can work anywhere in India (Preference is Hybrid - Chennai)

We are seeking experienced Data Engineers to support a large-scale enterprise data platform migration and modernization initiative. This role will focus on building and optimizing data pipelines, integrating large-scale datasets, and enabling reliable data delivery for analytics and downstream applications.

The ideal candidate has strong experience working with large-scale data processing, cloud data platforms, and modern data pipeline architectures.

Responsibilities

• Design, build, and maintain scalable data pipelines and ETL/ELT workflows
• Develop and optimize data ingestion, transformation, and integration pipelines
• Work with large-scale structured and semi-structured datasets to support analytics and reporting
• Integrate data across multiple systems and ensure reliable downstream consumption
• Collaborate with data architects, platform engineers, and analytics teams to support cloud-based data platforms
• Ensure high levels of data quality, performance, and reliability
• Support modernization of legacy pipelines into cloud-native architectures

Required Skills

• Strong programming experience with Python and SQL
• Experience building data pipelines and data warehousing solutions
• Experience processing large-scale datasets in distributed environments
• Experience with streaming or near real-time data pipelines
• Hands-on experience with Airflow or Cloud Composer (GCP)
• Experience working in AWS or Google Cloud Platform (GCP) environments

Nice to Have

• Experience with Apache Spark or Big Query
• Experience with Kafka or event streaming platforms
• Experience with dbt for data transformation and modeling
• Claude or a similar AI tool to help accomplish the objective

Ideal Background

• Experience working in large-scale enterprise data environments
• Strong understanding of data pipeline orchestration and cloud data platforms
• Experience supporting data platform migrations or modernization initiatives