Data Engineer

Introduction to the Role We are seeking a Data Engineer with 3-5 years of experience, based in Chennai/Hyderabad (On-site). The role involves building and optimizing scalable data pipelines, data lakes, and data warehouses while ensuring data quality, governance, and security across analytics and machine learning use cases. Accountabilities Design, develop, and optimize data pipelines, ETL/ELT processes, and data integration workflows. Build and maintain data lakes, data warehouses, and real-time streaming pipelines. Transform structured and unstructured data into clean, usable datasets for analytics and ML. Collaborate with analytics, product, and engineering teams to define and implement data models. Ensure data quality, governance, lineage, and security best practices. Monitor and optimize pipeline performance and troubleshoot issues in data flow. Document data processes and contribute to data engineering standards and frameworks. Essential Skills / Experience 3-5 years of experience as a Data Engineer. Strong programming skills in Python and SQL. Hands-on experience with PySpark, Apache Airflow, or dbt. Experience with modern cloud data platforms such as: o AWS (Redshift, Glue, S3) o Azure (Data Lake, Synapse) o GCP (BigQuery, Dataflow) Ability to work with both structured and unstructured data. Good understanding of data governance, lineage, and security practices. Strong troubleshooting and performance optimization skills. Desirable Skills / Experience Familiarity with real-time data streaming tools (Kafka, Kinesis, Pub/Sub). Experience supporting machine learning workflows. Exposure to containerization/orchestration tools (Docker, Kubernetes). Cloud or data engineering certifications.