Data Engineer - AWS/GCP | SQL | PySpark

Location: Mumbai
Company: Algotale
Experience: 3+ Years

About Algotale

Algotale is a technology-driven organization focused on building scalable data solutions, cloud-native architectures, and advanced analytics platforms. We help businesses transform data into actionable insights through modern data engineering practices.

Role Overview

We are looking for a skilled Data Engineer with strong expertise in AWS/GCP, SQL, and PySpark to design, build, and optimize scalable data pipelines and cloud-based data platforms. The ideal candidate should have hands-on experience in distributed data processing and cloud environments.

Key Responsibilities

• Design, develop, and maintain scalable ETL/ELT pipelines

• Build and optimize data architectures on AWS and/or GCP

• Develop data processing frameworks using PySpark

• Write complex and optimized SQL queries for large datasets

• Work with structured and unstructured data from multiple sources

• Implement data quality, validation, and governance frameworks

• Collaborate with data analysts, data scientists, and cross-functional teams

• Monitor and troubleshoot production data systems

• Ensure best practices in performance tuning and cost optimization in cloud environments

Required Skills & Qualifications

• 3+ years of experience in Data Engineering

• Strong hands-on experience with AWS (S3, Redshift, Glue, EMR, Lambda) or GCP (BigQuery, Dataflow, Cloud Storage, Dataproc)

• Strong proficiency in SQL

• Hands-on experience with PySpark

• Experience with data warehousing concepts and dimensional modeling

• Familiarity with workflow orchestration tools (e.g., Airflow)

• Understanding of distributed data processing systems

• Experience with version control tools like Git

Good to Have

• Experience with real-time data processing (Kafka or similar tools)

• Knowledge of CI/CD pipelines

• Exposure to Infrastructure as Code (Terraform, CloudFormation)

• Basic understanding of machine learning pipelines