Algotale-Data Engineer(Lumiq)

Location: Mumbai
Company: Algotale
\n ‍ Experience: 3+ Years

Algotale is a technology-driven organization focused on building scalable data solutions, cloud-native architectures, and advanced analytics platforms. We help businesses transform data into actionable insights through modern data engineering practices.

We are looking for a skilled Data Engineer with strong expertise in AWS/GCP, SQL, and PySpark to design, build, and optimize scalable data pipelines and cloud-based data platforms. The ideal candidate should have hands-on experience in distributed data processing and cloud environments.

\n
• \n

  Design, develop, and maintain scalable ETL/ELT pipelines

\n
• \n

  Build and optimize data architectures on AWS and/or GCP

\n
• \n

  Develop data processing frameworks using PySpark

\n
• \n

  Write complex and optimized SQL queries for large datasets

\n
• \n

  Work with structured and unstructured data from multiple sources

\n
• \n

  Implement data quality, validation, and governance frameworks

\n
• \n

  Collaborate with data analysts, data scientists, and cross-functional teams

\n
• \n

  Monitor and troubleshoot production data systems

\n
• \n

  Ensure best practices in performance tuning and cost optimization in cloud environments

\n

\n
• \n

  3+ years of experience in Data Engineering

\n
• \n

  Strong hands-on experience with AWS (S3, Redshift, Glue, EMR, Lambda) or GCP (BigQuery, Dataflow, Cloud Storage, Dataproc)

\n
• \n

  Strong proficiency in SQL

\n
• \n

  Hands-on experience with PySpark

\n
• \n

  Experience with data warehousing concepts and dimensional modeling

\n
• \n

  Familiarity with workflow orchestration tools (e.g., Airflow)

\n
• \n

  Understanding of distributed data processing systems

\n
• \n

  Experience with version control tools like Git

\n

\n
• \n

  Experience with real-time data processing (Kafka or similar tools)

\n
• \n

  Knowledge of CI/CD pipelines

\n
• \n

  Exposure to Infrastructure as Code (Terraform, CloudFormation)

\n
• \n

  Basic understanding of machine learning pipelines

\n