Posted 17 June, 2026
Big Data Engineer
ClifyX
India
Full Time
Reference: 365_594563_26-01120
Job Description:
• Key Responsibilities Design, develop, and maintain ETL ELT pipelines using Airflow and transformation tools like dbt (or similar) Manage data workflows and orchestration on Google Cloud Composures
• Build and maintain data storage and processing workflows, preferably on Google Cloud Platform (GCP) using Big Query and GCS (or equivalent tools in other cloud environments) Automate infrastructure and deployments using Terraform Collaborate with data analysts, scientists, and engineers to deliver clean, tested, and reliable datasets
• Monitor pipeline performance, handle failures, and ensure data quality and observability Follow best practices for coding, testing, documentation, and version control Required Skills and Experience Strong proficiency in Python for data processing and scripting Experience with Airflow (or similar orchestration frameworks) Familiarity with data transformation tools such as dbt, or comparable tools like Spark SQL, Dataform, etc.
• Experience with cloud data platforms, ideally GCP (BigQuery, GCS), or equivalent platforms (e.g., AWS S3Redshift, Azure Data Lake Synapse) Understanding of Terraform and infrastructure-as-code practices Solid foundation in data modelling, SQL, and data warehousing principles Comfortable working in collaborative, agile environments with Git-based workflows
• Key Responsibilities Design, develop, and maintain ETL ELT pipelines using Airflow and transformation tools like dbt (or similar) Manage data workflows and orchestration on Google Cloud Composures
• Build and maintain data storage and processing workflows, preferably on Google Cloud Platform (GCP) using Big Query and GCS (or equivalent tools in other cloud environments) Automate infrastructure and deployments using Terraform Collaborate with data analysts, scientists, and engineers to deliver clean, tested, and reliable datasets
• Monitor pipeline performance, handle failures, and ensure data quality and observability Follow best practices for coding, testing, documentation, and version control Required Skills and Experience Strong proficiency in Python for data processing and scripting Experience with Airflow (or similar orchestration frameworks) Familiarity with data transformation tools such as dbt, or comparable tools like Spark SQL, Dataform, etc.
• Experience with cloud data platforms, ideally GCP (BigQuery, GCS), or equivalent platforms (e.g., AWS S3Redshift, Azure Data Lake Synapse) Understanding of Terraform and infrastructure-as-code practices Solid foundation in data modelling, SQL, and data warehousing principles Comfortable working in collaborative, agile environments with Git-based workflows
