Senior Data Engineer

Senior Data Engineer

Role : Senior Data Engineer Location: Bangalore

Years of experience : 7+ Years

Shift : General Shift (3 days WFO)

Responsibilities : Design and implement GCP-native data pipelines using services such as

BigQuery, Dataflow, and Pub/Sub. Leverage Cloud Composer for orchestration and automate workflows across GCP services.

• Understanding of the data architecture - from data ingestion at the source, through transformation and storage, to final consumption by analytics, reporting, or machine learning systems.

• Design and implement data pipelines and ETL/ELT pipelines to move and transform data from various sources (APIs, databases, logs, IoT, files)

• Ensure ETL processes are efficient, scalable, and optimized for performance

• Implement measures to ensure accuracy, integrity, and consistency of data throughout the ETL process

• Design and optimize data models for structured and unstructured data

• Implement and manage scalable cloud data lakes and warehouses

• Collaborate with cross-functional teams to understand data requirements and deliver solutions

• Troubleshoot and resolve performance and reliability issues across the data platform

• Involved in automating workflows using CI/CD (e.g., GitHub Actions, Jenkins)

Mandatory Skills:

Extensive experience with Google Cloud Platform (GCP) /Azure/AWS including BigQuery, Dataflow, Pub/Sub, Cloud Composer, Vertex AI, Cloud Storage, Cloud Functions. Ability to design and implement GCP-native data engineering solutions.

• 7+ years for Data Modeling and ETL Development Experience

• Experience with cloud data warehouse such as BigQuery

• Strong SQL skills experience and experience with one or more programming languages (Python, Java, Scala)

• Experience with big data technologies (Hadoop, Spark, Kafka)

• Hands-on knowledge of GCP cloud platform

• Experience with CI/CD pipelines and DevOps practices

• Familiarity with data modeling, warehousing, and governance principles Preferred Skills: Hands-on experience with GCP-native tools and services for data engineering and orchestration.

• Certifications in GCP or cloud data engineering

• Familiarity with tools like Looker and dbt