GCP Data Engineer - Bangalore
Job Summary:
We are looking for a skilled GCP Data Engineer to design, build, and maintain scalable data processing systems using Google Cloud Platform (GCP). You will work closely with data scientists, analysts, and software engineers to build data pipelines and ensure the availability, integrity, and performance of data solutions across the organization.
Key Responsibilities:
Design, develop, and optimize scalable data pipelines and ETL processes in GCP.
Implement and manage data solutions using tools like BigQuery, Dataflow, Pub/Sub, and Cloud Storage.
Integrate data from various sources such as APIs, databases, and streaming platforms.
Develop and maintain data models, metadata, and documentation.
Monitor, troubleshoot, and optimize the performance of data pipelines.
Collaborate with analytics and product teams to deliver reliable data solutions.
Ensure data governance, security, and compliance standards are met.
Use Terraform, Cloud Composer, or similar tools for infrastructure as code and orchestration.
Required Qualifications:
Bachelor's degree in Computer Science, Engineering, or related field.
4+ years of experience in data engineering with a strong focus on GCP.
Proficient in SQL, Python, and data processing frameworks.
-
Hands-on experience with GCP services such as:
BigQuery
Cloud Dataflow
Cloud Pub/Sub
Cloud Storage
Cloud Composer
Strong understanding of data warehousing, data modeling, and distributed systems.
Experience with CI/CD practices and tools (e.g., Git, Jenkins, Cloud Build).