Senior Data Engineer

Senior Data Engineer\nRole : Senior Data Engineer Location: Bangalore\nYears of experience : 7+ Years\nShift : General Shift (3 days WFO)\nResponsibilities : Design and implement GCP-native data pipelines using services such as\nBigQuery, Dataflow, and Pub/Sub. Leverage Cloud Composer for orchestration and automate workflows across GCP services.\n• Understanding of the data architecture - from data ingestion at the source, through transformation and storage, to final consumption by analytics, reporting, or machine learning systems.\n• Design and implement data pipelines and ETL/ELT pipelines to move and transform data from various sources (APIs, databases, logs, IoT, files)\n• Ensure ETL processes are efficient, scalable, and optimized for performance\n• Implement measures to ensure accuracy, integrity, and consistency of data throughout the ETL process\n• Design and optimize data models for structured and unstructured data\n• Implement and manage scalable cloud data lakes and warehouses\n• Collaborate with cross-functional teams to understand data requirements and deliver solutions\n• Troubleshoot and resolve performance and reliability issues across the data platform\n• Involved in automating workflows using CI/CD (e.g., GitHub Actions, Jenkins)\nMandatory Skills:\nExtensive experience with Google Cloud Platform (GCP) /Azure/AWS including BigQuery, Dataflow, Pub/Sub, Cloud Composer, Vertex AI, Cloud Storage, Cloud Functions. Ability to design and implement GCP-native data engineering solutions.\n• 7+ years for Data Modeling and ETL Development Experience\n• Experience with cloud data warehouse such as BigQuery\n• Strong SQL skills experience and experience with one or more programming languages (Python, Java, Scala)\n• Experience with big data technologies (Hadoop, Spark, Kafka)\n• Hands-on knowledge of GCP cloud platform\n• Experience with CI/CD pipelines and DevOps practices\n• Familiarity with data modeling, warehousing, and governance principles Preferred Skills: Hands-on experience with GCP-native tools and services for data engineering and orchestration.\n• Certifications in GCP or cloud data engineering\n• Familiarity with tools like Looker and dbt