Assistant Manager - Cloud Engineering
Cloud Engineering - Consulting
The Consulting business at KPMG Global Services (KGS) is a diverse team of more than 6400 professionals. We work with KPMG Firms worldwide to transform the businesses of clients across industries through the latest technology and innovation. Our technology professionals combine deep industry knowledge with strong technical experience to navigate through complex challenges and deliver real value for our clients.
The Role
We are looking for a highly skilled Senior Data & Cloud Engineer to design, build, and optimize next-generation data platforms for our clients. The ideal candidate is a master of core data engineering principles such as distributed computing and advanced data modelling and possesses deep, hands-on expertise in at least one major cloud ecosystem (Azure or GCP). You will be responsible for the entire data lifecycle, from real-time ingestion to providing analytics-ready datasets for our Machine Learning and Business Intelligence teams.
Your key responsibilities will include -
- Architect Pipelines: Design and build scalable ETL/ELT pipelines to ingest high-velocity telemetry and log data into our cloud warehouse.
- Model Implementation: Partner with Data Scientists to build and maintain Feature Stores and automated ML training pipelines.
- Infrastructure as Code: Utilize Docker, Kubernetes, and Terraform to deploy and manage containerized data services.
- Optimization: Continuously monitor and optimize query performance, sharding strategies, and cloud costs across the data stack.
- Data Governance: Ensure high data quality, integrity, and security standards are met across all production environments.
Mandatory Skills
- Programming: Expert-level Python and Advanced SQL (Window functions, CTEs, and performance tuning).
- Data Modeling: Proven experience with Star/Snowflake Schemas and managing Slowly Changing Dimensions (SCD Type 1, 2, & 3).
- Distributed Computing: Hands-on experience with Apache Spark (PySpark/Scala) for processing multi-terabyte datasets.
- Orchestration & Transformation: Proficiency with Apache Airflow for workflow management and dbt for modular data modeling.
- Streaming: Experience with Apache Kafka or similar message brokers for event-driven architectures.
- Key tech stacks - Cloud Expertise (either Azure or GCP)
Feature |
Azure |
GCP |
Data Warehouse |
Azure Synapse Analytics |
Google BigQuery |
Storage / Lake |
Azure Data Lake (ADLS Gen2) |
Google Cloud Storage |
Serverless ETL |
Azure Data Factory (ADF) |
Google Cloud Dataflow |
Managed Spark |
Azure Databricks |
Google Cloud Dataproc |
Streaming/Pub-Sub |
Azure Event Hubs |
Google Cloud Pub/Sub |
Compute / NoSQL |
Azure Functions / Cosmos D |
Cloud Functions / Bigtable |
Governance & Lineage |
Data Catalog/ Microsoft Purview |
Lake Formation/ Google Dataplex |
The person
- Outstanding interpersonal skills with the ability to inspire teams and develop excellent client relationships
-
Previous experience in consulting and working on complex solutions to business executives
- Embraces a growth mindset for business development, with an ability to influence senior stakeholders
- Excellent communication (written and oral) skills capable of discussing complex ideas with various groups, ranging from a board room to business unit leads.
- Good team player with strong commitment to professional and client service excellence.
- Minimum Bachelor's degree in Computer Science, Information Technology or MCA.
- Google Professional Data Engineer or Microsoft Azure Data Engineer Associate
- Experience with Microsoft Fabric will be preferred.
- Experience with Snowflake or Databricks as a centralized data platform.