Skip to main content
Posted 02 July, 2026

Associate Director - Data Science

KPMG
Bangalore,Karnataka,IN,560103 Full Time
Reference: 218_549848_30044059

About the Role:

We are seeking a Principal AI Engineer / AI Architect with extensive experience in Generative AI (GenAI), Retrieval-Augmented Generation (RAG), and Agentic AI systems. This role requires strategic leadership, architectural design, and delivery of large-scale AI projects. You will define technical roadmaps, manage teams, and ensure enterprise-grade AI solutions align with business objectives.

Required Skills:

  • Programming: Expert-level proficiency in Python and AI/ML libraries (PyTorch, TensorFlow, Hugging Face).
  • Generative AI: Proven experience in LLM fine-tuning, prompt engineering, and production deployment.
  • RAG & Agentic AI: Advanced knowledge of embeddings, vector databases (FAISS, Pinecone), and agent orchestration frameworks (LangChain, AutoGen).
  • Traditional ML & Deep Learning: Strong foundation in ML algorithms and deep learning architectures (CNNs, RNNs, Transformers).
  • Architecture & Leadership: Ability to design scalable AI architectures, manage large teams, and deliver enterprise projects.
  • Cloud Expertise: Strong understanding of cloud services (AWS, Azure, GCP), including compute, storage, networking, and AI-specific offerings.
  • MVP Development: Experience creating proof-of-concepts and MVPs for rapid prototyping and stakeholder validation.
  • Production Deployment: Should have proven capability to production
  • Excellent communication and stakeholder management skills.


Preferred Skills:

  • Experience with MLOps, CI/CD for AI, and multi-cloud deployments.
  • Familiarity with cost optimization, security best practices, and disaster recovery strategies.
  • Exposure to multi-modal AI, agent orchestration, and AI governance frameworks
  • Hands-on experience deploying AI models in production environments with monitoring and scaling strategies.
  • Cost Estimation: Exposure to estimating LLM model costs prior to deployment, including compute, storage, and inference optimization.

Qualifications:

  • Bachelor's or Master's degree in Computer Science, AI/ML, or related field.
  • 12+ years of experience in AI/ML development, with at least 5+ years in Generative AI and advanced AI systems.
  • Proven track record of leading large-scale AI projects, defining architecture, and managing cross-functional teams.

Key Responsibilities:

  • Lead and architect enterprise-scale AI solutions leveraging LLMs, multimodal models, and advanced GenAI techniques.
  • Design and oversee RAG pipelines and Agentic AI frameworks for complex workflows.
  • Define AI architecture standards, scalability strategies, and integration patterns with cloud services.
  • Drive effort estimation, resource planning, and delivery timelines for large-scale AI projects.
  • Collaborate with senior stakeholders to propose AI-driven solutions and influence technology strategy.
  • Ensure compliance with security, governance, and ethical AI principles.
  • Oversee model deployment, model cost estimation in production environments and ensure robust monitoring.
  • Lead MVP development for rapid prototyping and proof-of-concept initiatives.
  • Mentor and guide engineering teams, fostering innovation and best practices.

Sign up for Job Alerts