AI Architect

Job Purpose

Designs and architect end-to-end AI Cloud platforms with a focus on security, cost-efficiency, and performance. This position involves direct client engagement to translate requirements into technical Solution, encompassing GPU infrastructure rightsizing and optimal model selection. We are looking for a cloud expert with a demonstrated ability to transition complex AI models from concept to large-scale production. The ideal candidate brings extensive experience in AI/Cloud ecosystems and a successful track record of architecting and managing production-grade, large-scale AI platforms.

Role Summary

Key Responsibilities

• Translate business requirements into scalable, high-performance AI/GenAI architectures featuring NVIDIA GPU clusters
\n
• Design end-to-end AI Cloud and next-generation platforms optimized for deep learning workloads and distributed training.
\n
• Architect HPC cluster topologies utilizing high-speed InfiniBand (NDR/HDR) and RoCE v2 interconnects for low-latency communication.
\n
• Right-size platform components, including GPUs, CPUs, memory and NVMe storage for comprehensive client proposals.
\n
• Architect distributed training and inference environments optimized for MPI frameworks and workload scheduling via Slurm.
\n
• Desing scalable container orchestration platforms using Kubernetes and Kubeflow to manage AI workloads.
\n
• Propose optimized inference strategies using vLLM, Triton, and TensorRT-LLM to meet specific latency and throughput KPIs.
\n
• Should have experience on RAG systems and multi-agent orchestration frameworks like LangGraph and agentic ecosystems.
\n
• Develop private AI cloud environments focused on data sovereignty and regulatory compliance, such as the India DPDP Act.
\n
• Define integration strategies for LLMs and open-source models within existing enterprise data systems, APIs, and knowledge graphs.
\n
• Establish reference architectures for CI/CD/CT pipelines and automated model retraining workflows to ensure reproducibility.
\n
• Implement automation and observability frameworks for monitoring GPU utilization, performance tuning, and failure handling.
\n
• Drive technical validation through Proof of Concept (PoC) engagements, focusing on scalability and performance benchmarks for LLM training.
\n
• Establish Infrastructure-as-Code (IaC) practices to ensure reproducible and reliable cluster deployments.
\n
• Collaborate with C-suite stakeholders and cross-functional teams to drive technical decision-making, innovation, and roadmap alignment.
\n

Experience & Educational Requirements

\n

Qualifications and Experience

\n

EDUCATIONAL QUALIFICATIONS: (degree, training, or certification required)

\n

BE/B-Tech or equivalent with Computer Science or Electronics & Communication

\n

RELEVANT EXPERIENCE: 15 - 20 years of IT Experience with minimum 5 years in AI platform

\n

Required Technical Skills

\n

Core AI/ML Expertise

\n
• Strong experience in Nvidia, Intel, Google GPU Architecture, InfiniBand
\n
• Strong expertise in Kubernetes, Slurm and OpenShift
\n
• Good experience in Python, PyTorch and TensorFlow
\n
• Good knowledge on LangChain, LangGraph
\n
• Deep understanding of Transformers, Attention mechanisms, Diffusion, MoE
\n
• Knowledge of RLHF, Pinecone, FAISS, Chroma, OpenAI, VLLM
\n
• Expertise in RAG and agentic AI workflows
\n
• Knowledge of high-performance storage (Lustre, PFS, Object NVMe)
\n
• Good Knowledge with NVIDIA architectures (Hopper, Blackwell)
\n

Soft Skills

\n
• Strong problem-solving and analytical thinking
\n
• Excellent communication and stakeholder management
\n
• Ability to influence leadership and drive strategic decisions
\n
• Innovation mindset with focus on enterprise impact
\n

Preferred Experience

\n
• Currently in AI / Cloud Presales team
\n
• Should be able to right size infra and choose right GPU model as per client requirement
\n
• Hands-on with Python, vector DBs (Pinecone, FAISS, Chroma), and LLM APIs (OpenAI, Anthropic).
\n
• Solid understanding of cloud-native architecture OpenStack, KVM, (Azure/AWS/GCP), microservices, Kubernetes, serverless, API gateways.
\n
• Good knowledge on deep learning experience: CNNs, RNNs/LSTMs, Transformers, and attention mechanisms.
\n
• Proficiency in Python for ML: NumPy, pandas, scikit-learn, and frameworks such as PyTorch or TensorFlow.
\n
• Experience in integrating LLMs (GPT, Claude, Gemini, LLaMA, Mistral) into applications.
\n
• Prompt engineering skills: zero-shot, few-shot, chain-of-thought, ReAct, and structured output patterns.
\n
• Experience building RAG systems: document chunking, embedding models, vector search, and retrieval optimization.
\n
• Understanding of AI agent patterns, tool use, and agentic workflows.
\n
• Familiarity with Docker, CI/CD pipelines, and Git-based workflows.
\n
• Strong communication, stakeholder management, and solution design skills.