Skip to main content
Posted 02 July, 2026

Senior AI Engineer

VARITE INDIA PRIVATE LIMITED
Bangalore, Karnataka, IN Full Time
Reference: 26-36554-2522-2

Company Name: VARITE India Private Limited

About The Client:

Client is one of the world’s leading professional services firms and the fastest growing Big Four accounting firm

About The Job:
  • We’re building the next-generation multi-agentic system that powers intelligent, adaptive, and scalable chatbot experiences. As a Senior LLM Engineer , you'll be a core member of our team, designing and deploying production-ready systems built on foundation models. You’ll contribute across the LLM development lifecycle—from prompt engineering and fine-tuning to orchestration and LLMOps.
  • We're AWS-native and leverage GitLab for CI/CD and infrastructure automation. You’ll work closely with ML researchers, DevOps engineers, and product teams to operationalize advanced AI capabilities
Essential Job Functions:
  • LLM System Development
    • Design, build, and optimize multi-agent LLM architectures for chatbot orchestration.
    • Engineer advanced prompt chains, retrieval-augmented generation (RAG), and agent memory systems.
    • Integrate multiple LLMs (e.g., OpenAI, Anthropic) and tools (e.g., vector DBs, external APIs, code execution etc) into a cohesive agentic pipeline.
  • LLMOps & Deployment
    • Build and maintain LLMOps workflows using GitLab pipelines and Terraform/CloudFormation on AWS.
    • Monitor, test, and evaluate LLM performance in production; define guardrails, fallback strategies, and observability metrics.
  • Collaboration & Leadership
    • Mentor junior engineers; review code and model pipelines.
    • Collaborate with cross-functional stakeholders to translate product needs into LLM-driven solutions.
    • Stay ahead of LLM research trends and translate insights into practical engineering designs.
Qualifications:
Required:
  • 4-8 years in software or machine learning engineering, with 2+ years focused on LLMs or NLP systems.
  • Experience working in product environment and familiarity with Agile.
  • Deep experience with prompt engineering, LLM APIs, LangGraph/LangChain/LlamaIndex, and vector databases.
  • Worked on Agentic AI patterns – LLM workflows, Agent loops, ReAct Agents.
  • Proven skills in deploying and managing AI/ML workloads on AWS (e.g., SageMaker, ECS, EKS, S3, Lambda, CloudWatch).
  • Strong Python coding skill
  • Should be able to write clean python code without using AI.
  • Familiarity with LLMOps tooling (Langsmith, Langfuse etc.).

How to Apply: Interested candidates are encouraged to respond/submit their updated resumes, and for additional job opportunities, please visit Jobs In India – VARITE.

Unlock Rewards: Refer Candidates and Earn.
If you're not available or interested in this opportunity, please pass this along to anyone in your network who might be a good fit and interested in our open positions. VARITE offers a Candidate Referral program, where you'll receive a one-time referral bonus based on the following scale if the referred candidate completes a three-month assignment with VARITE.

Experience Level Bonus Referral:
0-2 years INR 5,000
2-6 years INR 7,500
6+ years INR 10,000

About VARITE: VARITE is a global staffing and IT consulting company providing technical consulting and team augmentation services to Fortune 500 Companies in USA, UK, CANADA and INDIA. VARITE is currently a primary and direct vendor to the leading corporations in the verticals of Networking, Cloud Infrastructure, Hardware and Software, Digital Marketing and Media Solutions, Clinical Diagnostics, Utilities, Gaming and Entertainment, and Financial Services.

Equal Opportunity Employer:
VARITE is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees. We do not discriminate on the basis of race, color, religion, sex, sexual orientation, gender identity or expression, national origin, age, marital status, veteran status, or disability status.

Sign up for Job Alerts