Technical Program Manager
Job Description
Technical Program Manager
Location: Gurugram (Work From Office)
Experience: 10+ Years
Employment Type: Full-Time
Role Overview
We are looking for a Technical Program Manager (TPM) with strong engineering depth and program ownership to lead large-scale LLM post-training and AI data programs.
This is a tech-first TPM role requiring hands-on understanding of:
• Python full stack systems
• LLM post-training workflows (RLHF, SFT, evaluation pipelines)
• Docker-based environments and Git-driven workflows
You will act as a bridge between Engineering, Research, and Operations, ensuring that AI systems are not only designed but also executed at scale with high quality and reliability.
Key Responsibilities
1. Program Ownership & Delivery
• Own end-to-end delivery of LLM post-training programs
• Manage multiple high-throughput pipelines across teams
• Ensure alignment with client expectations, SLAs, and quality benchmarks
• Act as the single point of accountability for program success
2. Technical Execution & System Understanding
• Oversee design and execution of:
- RLHF / SFT pipelines
- code evaluation and validation systems
• Work closely with engineering teams to:
- Integrate APIs and data pipelines
- Ensure system scalability and reliability
• Identify and resolve technical bottlenecks and workflow inefficiencies
3. Engineering & Full Stack Alignment (Critical)
• Demonstrate strong understanding of:
- Python backend systems
- API and system architecture
- Frontend based systems
• Participate in:
- architecture discussions
- code reviews (high-level)
- o technical decision-making
4. DevOps & Workflow Practices
• Ensure effective use of:
- Git workflows (branching, versioning, PR reviews)
- Docker environments for consistent execution and deployment
• Align with CI/CD and automation practices for smooth delivery
5. Automation & Performance Optimization
• Drive automation across pipelines to improve:
- throughput
- consistency
- efficiency
• Define and track key metrics:
- pipeline throughput
- system reliability
- delivery efficiency
6. Stakeholder & Team Leadership
• Lead cross-functional teams across:
- Engineering
- Operations
- Quality / Evaluation
• Manage client communication and expectations
• Provide data-driven updates to leadership
• Mentor Program Managers, Leads, and Engineers
Technical Requirements (Mandatory)
• 10+ years of experience in technical program management or engineering leadership
• Strong hands-on understanding of:
- Python full stack systems (backend + APIs + integrations)
- LLM post-training workflows (RLHF, SFT, evaluation pipelines)
• Practical experience with:
- Git workflows (version control, branching, collaboration)
- Docker (containerization and execution environments)
• Experience working with: data pipelines; scalable distributed systems; API-driven architectures
• Ability to: review code and system design; translate business problems into technical solutions
Managerial & Leadership Expectations
• Proven ability to manage large-scale, complex programs
• Strong ownership of end-to-end delivery
• Experience handling high-volume, execution-driven environments
• Strong skills in:
- stakeholder management
- risk identification and mitigation
- delivery planning and tracking
• Ability to align technical execution with business outcomes
• Experience mentoring teams and driving performance excellence
Preferred Experience
• Experience in AI/ML or LLM ecosystems
• Familiarity with:
- evaluation frameworks / harness systems
- human-in-the-loop workflows
• Exposure to:
- cloud platforms (AWS/GCP/Azure)
- CI/CD pipelines and DevOps practices
Success Metrics
• Program delivery within timeline and quality benchmarks
• Efficiency and scalability of post-training pipelines
• Improvement in automation and system reliability
• Reduction in delivery bottlenecks and operational inefficiencies
• Cross-team alignment and execution effectiveness
Why Join Us
• Lead high-impact AI/LLM programs at scale
• Work on production-grade LLM systems
• High ownership in a fast-paced, execution-driven environment
• Opportunity to influence engineering, research, and operations alignment