AI Test Engineer

Date Of Requisition

26^th September

ECMS REQ ID/ Unique ID

539006

PU

DNA

Project Manager

Gopi Krishna Devanga [email protected]

Delivery SPOC

Gopi Krishna Devanga [email protected]

Number of Openings

539006

Country

India

Detailed JD (Roles and Responsibilities)

Roles & Responsibilities:

• Design and implement test plans for AI models, including LLMs and agentic systems.
• Develop and refine prompts to evaluate model behavior, edge cases, and failure modes.
• Test agentic AI workflows involving planning, tool use, memory, and goal-directed behavior.
• Create automated test suites for regression, performance, and adversarial testing.
• Collaborate with AI researchers, data scientists, and product teams to define quality metrics.
• Analyze model outputs for bias, hallucination, toxicity, and factual accuracy.
• Contribute to the development of internal tools for prompt evaluation and agent simulation
• Collaborate with cross-functional teams to gather requirements and in test automation

Qualifications:

2+ Experience in testing Agentic AI

Total Experience

8+

Relevant Experience

2+

Mandatory skills

prompt testing, Eval, building synthetic models, validating multi-agent coordination behaviors, agent reasoning

Desired skills

AI evaluation metrics

Domain (Industry)

-

Work Location

Bangalore, Hyderabad

Background Check (Before onboarding / After onboarding)

Pre-onboarding

BGV Vendor

-

Mode of Interview- Telephonic/Face to Face/Video Interview

Face to Face/Teams Interview

WFO / WFH / Hybrid

Hybrid

Shift Details (Time)

-

Client BTP / SHTP (onsite)

-

Vendor Rate in currency of Work Location

INR 10000 per day