Machine Intelligence Analyst
Job Description
Hello
Greetings from ZettaMine Labs Pvt Ltd!!
We are looking for Machine Intelligence Analyst for PAN India.
Looking only for Immediate Joiners
Job Role : Machine Intelligence Analyst
Location : PAN India
Notice Period : NA( As it is for Gig Workers)
Experience : 2 to 4 years
Relevant Exp : Minimum of 2 Years Experience in below list Skills
'13; LLM internals (transformers, RLHF, attention)
'13; Multi-modal AI systems
'13; Adversarial ML & red-teaming
'13; Inter-rater agreement metrics
'13; NLP and computational linguistics
'13; Safety evaluation & responsible AI
'13; Prompt engineering & instruction evaluation
'13; Python scripting & statistical analysis.
Mandatory :
- PhD in CS, ML, Computational Linguistics, Cognitive Science, or Mathematics (MS with exceptional industry/research experience considered)
- 2–3+ years in AI/ML research, model evaluation, or applied NLP; demonstrated experience with LLM fine-tuning, alignment, or evaluation datasets
Job Description:
As a Machine Intelligence Analyst, you will serve as a high-signal evaluator and adversarial tester for large language models and multi-modal AI systems. Working alongside frontier AI researchers and ML engineers, you will produce gold-standard evaluation data, surface failure modes, and stress-test model safety boundaries. Your expert judgment directly shapes the quality of AI systems used by the world’s leading technology organisations.
Key Responsibilities:
LLM Evaluation & Alignment
- Conduct expert preference annotation and comparative evaluation for RLHF and RLAIF pipelines; assess outputs for accuracy, reasoning quality, coherence, and intent alignment
- Generate and annotate SFT datasets; rate instruction-following quality, chain-of-thought correctness, and response calibration
Adversarial Safety & Red-Teaming
- Design and execute adversarial prompts to probe safety boundaries and jailbreak vectors; identify hallucination patterns, refusal evasion, and harmful output pathways
- Contribute to safety evaluation rubrics, adversarial scenario libraries, and structured vulnerability documentation
Multi-Modal Annotation & Quality
- Annotate and evaluate text, image, audio, and video model outputs; apply domain knowledge (science, law, medicine, code, linguistics) to nuanced tasks
- Uphold 98%+ accuracy; participate in inter-rater calibration; leverage Platina’s AI-assisted tooling to maximise throughput.
Please provide following detail along with your updated profile to
Primary Skill -
Total Experience -
Relevant Experience :
Current location
Highest Qualificaiton:
Expertise/Stream:
Domain :
I will be reaching out to you over a call or email as soon as possible.
Thanks & Regards,
Vyshnavi