Back to Jobs
Agent Evaluation & Instrumentation Engineer
Umanist NA
Pune
Not Disclosed
8 - 11 Years
Full Time - Permanent
Views:1
Applicants:0
Posted on 5 Oct, 2026
In Office
Job Description | Responsibilities
- Evaluate AI agent performance and behavior.
- Design metrics, tests, and evaluation frameworks.
- Build instrumentation for monitoring agent systems.
- Analyze results and identify performance issues.
- Improve reliability and quality of AI agents.
Overview
- Industry - IT - Consulting Services / Advisory Services
- Job Role - Agent Evaluation & Instrumentation Engineer
- Employment type - Full Time - Permanent
- Work Mode - In Office
Qualifications
- Any Graduate - Any Specialization
- Any Post Graduate - Any Specialization
- Any Doctorate - Any Specialization
Job Related Keywords
AI Agents
Agent Evaluation
Instrumentation
LLM
Python
Monitoring
Testing
AI/ML Files
images
and data analysis are unavailable until usage resets at 3:22?PM. Continue chatting with text only
or upgrade for more access. Try Plus free