AI Agent Developer
- Category: IT Engineer & Developer Jobs
- Location: Delhi
- Job Type: Full Time / Part Time
- Salary: Estimated: $ 20K to 33K
- Published on: 2025/09/27
Title:AI Agent Developer
Essentially the key words are -responsible AI/Explainable AI , AI testing, and certification
Exp: 3-5 Years
Location: LTIM PAN India
Skills
• Benchmarking Frameworks (e.g., HELM, Arena, MT-Bench)
• Agent Evaluation Metrics (Task success rate, CoT correctness, latency)
• Human-in-the-loop Testing
• Synthetic Data Generation
• Prompt Robustness Testing
• Hallucination Detection
• Response Evaluation (BLEU, ROUGE, GPTScore, etc.)
• A/B Testing of Agent Behaviors
• Safety Testing (e.g., jailbreaks, prompt injections)
• Trace Logging Interpretability
• Test Harness Automation for LLM Agents
This job is provided by Shine.com
Related jobs
-
Hiring BBA, BCOM, BSC, BCA Fresher
Company DescriptionFounded in 2016, Galleon Consultants is a global management consulting firm offering specialized services to large and multinational corporations across Australia, USA, Canada, Philippines, UK, and India. Our core focus areas inclu...
-
Engineering Manager
Job Summary: We are seeking an accomplished Engineering Manager with deep expertise in Microsoft technologies, capable of managing cross-functional development teams and overseeing complex technical solutions. Lead end-to-end software delivery across...
-
Technical Support Manager [GI-+02]
1. Responsible for organizing contract technical evaluation, review and formulating contract technical negotiation plan. 2. Responsible for the communication and coordination of technical issues in contract implementation, etc. 3．Responsible for assi...