Run an evaluation on an agent or workforce
One step with Relevance AI. We can help you get access.
Get something done
Run an evaluation on an agent or workforce
with Relevance AI · Software Quality Engineering
Use Relevance AI: its Relevance AI Endpoints Evals API lets you run an evaluation on an agent or workforce in a single step (POST /evals/{resource_type}/{resource_id}/evaluate). capabilities.work can help you get signed up and connected.
- How do I evaluate a set of my agent's past conversations?
- Can I run an evaluation using a whole test set and selected rules?
Say it to your AI assistant
- Start an evaluation run named {evaluation_run_name} on {resource_type} {resource_id} for conversations {conversation_ids}.
- Evaluate agent {resource_id} against test set {test_set_id} as run {evaluation_run_name}.
For your developer
POST /evals/{resource_type}/{resource_id}/evaluate in Relevance AI Endpoints Evals API. Full spec on APIs.io.