capabilities.work

Set the pre-publish eval config

One step with Relevance AI. We can help you get access.

Get something done

Set the pre-publish eval config

with Relevance AI · Software Quality Engineering

Use Relevance AI: its Relevance AI Endpoints Evals API lets you set the pre-publish eval config in a single step (POST /evals/{resource_type}/{resource_id}/pre-publish/config). capabilities.work can help you get signed up and connected.

  • How do I require certain test sets to run before an agent is published?
  • Does saving a pre-publish config replace the whole existing one?
Say it to your AI assistant
  • Set the pre-publish config for {resource_type} {resource_id} to test sets {test_sets}.
  • Replace agent {resource_id}'s pre-publish checks with test sets {test_sets}.
For your developer

POST /evals/{resource_type}/{resource_id}/pre-publish/config in Relevance AI Endpoints Evals API. Full spec on APIs.io.