capabilities.work

Run a grader against a model sample

One step with OpenAI. We can help you get access.

Look something up

Run a grader against a model sample

with OpenAI · Artificial Intelligence Management

Use OpenAI: its OpenAI Fine Tuning API lets you run a grader against a model sample in a single step (POST /fine_tuning/alpha/graders/run). capabilities.work can help you get signed up and connected.

  • How do I score a single model output with a grader before fine-tuning?
  • Can I test a grader against a sample and a reference item to see the score it gives?
Say it to your AI assistant
  • Run grader {grader} on the model sample {model_sample}.
  • Score {model_sample} with grader {grader} using reference item {item}.
For your developer

POST /fine_tuning/alpha/graders/run in OpenAI Fine Tuning API. Full spec on APIs.io.