capabilities.work

Score a Running Scenario Run

A 4-step recipe with Runloop. We can help you get access.

Recipe · 4 steps

Score a Running Scenario Run

with Runloop

Run an existing scenario, score it while running, then complete it.

  1. Start a run of the existing scenario, provisioning a devbox for it.
  2. Poll the run until it reports the running state so the environment is ready to be scored.
  3. Trigger scoring of the currently running scenario run.
  4. Complete the run, shutting down the underlying devbox.
What you'll need to have ready
  • apiToken: Runloop API bearer token.
  • scenarioId: The id of the existing scenario to run and score.
  • runName: Optional display name for the run.
For your developer

Arazzo workflow runloop-ai:score-running-scenario-run, 4 operations: startScenarioRun → getScenarioRun → scoreScenarioRun → completeScenarioRun. Specs on APIs.io.