Discover Model And Complete
A 2-step recipe with Hyperbolic. We can help you get access.
Recipe · 2 steps
Discover Model And Complete
with Hyperbolic
Confirm a base model from the catalog and generate a raw text completion.
- List the live inference catalog so the base model can be confirmed before a completion is requested.
- Submit the prompt to the base model and capture the generated text and token usage.
What you'll need to have ready
- apiKey: Hyperbolic API key passed as a Bearer token.
- model: Base model id (e.g. meta-llama/Meta-Llama-3.1-405B).
- prompt: The raw text prompt to complete.
- maxTokens: Maximum number of tokens to generate.
- temperature: Sampling temperature between 0 and 2.
For your developer
Arazzo workflow hyperbolic-ai:discover-model-and-complete, 2 operations: listModels → createCompletion. Specs on APIs.io.