Run a Workers AI model

Run a Workers AI model

Use Cloudflare: its Cloudflare Workers AI AI Inference API lets you run a Workers AI model in a single step (POST /accounts/{account_id}/ai/run/{model}). capabilities.work can help you get signed up and connected.

• How do I run a text generation model like Llama on Cloudflare's network?
• Can I stream the model's output back as server-sent events?
• What inputs can I send, such as a chat message list, an image or text to translate?

Say it to your AI assistant

• Run model {model} on account {account_id} with the prompt {prompt}.
• Send chat {messages} to model {model} in account {account_id}, capped at {max_tokens} tokens.
• Translate {text} from {source_lang} to {target_lang} using model {model} on account {account_id}.

For your developer

POST /accounts/{account_id}/ai/run/{model} in Cloudflare Workers AI AI Inference API. Full spec on APIs.io.