Deploy a Dedicated Endpoint and infer
A 3-step recipe with FriendliAI. We can help you get access.
Recipe · 3 steps
Deploy a Dedicated Endpoint and infer
with FriendliAI · Artificial Intelligence Management
Create a Dedicated Endpoint, poll status, then send inference to it.
- createEndpoint
- checkStatus
- infer
What you'll need to have ready
- token
- model
- prompt
For your developer
Arazzo workflow friendliai:deploy-and-infer, 3 operations: dedicatedCreateEndpoint → dedicatedGetEndpointStatus → dedicatedChatComplete. Specs on APIs.io.