Azure API Management AI Gateway Chat and Embed
A 2-step recipe with Microsoft Azure API Management. We can help you get access.
Recipe · 2 steps
Azure API Management AI Gateway Chat and Embed
Get a chat completion and an embedding through the AI gateway.
- Send the prompt as a chat completion request to the chat deployment and capture the assistant answer.
- Send the original prompt to the embeddings deployment to produce a vector for indexing and semantic search.
What you'll need to have ready
- chatDeploymentId: The chat deployment identifier (e.g. gpt-4o-deployment).
- embeddingDeploymentId: The embeddings deployment identifier.
- prompt: The user prompt to answer and embed.
- maxTokens: The maximum number of completion tokens.
For your developer
Arazzo workflow microsoft-azure-api-management:ai-gateway-chat-and-embed, 2 operations: AIGateway_ChatCompletions → AIGateway_Embeddings. Specs on APIs.io.