capabilities.work

Azure API Management AI Gateway Chat and Embed

A 2-step recipe with Microsoft Azure API Management. We can help you get access.

Recipe · 2 steps

Azure API Management AI Gateway Chat and Embed

Get a chat completion and an embedding through the AI gateway.

  1. Send the prompt as a chat completion request to the chat deployment and capture the assistant answer.
  2. Send the original prompt to the embeddings deployment to produce a vector for indexing and semantic search.
What you'll need to have ready
  • chatDeploymentId: The chat deployment identifier (e.g. gpt-4o-deployment).
  • embeddingDeploymentId: The embeddings deployment identifier.
  • prompt: The user prompt to answer and embed.
  • maxTokens: The maximum number of completion tokens.
For your developer

Arazzo workflow microsoft-azure-api-management:ai-gateway-chat-and-embed, 2 operations: AIGateway_ChatCompletions → AIGateway_Embeddings. Specs on APIs.io.