capabilities.work

Building an AI Assistant & Chat app

Every piece it needs, and who provides it. Pick a provider to see what you can do with it.

Application blueprint

AI Assistant & Chat

What 8 leading AI Assistant & Chat apps are built from: the capabilities they need and the providers they actually use, from their code and their published integrations.

8 reference apps 93 providers 61 providers ready for AI assistants

What makes it an AI Assistant & Chat app

Hosted LLM Inference

the chat app is a front end over hosted model APIs; every reference app ships multi-vendor LLM connectors [AE id AE-110.10.10; dotted form rejected by schema capability_ref pattern, recorded hyphenated with fit gap]

Anthropic AI-assistant ready
used by AnythingLLM, LibreChat, LobeChat, Open WebUI
OpenAI AI-assistant ready
used by AnythingLLM, LibreChat, LobeChat, Open WebUI
Perplexity AI-assistant ready
used by AnythingLLM, LibreChat, LobeChat
Google Gemini
used by AnythingLLM, LibreChat, LobeChat
Amazon Bedrock AI-assistant ready
used by AnythingLLM, LibreChat, LobeChat
Vertex AI (Anthropic on Vertex) AI-assistant ready
used by AnythingLLM, LibreChat, LobeChat
Mistral AI
used by AnythingLLM, LibreChat, LobeChat
DeepSeek
used by AnythingLLM, LibreChat, LobeChat

and 27 more providers

Retrieval-Augmented Generation

Serper
used by AnythingLLM, LibreChat, Open WebUI
Google Programmable Search
used by AnythingLLM, LibreChat, Open WebUI
Tavily AI-assistant ready
used by AnythingLLM, LibreChat, Open WebUI
SerpApi AI-assistant ready
used by AnythingLLM, Open WebUI
Exa AI-assistant ready
used by AnythingLLM, Open WebUI
SearchApi AI-assistant ready
used by AnythingLLM, Open WebUI
Keenable AI-assistant ready
used by AnythingLLM, LibreChat
Bing Search
used by AnythingLLM, Open WebUI

and 8 more providers

Vector Search

vector stores behind RAG / knowledge bases [AE id AE-110.60.20; dotted form rejected by schema capability_ref pattern, recorded hyphenated with fit gap]

Pinecone AI-assistant ready
used by AnythingLLM, Open WebUI
Chroma AI-assistant ready
used by AnythingLLM, Open WebUI
Weaviate AI-assistant ready
used by AnythingLLM, Open WebUI
Milvus AI-assistant ready
used by AnythingLLM, Open WebUI
Qdrant AI-assistant ready
used by AnythingLLM, Open WebUI
DataStax Astra DB AI-assistant ready
used by AnythingLLM
LanceDB AI-assistant ready
used by AnythingLLM
Zilliz AI-assistant ready
used by AnythingLLM

Model Routing & Gateways

aggregators (OpenRouter) let a chat app reach many models through one key [AE id AE-110.10.30; dotted form rejected by schema capability_ref pattern, recorded hyphenated with fit gap]

OpenRouter AI-assistant ready
used by AnythingLLM, LibreChat, LobeChat
APIpie
used by LibreChat
ShuttleAI
used by LibreChat

Image Generation

image tools inside the chat (Flux, fal, Replicate) [AE id AE-110.20.10; dotted form rejected by schema capability_ref pattern, recorded hyphenated with fit gap]

Black Forest Labs (Flux) AI-assistant ready
used by LibreChat, LobeChat
fal AI-assistant ready
used by LobeChat
Replicate AI-assistant ready
used by LobeChat

Embeddings

embedding engines for chat-with-your-documents [AE id AE-110.60.10; dotted form rejected by schema capability_ref pattern, recorded hyphenated with fit gap]

Jina AI AI-assistant ready
used by LibreChat
Voyage AI
used by AnythingLLM

Data & Reference Information Services

reference data tools (weather)

OpenWeather AI-assistant ready
used by LibreChat

OCR & Document AI

document extraction for uploaded files [AE id AE-110.40.20; dotted form rejected by schema capability_ref pattern, recorded hyphenated with fit gap]

Azure AI Document Intelligence AI-assistant ready
used by Open WebUI

Text-to-Speech

voice replies [AE id AE-110.30.20; dotted form rejected by schema capability_ref pattern, recorded hyphenated with fit gap]

ElevenLabs AI-assistant ready
used by AnythingLLM

What every app like this also needs

Social & Federated Login

social sign-in strategies [AE id AE-160.10.30; dotted form rejected by schema capability_ref pattern, recorded hyphenated with fit gap]

GitHub AI-assistant ready
used by LibreChat
Apple
used by LibreChat
Discord
used by LibreChat
Facebook
used by LibreChat
Google sign-in
used by LibreChat

Storage Management

file uploads to object storage; no object-storage capability

Azure Blob Storage AI-assistant ready
used by LibreChat, Open WebUI
Google Cloud Storage AI-assistant ready
used by Open WebUI
Amazon S3 AI-assistant ready
used by LibreChat
Firebase AI-assistant ready
used by LibreChat

Observability Management

crash / error reporting

Sentry AI-assistant ready
used by ChatGPT, Claude, Le Chat (Mistral)
Firebase (Crashlytics) AI-assistant ready
used by Perplexity

Product Usage Analytics

product analytics / telemetry

Segment
used by ChatGPT, Claude
PostHog AI-assistant ready
used by AnythingLLM
Firebase Analytics AI-assistant ready
used by Perplexity

Internal Communications Management

Slack / Discord bot adapters

Slack AI-assistant ready
used by LobeChat
Discord
used by LobeChat

Managed Operational Databases

Neon AI-assistant ready
used by LobeChat
Upstash AI-assistant ready
used by LobeChat

Transactional Email

verification / password email [AE id AE-150.10.10; dotted form rejected by schema capability_ref pattern, recorded hyphenated with fit gap]

Resend AI-assistant ready
used by LobeChat
Mailgun AI-assistant ready
used by LibreChat

WhatsApp & OTT Messaging

the assistant answers inside messaging apps (bot adapters) [AE id AE-150.20.20; dotted form rejected by schema capability_ref pattern, recorded hyphenated with fit gap]

Telegram
used by AnythingLLM, LobeChat

Cloud Drive & File Sync

Microsoft Graph file picker / people search

Microsoft Graph AI-assistant ready
used by LibreChat

Edge Functions & Edge Config Stores

Vercel AI-assistant ready
used by LobeChat

Mobile Attribution & Deep Linking

install attribution in the mobile app

Singular
used by Perplexity

Payment Processing Management

paid plans

Stripe AI-assistant ready
used by LobeChat

Software Construction Management

hosting / dev platform; no hosting capability

GitHub AI-assistant ready
used by LobeChat

Webhook Delivery Reliability Management

webhook delivery (Svix); no webhook capability

Svix
used by LobeChat

agent

Browser & Computer-Use Automation

Firecrawl AI-assistant ready
used by AnythingLLM, LibreChat, Open WebUI

Agent Observability

LLM tracing (Langfuse) [AE id AE-100.60.20; dotted form rejected by schema capability_ref pattern, recorded hyphenated with fit gap]

Langfuse AI-assistant ready
used by LibreChat, LobeChat

Agent Tool Exposure

third-party tool catalogs the assistant calls (Composio, Zapier NLA) [AE id AE-100.10; dotted form rejected by schema capability_ref pattern, recorded hyphenated with fit gap]

Zapier AI-assistant ready
used by LibreChat
Composio AI-assistant ready
used by LobeChat

The reference apps

Open WebUI
26 providers · has its own MCP server
LibreChat
39 providers · has its own MCP server
LobeChat
48 providers · has its own MCP server
AnythingLLM
43 providers · has its own MCP server
ChatGPT
2 providers
Claude
2 providers
Perplexity
2 providers

All application types · Blueprint from APIs.io Applications by API Evangelist, CC BY-NC-SA 4.0. Capabilities marked from Turbo EA Capabilities by Vincent Verdet (CC BY 4.0). Adapted: a subset, shown for business readers.