Check whether a TGI server is ready
One step with Hugging Face. We can help you get access.
Look something up
Check whether a TGI server is ready
with Hugging Face
Use Hugging Face: its Hugging Face Text Generation Inference Info API lets you check whether a TGI server is ready in a single step (GET /health). capabilities.work can help you get signed up and connected.
- Is my TGI server up with the model loaded and ready to serve requests?
- Which probe should a load balancer hit to confirm the text generation server is healthy?
Say it to your AI assistant
- Check the health of the TGI server.
- Confirm the text generation server is ready for traffic.
For your developer
GET /health in Hugging Face Text Generation Inference Info API. Full spec on APIs.io.