Check that the model is loaded and ready
One step with NVIDIA NIM. We can help you get access.
Look something up
Check that the model is loaded and ready
with NVIDIA NIM
Use NVIDIA NIM: its NVIDIA NIM Biology (BioNeMo) ASR Health API lets you check that the model is loaded and ready in a single step (GET /v1/health/ready). capabilities.work can help you get signed up and connected.
- Has the model engine finished loading so the NIM can start accepting traffic?
- Which check tells a load balancer the container is ready to serve inference requests?
Say it to your AI assistant
- Check whether the NIM model engine is loaded and ready for requests.
- Run the readiness probe before sending traffic to the container.
For your developer
GET /v1/health/ready in NVIDIA NIM Biology (BioNeMo) ASR Health API. Full spec on APIs.io.