capabilities.work

Get Prometheus metrics for a NIM container

One step with NVIDIA NIM. We can help you get access.

Look something up

Get Prometheus metrics for a NIM container

with NVIDIA NIM

Use NVIDIA NIM: its NVIDIA NIM Biology (BioNeMo) ASR Health API lets you get Prometheus metrics for a NIM container in a single step (GET /v1/metrics). capabilities.work can help you get signed up and connected.

  • Where can I scrape GPU utilization and request latency metrics for my NIM deployment?
  • Can I see the current request queue depth for an inference container in Prometheus format?
Say it to your AI assistant
  • Fetch the Prometheus metrics from my NIM container.
  • Show the GPU utilization, latency histograms and queue depth for this NIM.
For your developer

GET /v1/metrics in NVIDIA NIM Biology (BioNeMo) ASR Health API. Full spec on APIs.io.

More you can do with NVIDIA NIM

List the models this NIM endpoint servesGet details for one modelCheck that the NIM container process is aliveCheck that the model is loaded and readyGenerate a chat reply from a conversationRerank passages by relevance to a queryComplete a raw text promptCreate embedding vectors for textTranscribe an audio clip to textGenerate or edit an image from a promptPredict a protein's 3D structure from its sequenceDock a small-molecule ligand to a protein