capabilities.work

Dataset Size and Parquet Files

A 3-step recipe with Hugging Face. We can help you get access.

Recipe · 3 steps

Dataset Size and Parquet Files

with Hugging Face

Verify a dataset, read its size profile, and list its Parquet files.

  1. Confirm the dataset exists on the Hub before querying the viewer for its size and Parquet files.
  2. Read the dataset's size profile including row counts and byte sizes for the full dataset and for each subset and split.
  3. List the auto-converted Parquet files for the dataset so a consumer can plan efficient bulk access.
What you'll need to have ready
  • hfToken: Hugging Face access token used as a Bearer credential.
  • dataset: The dataset id on the Hugging Face Hub.
For your developer

Arazzo workflow hugging-face:dataset-size-and-parquet, 3 operations: $sourceDescriptions.datasetsApi.getDataset → $sourceDescriptions.filesMetadataApi.getDatasetSize → $sourceDescriptions.filesMetadataApi.getParquetFiles. Specs on APIs.io.

More recipes with Hugging Face

Chat Completion with Model DiscoveryCreate Repository and ConfigureDataset Filter RowsDataset Search and StatisticsDataset Validate and PreviewDeploy Inference Endpoint and WaitDiscover a SpaceEmbeddings PairGrounded Text GenerationSearch and Inspect a Model