capabilities.work

Web Archive Search and Deliver

A 3-step recipe with Bright Data. We can help you get access.

Recipe · 3 steps

Web Archive Search and Deliver

with Bright Data

Submit an archive search, poll until ready, then deliver the corpus.

  1. Submit the archive search for the domain, returning a search id used to poll status and deliver.
  2. Poll the search status until it reaches a terminal state. A ready status means the matching corpus can be delivered.
  3. Schedule delivery of the matching corpus to the configured cloud destination in the requested format.
What you'll need to have ready
  • apiToken: Bright Data API token used as a Bearer credential.
  • domain: Domain to search the historical web index for.
  • query: Optional full-text query to constrain the search.
  • destinationType: Delivery destination type (s3, azure, gcs).
  • bucket: Destination bucket or container name.
  • credentials: Destination credentials object.
  • format: Delivery format (json, ndjson, parquet).
For your developer

Arazzo workflow bright-data:search-and-deliver-archive, 3 operations: submitArchiveSearch → getArchiveSearch → deliverArchiveToCloud. Specs on APIs.io.

More recipes with Bright Data

Marketplace Dataset Snapshot and DeliverDeep Lookup Trigger and Enrich ColumnsDeep Lookup Research and DownloadProvision an Unlocker Zone then Unlock a URLProvision a Zone and Allocate IPsProxy Manager Create and Verify a PortSubmit SERP Request and Retrieve ResultsScrape and Deliver Snapshot to Cloud StorageTrigger Web Scraper Job and Download ResultsMonitor a Snapshot and Cancel a Stuck Job