capabilities.work

Trigger Web Scraper Job and Download Results

A 3-step recipe with Bright Data. We can help you get access.

Recipe · 3 steps

Trigger Web Scraper Job and Download Results

with Bright Data

Trigger a scrape, poll the snapshot, and download the results.

  1. Trigger an asynchronous scraping job for the dataset using the supplied per-record input payload, returning a snapshot id to poll.
  2. Poll the snapshot progress endpoint. Bright Data reports running, building, or collecting while the job is in flight and ready when the rows are available for download.
  3. Download the snapshot rows once the snapshot reports a ready status, returning the collected records in the requested format.
What you'll need to have ready
  • apiToken: Bright Data API token used as a Bearer credential.
  • datasetId: Bright Data dataset identifier of the collector to run.
  • records: Array of per-record input objects passed to the collector.
  • includeErrors: Whether to include error rows in the snapshot output.
  • format: Download format for the snapshot (json, ndjson, csv, jsonl).
For your developer

Arazzo workflow bright-data:trigger-and-download-scrape, 3 operations: triggerScrape → getScrapeProgress → downloadSnapshot. Specs on APIs.io.

More recipes with Bright Data

Marketplace Dataset Snapshot and DeliverDeep Lookup Trigger and Enrich ColumnsDeep Lookup Research and DownloadProvision an Unlocker Zone then Unlock a URLProvision a Zone and Allocate IPsProxy Manager Create and Verify a PortSubmit SERP Request and Retrieve ResultsWeb Archive Search and DeliverScrape and Deliver Snapshot to Cloud StorageMonitor a Snapshot and Cancel a Stuck Job