capabilities.work

Search Then Scrape Result

A 2-step recipe with Oxylabs. We can help you get access.

Recipe · 2 steps

Search Then Scrape Result

with Oxylabs

Parse a search result then scrape the discovered URL.

  1. Run a parsed, query-based search so the structured response can surface a result URL.
  2. Scrape the discovered result URL with JavaScript rendering using a second realtime job.
What you'll need to have ready
  • searchSource: Query-based search source (e.g. google_search).
  • query: Search query to run.
  • fetchSource: Source used to scrape the discovered URL (e.g. universal).
  • geo_location: Geo-targeting location string.
For your developer

Arazzo workflow oxylabs:search-then-scrape-result, 2 operations: submitQuery → submitQuery. Specs on APIs.io.