Update a crawler's configuration (versioned)
One step with Algolia. We can help you get access.
Get something done
Update a crawler's configuration (versioned)
with Algolia
Use Algolia: its Crawler API lets you update a crawler's configuration (versioned) in a single step (PATCH /1/crawlers/{id}/config). capabilities.work can help you get signed up and connected.
- How do I change a crawler's start URLs or schedule and keep a version history?
- Can I update the rate limit or exclusion patterns on my crawler?
Say it to your AI assistant
- Update crawler {id}'s config with actions {actions}, app {appId} and rate limit {rateLimit}.
- Set crawler {id} to start from {startUrls} on schedule {schedule}.
- Add exclusion patterns {exclusionPatterns} to crawler {id}'s configuration.
For your developer
PATCH /1/crawlers/{id}/config in Crawler API. Full spec on APIs.io.