List every page URL on a website
One step with Context.dev. We can help you get access.
Look something up
List every page URL on a website
with Context.dev
Works with AI assistants
Use Context.dev: its Context Web Scraping API lets you list every page URL on a website in a single step (GET /web/scrape/sitemap). Context.dev also has an MCP server, so an AI assistant like Claude or ChatGPT can do it for you. capabilities.work can help you get signed up and connected.
- How can I get a list of all the page URLs on a website from its sitemap?
- Can I filter sitemap URLs with a regex, like only blog posts?
Say it to your AI assistant
- Crawl the sitemap of {domain} and list its URLs.
- List up to {maxLinks} URLs on {domain} matching {urlRegex}.
For your developer
GET /web/scrape/sitemap in Context Web Scraping API. Full spec on APIs.io.