Web Scraper documentation
Start here
Web Scraper uses a sitemap to describe how a website should be navigated and which data should be extracted. Build the sitemap in the browser extension, test it against the target website, and run it locally or in Web Scraper Cloud.
- Create your first scraper
- Build a sitemap with the AI Sitemap Wizard
- Build a custom sitemap with the Advanced Sitemap Builder
- Run an existing sitemap in Web Scraper Cloud
Browse documentation
Getting started
Install the extension, open Web Scraper, create a sitemap and run a first scraping job.
Build a sitemap
Understand sitemap structure, start URLs, selectors and data validation.
- Sitemaps and selector trees
- Start URLs and URL ranges
- Selector reference
- Preview and validate a sitemap
Common workflows
Combine selectors to solve common navigation and extraction tasks.
- Scrape listing pages
- Scrape listing and detail pages
- Handle pagination, load more and infinite scrolling
- Click tabs, buttons and product variants
Run and automate
Troubleshooting
- No data was extracted
- Pagination stops early
- JavaScript content does not load
- The website blocks the scraper
Product boundaries
The browser extension creates and runs sitemaps locally. Web Scraper Cloud runs compatible sitemaps remotely and adds scheduling, proxy configuration, monitoring, retries, API access, webhooks, parsing and automated data delivery.
No universal scraping tool can guarantee compatibility with every website. Test the target site with the extension before designing a production workflow.