Scraping workflow guides

Choose a workflow

• Scrape repeated records from listing pages
• Follow listing links and scrape detail pages
• Navigate multiple categories
• Handle pagination, load more and infinite scrolling
• Click tabs, buttons and product variants
• Extract from iframes and shadow DOM
• Scrape URLs from sitemap.xml

Guide and reference distinction

Workflow guides explain how selectors work together. Selector pages document the configuration of one selector type. Use both when diagnosing a complex sitemap.

Related

• Selector reference
• Troubleshooting