Selectors
Selector categories
Data extraction selectors
Navigation selectors
Record and interaction selectors
Common configuration
- Selector ID - The field or navigation name used in the sitemap and output.
- CSS selector - The expression used to match page elements.
- Parent selectors - The selector contexts in which this selector runs.
- Delay - Time allowed before selection or interaction where the page updates asynchronously.
- Multiple - HTML, Link, Table, Element and Element Click selectors use a Multiple checkbox. When disabled, only the first match is processed. When enabled, all matching elements are processed.
- Multiple type - Text, Image and Element Attribute selectors use a Multiple type dropdown instead of a Multiple checkbox. The dropdown controls whether only the first match is returned or multiple matches are returned, and how those values are arranged in the output.
Execution order
Selectors under the same parent execute from top to bottom in the order displayed in the selector tree. Place selectors that change the page state before selectors that depend on the result of that action.
For example, when an Element Click selector reveals a phone number, the click selector must be positioned above the Text selector that extracts the phone number. Otherwise, the Text selector executes before the value is visible.
This is different from the order of elements matched by a CSS selector. Selector rows determine execution order. Matching elements within an individual selector are processed in HTML document order.
Multiple selectors and record generation
Selectors with Multiple enabled can create multiple output records. Sibling selectors that return a single value are repeated across those records.
One Multiple selector with single-value siblings
If one sibling selector has Multiple enabled and matches several elements, it creates several records. A sibling selector configured to return one value is copied into each of those records.
category Multiple: No
title Multiple: Yes
If title matches six elements, six records are created and the single
category value is repeated in each record.
Two or more Multiple selectors at the same level
Multiple sibling selectors are processed independently. Web Scraper does not pair their first matches, second matches and subsequent matches by position.
category Multiple: No
title Multiple: Yes
year Multiple: Yes
In this structure, the records created by title are output separately from the
records created by year. The single category value is repeated across both
groups of records.
If several values belong to the same repeated item and must appear in the same record, create an Element selector for the repeated item, enable Multiple on that Element selector, and place the individual field selectors beneath it.
item Multiple: Yes
├── title First Record Only
└── year First Record Only
This makes each repeated item element the record boundary, so its child fields
are extracted from the same item context.
Selection tools
Use the point-and-click selection tool for initial selector generation. Use manual CSS selectors when the generated selector is unstable or incomplete.