August 08, 2025
Advanced Sitemap Builder, Reliable web scraping selectors, Multi-element data extraction using AI, AI-powered selector generation, AI web scraping automation, Sitemap Wizard for web scraping, Web Scraper AI update, Automated data extraction tools, Streamlined web scraper interface with AI, CSS selector improvements
We are excited to announce a new version of the Web Scraper extension packed with AI-powered improvements, usability upgrades, and some important changes to how selectors work. This release focuses on making your most common use cases simpler while utilising AI tools for advanced data extraction scenarios.
August 08, 2024
Authenticated page scraping, Login automation for web scraping, Web Scraper Website State Setup, Web Scraper change currency feature, Web Scraper input and click automation, Conditional data extraction Web Scraper, Automate conditional web scraping actions, Web Scraper change location feature, Website-specific data collection automation, Efficient web scraping workflow
In the world of web scraping and data collection, efficiency and precision are paramount. That's why we're excited about the new feature that is being added to Web Scraper functionality: Website State Setup. This feature you to execute conditional actions based on specific criteria, ensuring you collect the most relevant data.
August 01, 2024
Page load detection fix, Web Scraper performance update, Web scraping tool enhancements, Web Scraper bug fixes, Input validation refactor, Web Scraper 1.79.3 release, Efficient web scraping features, Web Scraper sitemap sync, Optimized data export Web Scraper, Improved link extraction Web Scraper
New Update: Web Scraper 1.79.3
Web scraping enthusiasts and data aficionados, rejoice! The latest release of Web Scraper, version 1.79.3, brings several enhancements and fixes.
February 19, 2024
Pagination type Link from script, Web Scraper update, Dynamic link scraping, Network traffic page navigation, Advanced link extraction, Window.open() and window.location scraping, Selector grouping feature, Misconfiguration modal for selectors, Web Scraper performance enhancements
Exciting Updates Alert!
We're thrilled to announce some powerful features and enhancements in our latest Web Scraper update!
Check out what's new:
November 27, 2023
Web Scraper UI improvements, Web Scraper extension update, Enhanced Link Selector feature, HTML code on hover, Page load scraping fix, Scrape non-HTML links, Faster data extraction Chrome, Web Scraper user experience update, Refactored scraping extension, Selector deletion confirmation popup
We're thrilled to share the latest enhancements in our extension to make your experience even smoother. Check out the new features and improvements in our latest release:
July 07, 2023
Chrome MV3 compatibility update, Improved mouse click simulation, Web Scraper latest update, Web Scraper extension feature release, New Link Selector feature, Extract links from attributes, Sitemap deletion confirmation, Pop-up Link Selector removal, Scrape text-based links
Hey there! We've got some major news to share with you that will up your scraping game. We're thrilled to introduce the latest and greatest version of Web Scraper. Take your experience to a new level with the newly updated Link Selector and more.
May 10, 2023
Selector execution order control, Web Scraper CSS selector optimization, Chrome Manifest V3 update, Web Scraper extension updates, Web Scraper feature release, PouchDB to local storage migration, Latest Web Scraper extension updates, Automated CSS selector restructuring, Web Scraper validation engine update, Improve web scraper speed
It's time for our latest feature release article, and we can't wait to show you what we've been working on!
September 09, 2022
Web Scraper shadow-root support, Web Scraper element scroll selector, Web Scraper release notes, Web Scraper 0.6.5 update, Web Scraper data export improvements, Web Scraper bug fixes, Firefox sitemap sync Web Scraper, Web Scraper UTF-8 text handling, Web Scraper performance optimizations, Web Scraper new features
For the last few months, we have been working towards the Web Scraper 0.6.5 release, and finally, it is here!
June 28, 2022
DOM element selection techniques, Isolating specific page elements for scraping, CSS selectors for web scraping, Web Scraper Chrome tool selector guide, :contains() and :has() jQuery selectors, Attribute-based CSS selectors, Advanced element targeting for scraping, Chaining CSS and jQuery selectors, nth-child and nth-of-type selectors, jQuery selectors for data extraction
Selectors, when it comes to CSS and jQuery, refer to code you can use to interact with specific elements in the DOM. They are particularly useful when you want to style or act upon certain elements of the document without altering other elements. Through a careful use of selectors, you can manipulate a page exactly as intended or isolate the specific data you’re looking to scrape.
May 02, 2022
Average price calculation in Athena, Analyze web scraping data in AWS, Web scraping data analysis with Athena, AWS data querying and processing, Amazon Athena SQL queries, Web Scraper Cloud data insights, Sync scraping results to Amazon S3, Query JSON data with Athena, Create Athena table from S3 JSON, Web Scraper Cloud S3 integration
Amazon Athena lets you use SQL to interactively query any data you have within an Amazon S3 Bucket. With Web Scraper Cloud, you can automatically sync web scraping job results to an Amazon S3 Bucket where you can then use Athena to quickly query this data with little additional overhead. In this article, we’re going to guide you through syncing Web Scraper Cloud with an S3 bucket and using Athena to generate and perform calculations on table data. While we’re covering a specific use case, you can adapt this same process to any other data set to gather insights.
March 21, 2022
Extract HTML elements with Cheerio, Parse web page content in Node.js, Headless scraper setup tutorial, Web scraping with Axios and Cheerio, JavaScript web scraping techniques, Axios HTTP requests for web scraping, Automated data extraction using Cheerio, Spoof browser headers for scraping, Cheerio Node.js web scraping, Scrape dynamic pages without a browser
Cheerio is a node package that allows you to easily parse and extract elements from markup. Unlike a browser, Cheerio doesn’t produce a visual rendering, load external resources, execute JavaScript code, or apply CSS. As a result, it’s much faster than other solutions when it comes to scraping web pages for valuable data.
In this article, we’re going to specifically cover how to set up a headless scraper with Cheerio and spoof browser headers to access a wider range of web pages.
March 03, 2022
Legal web scraping GDPR compliance, Lawful data processing for scraping public data, Compliance tips for automated data extraction, Facebook vs BrandTotal web scraping lawsuit, HiQ vs LinkedIn web scraping case analysis, Scraping publicly available data lawfully, Platform Terms and Conditions web scraping, Scraping emails and phone numbers legally, GDPR guidelines for data scraping, Data minimisation principle for web scraping
We’ve all been hearing about the ongoing cases of companies failing lawsuits against web scraping activities. Worth mentioning are the cases of LinkedIn vs. HiQ on public data scraping and the case of Facebook Inc. vs. BrandTotal Ltd. on scraping data from Facebook. What is more interesting is that in one case it was ruled in favour of the data scraper, but in the other - of the company whose platform is being scraped. Seeing such cases with different outcomes raises questions, especially due to the recent General Data Protection Regulation (GDPR), on how lawful web scraping of publicly available data actually is?
September 01, 2021
Web Scraper extension new features update, Automatized element attribute selector Web Scraper, Syncing local and cloud sitemaps automatically, Cloud synchronization for Web Scraper sitemaps, Web Scraper sitemap search bar functionality, Web Scraper pagination selector guide, Data preview and element count in Web Scraper, How to create pagination in Web Scraper, Inspecting and validating selectors Web Scraper, Web Scraper additional data preview feature
The moment has come that we are ready to release the most requested feature of all time! Creating pagination correctly has been one of the most frequently reported problems; however, that is about to change. The pagination selector is here, and so are other additional updates that will make scraping with Web Scraper easier.
August 02, 2021
Web scraping applications in data science, Web scraping for e-commerce product data, Web scraping meaning and definition, How web scraping works step by step, Web scraping for lead generation and research, Uses of web scraping in business and marketing, Legal considerations for web scraping, Detecting web scraping activity on websites, Which websites allow web scraping, Making money with web scraping data
For discovery and greater understanding, questions are a must. Therefore, we have collected the most frequently asked questions by the public about different web scraping topics.
June 14, 2021
Automated data export to Google Sheets, Visualize scraped data in Google Sheets, How to append Web Scraper data to Google Sheets, Automatic updating of scraped data in spreadsheets, Google Append feature for cloud data export, Scheduler-enabled Google Sheets export for automation, Create dynamic charts from Web Scraper data, Export and visualize cryptocurrency data automatically, Streamline data visualization with automated Google Sheets, Google Sheets integration for Web Scraper Cloud
Most people could agree that observing a picture, a simple graph, or a pie chart is easier and more efficient than scrolling through blocks of text or trying to parse out useful insights from looking at numerous columns in a spreadsheet. This common knowledge is the basis of why visualisation is so important.
Also, in a rapidly changing world, people seek ways of becoming more efficient, ways of increasing the time spent focusing on the insights, rather than pouring endless hours and effort into collecting the necessary assets to gain those end results that determine so much. This is why automation nowadays is a key topic.
June 01, 2021
Customer review data extraction techniques, Improving business decisions with review data, How to monitor online reviews effectively, Web scraping customer reviews for market research, Sentiment analysis of product reviews, Automating customer review collection online, Customer review analysis for business insights, Using customer feedback for product development, Competitive analysis using customer reviews, Gathering online reviews for social proof
Just like a vehicle tire leaves an imprint in the mud, which can be washed away only by a great storm or rainfall, an impression leaves an impact on a product, which then becomes the formatting foundation of an opinion that can not be altered easily. For this simple reason, creating an interesting, positive, and captivating impression on your customers will go a long way toward your business's success and overall reputation.
May 14, 2021
Web scraping from HTML to AI, Early web crawlers and search engines, Rise of automated web data collection, Evolution of web data extraction, Web scraping and competitive advantage, Web scraping software history, History of web scraping tools, Future trends in web scraping technology, Timeline of web scraping development, Visual web scrapers for non-programmers
Web scraping is becoming a more widely known term. Most associate it with web data extraction, the most efficient and simplest way of copying large chunks of information online; however, did you know that web scraping was born for a completely different purpose, and it took almost two decades for it to transform into the web scraping we are familiar with now?
April 30, 2021
Data quality settings for web scraping, Web Scraper Cloud data quality control, Automated scraping job notifications, Web Scraper Cloud data validation, Scraping job performance tracking, Cloud-based scraping job management, Improve web scraping reliability, Web Scraper Cloud job monitoring tools, Real-time scraping error notifications, Automated web scraping alerts
With a constant development process and continuous growth, we are happy to have released a new notification system as well as a data quality feature to allow further automation optionality.
March 15, 2021
Legal aspects of web scraping, How to gather data from websites, Web scraping for business intelligence, Web scraping tools for beginners, Types of web scrapers explained, Automate data collection from websites, Cloud-based web scraping solutions, Browser extension web scrapers, What is web scraping and how it works, Web data extraction software
It is no lie that data is power in many ways. For different reasons and applications, different information available online can be used to gain an advantage in various spheres of life, especially in business.
February 17, 2021
Web Scraper Shopify CSV import, Scraping product listings for Shopify, Import scraped products to Shopify, Automate Shopify product uploads, E-commerce product data extraction, Shopify product migration from CSV, Shopify CSV product import tutorial, Efficient product data management Shopify, Scrape Amazon product data for Shopify, Automate dropshipping product updates
Nowadays, with almost everything being available online, many are looking for ways to start a new eCommerce business or automate an existing one.
Imagine a fast track to improve the efficiency of your new, already existing online store. CSV export from Web Scraper and import to Shopify can get you updating your product lists in only a few minutes.
November 24, 2020
Cloud Scraper API integration, Webhooks for scraping notifications, Clean and transform scraped data, Parser for data transformation, Scheduler for automated scraping, Maintain large web scraping projects, Automate web scraping tasks, Web Scraper Cloud data extraction, Community sitemaps for e-commerce, Data quality control web scraping
Data nowadays can be the driving fuel of a company. With the huge increase in technology and data, it has become more important than ever to retrieve, transform, and store that data correctly and effectively.
November 06, 2020
Scrape product pages Web Scraper, Web Scraper data extraction, CSS selector for scraping, Custom CSS selectors Web Scraper, CSS selector element selection, Advanced CSS selectors for web scraping, Attribute-based CSS selector, Web Scraper CSS selectors, CSS selectors text extraction
Scraping might get hard at times when you're dealing with website structures that frequently change or in general, are hard to scrape with just the point-and-click interface. No need to stress, with the knowledge of the CSS selector, any website structure can be overcome and any website - scraped. Here are the TOP 5 CSS selectors that we frequently use and might be of great use to you.
September 29, 2020
Web Scraper e-commerce scraping tips with sitemap.xml, Web Scraper sitemap.xml tutorial for e-commerce, Scraping e-commerce websites with sitemap.xml, Fastest way to extract e-commerce data Web Scraper, How to scrape product data using sitemap.xml, Create sitemap.xml links selector Web Scraper, Web Scraper element selectors for product pages, Guide to sitemap.xml data extraction for online stores, Collect product data quickly using sitemap.xml Web Scraper
In the previous blogs, we have gone through the classical way of scraping and exposed a tip of how to potentially prevent sitemaps from breaking when an e-commerce site changes product placements in designated categories. Now we are going to take a look at another scraping method, which is - scraping with the “Sitemap.xml Links” selector.
September 24, 2020
Web Scraper tutorial for e-commerce sites, Extract product titles and prices from websites, Web Scraper text selectors for product information, Step-by-step guide to e-commerce data scraping, Collect product data from dynamic e-commerce pages, Web Scraper best practices for reliable scraping, Web Scraper pagination setup for online stores, Data extraction from e-commerce websites with Web Scraper, Web Scraper sitemap creation for online shop data, How to scrape product data with Web Scraper
In the previous blog, we explained how to retrieve the necessary data the classical way by going through the categories, sub-categories, then the products, etc. It is the most primitive and intuitive way of gathering data with the Web Scraper extension; however, sometimes a problem arises when the website layout is changed or the placement of various products is altered. For this reason. Previously created sitemaps for that specific website may break or stop working properly.
September 16, 2020
Cleaning scraped e-commerce data with Web Scraper, Pagination selector Web Scraper tutorial, Web Scraper extract product titles and details, How to create selectors Web Scraper, Classical method e-commerce web scraping, How to scrape product categories with Web Scraper, E-commerce product data extraction Web Scraper, Web Scraper parser feature for data transformation, Web Scraper sitemap creation tutorial
With the enormous growth and development in technology, data being the main driver of modern and fast-growing companies, the online business has evolved over recent years. However, it comes as no surprise since ordering, reserving goods, and services online, while not leaving the house, is a huge time saver and accessible for everyone with a stable internet connection.
August 27, 2020
Fix misspelled data OpenRefine, Merge CSV files OpenRefine, Web scraped data cleaning, Remove special characters OpenRefine, Data enrichment OpenRefine, Transform numeric columns OpenRefine, Add new column OpenRefine, GREL formulas OpenRefine, OpenRefine data manipulation, Clustering similar entries OpenRefine
With cleaner data, we can begin to transform it. Data transformation can manifest in different forms. It can be clustering, merging, adding information, replacing strings, and so on. OpenRefine covers them all.
August 21, 2020
Page load detection, Web data automation, Data extraction tool, Web scraping automation, Automated data collection, Browser data scraper, Web Scraper SaaS, Web scraping software, Scraper extension, Scraping software
We are happy to announce that Web Scraper 0.5.0 has been released! This release contains new features such as a new data selection UI engine, a new page load detection system, a welcome page, and a whole lot more!
August 14, 2020
Data preprocessing for analysis, Delete duplicate rows OpenRefine, Filter and group data OpenRefine, Clean large datasets, Data transformation tool, Remove blank entries OpenRefine, Web scraping data filtering OpenRefine, Undo redo OpenRefine feature, Big data cleaning OpenRefine, OpenRefine tutorial, OpenRefine data cleaning
Data transformation is a step for preparing data sets for AI training and analysis. Clean and transformed data is a vital part of precise and correct data reports and analysis. In this blog series part, we will look at what importance it is to detecting and deleting blank, inconsistent and duplicate data entries.
July 28, 2020
Data analysis preparation, Open-source data software, Data cleaning tool, Transform and enrich data, Data preprocessing tool, Free data transformation tool, Clean data with OpenRefine, Merge and deduplicate data, Big data cleaning software, OpenRefine data transformation
As the saying goes, “garbage in, garbage out”. This can be associated with the idea of data analysis without data transformation beforehand. With bad, messy data, only lousy, chaotic analysis can be done. However, with data transformation, not only does the process of analysis become easier, but the precision also increases.
July 06, 2020
Data preprocessing for analysis, Data transformation software, Data integration solutions, Cloud data processing, Automate data preparation, Data cleansing software, Scraped data transformation, Clean and prepare data, Transform unstructured data, Data transformation tools
Have you ever been in a situation where you have two or more data sets of completely different structures? So different that it is impossible to analyse, manage, or integrate. It sounds like every professional’s worst nightmare.
June 05, 2020
Automated data extraction, Research data collection, Web scraper services, Data extraction services, Collect data online, Web scraping collaboration, Journalist data support, Scraping for journalists, Data retrieval for projects, Custom web scraping
If you are a journalist or a data enthusiast and you are in need of data, look no further. We, Web Scraper, offer a collaboration.
May 29, 2020
Lead generation software, Data extraction tool, Competitor price monitoring, Market research tool, Collect business data online, Web scraping software, Automated web scraper, Sentiment analysis from reviews, Product optimization insights, Business data collection
Nowadays, with increasing digitalisation, where new technologies are constantly arising and computational power is available almost to everyone, the necessity for data has escalated drastically.
May 12, 2020
Industry data insights, Big Data analytics, Predictive analytics, Big Data in healthcare, Applications of Big Data, Data-driven decision making, Big Data technology, Human behavior data analysis, Big Data for COVID-19, Big Data in sports
Enormous amounts of data that traditional data-processing application software is not capable of dealing with, which is used for analysing to reveal trends, patterns, and associations of especially human behaviour and interactions. The subject of Big Data and its usage has increased significantly over recent years. With the immense development of technology and the large sets of data that are processed every day, the question of how to take advantage of it is on everyone’s mind, regardless of the industry.
April 29, 2020
Google Data Studio for beginners, Business intelligence software, Create dashboards for business, Data reporting and analytics, Interactive data visualization, Google Data Studio dashboards, Visualize spreadsheet data, Track key performance indicators, Visualize data online, Data visualization tools
As possibly one of the wisest investments in big data, data visualisation can be a crucial tool for any business. With the continuous advancements in technology and the huge increase in the necessity for big data, visual representation of it can display and showcase many factors of a business that would have been hard to do without data visualisation. In this blog, we are gonna explore ways of data representation with the help of a highly easy and versatile tool.
April 08, 2020
Trending searches during pandemic, Coronavirus search trends, Online trends analysis, Pandemic online behavior, COVID-19 search patterns, COVID-19 consumer behavior, Coronavirus impact on searches, COVID-19 data analysis, COVID-19 Google trends, Google search insights
Of everything going on, we took an interest in what people are most searching for on the Google search engine during the coronavirus outbreak.
March 09, 2020
Sports Arbitrage Betting, Guaranteed profit betting, Calculate arbitrage bets, Bookmaker odds analysis, Betting odds comparison, Web scraping for sports odds, Data-driven sports betting, How to find arbitrage betting, Arbitrage opportunities, Arbitrage betting strategy
Imagine a scenario where you invest an amount of money and there is a guaranteed profit! Hard? Impossible? Not at all! Let us provide you with a mathematically proven strategy, which, when applied correctly, actually provides such possibilities.
February 03, 2020
Analyze data in Google Sheets, Sort and filter spreadsheet data, Access big data in sheets, Spreadsheet data analysis, Google Sheets SQL function, Google Sheets QUERY function, Filter spreadsheet data, Query data across spreadsheets, Summarize data in Google Sheets, Aggregate spreadsheet data
Imagine learning a function which can work as various other functions; therefore, replacing them with only one and making working with big data easier. With the query function of Google Sheets, that scenario is not that absurd because it provides exactly what is described. Accessing, summarising, and filtering data from various spreadsheets with only one function - thanks to Google Sheets, the opportunity to do exactly that has been around for quite some time already.
December 23, 2019
Clean scraped data, Simplify data analysis, Process scraped data online, Data post-processing tool, Data extraction and cleaning, Transform scraped data, Web scraping software, Automated web scraper, Scraped data cleaning tool, Web Scraper Cloud parser
We are happy to finally introduce a Parser feature for Web Scraper Cloud.
Usually, to post-process data, a custom-written script or extra time editing the data manually in a spreadsheet software would be the case; however, the Parser takes care of and eases this process.
September 02, 2019
Data extraction tool, Extract addresses and phone numbers, Restaurant data extraction, Web scraping software, Web scraper Chrome extension, Automated web scraper, Find restaurant contact information, Scrape restaurant information online, Yellow Pages data scraper, Scrape business listings
Have you ever planned a trip to a different state, city or even a country but did not know any places to have a delicious dinner at? We all know that Yellow Pages is the go-to site if we want to find restaurants in specific areas, but it can often be frustrating to get bogged up with endless pages on it. Luckily, Web Scraper is here to solve this by allowing you to extract all the information you need from Yellow Pages. So you can enjoy great meals during your trip.
April 17, 2019
Website data scraping service, Data extraction tool, Web scraper for business, Web scraping software, Automated web scraper, Scrape product information online, E-commerce data scraper, Cloud-based web scraping, Bulk data extraction tool, Product price scraper
We are happy to announce that Web Scraper 0.4.0 has been released. This release contains a new selector, updates to other selectors and an improved CSS selector generator. Starting from version 0.4.0, Web Scraper is also available in Firefox.
