Blog
November 27, 2023
Web Scraper UI improvements, Web Scraper extension update, Enhanced Link Selector feature, HTML code on hover, Page load scraping fix, Scrape non-HTML links, Faster data extraction Chrome, Web Scraper user experience update, Refactored scraping extension, Selector deletion confirmation popup
We're thrilled to share the latest enhancements in our extension to make your experience even smoother. Check out the new features and improvements in our latest release:
July 07, 2023
Chrome MV3 compatibility update, Improved mouse click simulation, Web Scraper latest update, Web Scraper extension feature release, New Link Selector feature, Extract links from attributes, Sitemap deletion confirmation, Pop-up Link Selector removal, Scrape text-based links
Hey there! We've got some major news to share with you that will up your scraping game. We're thrilled to introduce the latest and greatest version of Web Scraper. Take your experience to a new level with the newly updated Link Selector and more.
May 10, 2023
Selector execution order control, Web Scraper CSS selector optimization, Chrome Manifest V3 update, Web Scraper extension updates, Web Scraper feature release, PouchDB to local storage migration, Latest Web Scraper extension updates, Automated CSS selector restructuring, Web Scraper validation engine update, Improve web scraper speed
It's time for our latest feature release article, and we can't wait to show you what we've been working on!
September 09, 2022
Web Scraper shadow-root support, Web Scraper element scroll selector, Web Scraper release notes, Web Scraper 0.6.5 update, Web Scraper data export improvements, Web Scraper bug fixes, Firefox sitemap sync Web Scraper, Web Scraper UTF-8 text handling, Web Scraper performance optimizations, Web Scraper new features
For the last few months, we have been working towards the Web Scraper 0.6.5 release, and finally, it is here!
June 28, 2022
DOM element selection techniques, Isolating specific page elements for scraping, CSS selectors for web scraping, Web Scraper Chrome tool selector guide, :contains() and :has() jQuery selectors, Attribute-based CSS selectors, Advanced element targeting for scraping, Chaining CSS and jQuery selectors, nth-child and nth-of-type selectors, jQuery selectors for data extraction
Selectors, when it comes to CSS and jQuery, refer to code you can use to interact with specific elements in the DOM. They are particularly useful when you want to style or act upon certain elements of the document without altering other elements. Through a careful use of selectors, you can manipulate a page exactly as intended or isolate the specific data you’re looking to scrape.
May 02, 2022
Average price calculation in Athena, Analyze web scraping data in AWS, Web scraping data analysis with Athena, AWS data querying and processing, Amazon Athena SQL queries, Web Scraper Cloud data insights, Sync scraping results to Amazon S3, Query JSON data with Athena, Create Athena table from S3 JSON, Web Scraper Cloud S3 integration
Amazon Athena lets you use SQL to interactively query any data you have within an Amazon S3 Bucket. With Web Scraper Cloud, you can automatically sync web scraping job results to an Amazon S3 Bucket where you can then use Athena to quickly query this data with little additional overhead. In this article, we’re going to guide you through syncing Web Scraper Cloud with an S3 bucket and using Athena to generate and perform calculations on table data. While we’re covering a specific use case, you can adapt this same process to any other data set to gather insights.
March 21, 2022
Extract HTML elements with Cheerio, Parse web page content in Node.js, Headless scraper setup tutorial, Web scraping with Axios and Cheerio, JavaScript web scraping techniques, Axios HTTP requests for web scraping, Automated data extraction using Cheerio, Spoof browser headers for scraping, Cheerio Node.js web scraping, Scrape dynamic pages without a browser
Cheerio is a node package that allows you to easily parse and extract elements from markup. Unlike a browser, Cheerio doesn’t produce a visual rendering, load external resources, execute JavaScript code, or apply CSS. As a result, it’s much faster than other solutions when it comes to scraping web pages for valuable data.
In this article, we’re going to specifically cover how to set up a headless scraper with Cheerio and spoof browser headers to access a wider range of web pages.
March 03, 2022
Legal web scraping GDPR compliance, Lawful data processing for scraping public data, Compliance tips for automated data extraction, Facebook vs BrandTotal web scraping lawsuit, HiQ vs LinkedIn web scraping case analysis, Scraping publicly available data lawfully, Platform Terms and Conditions web scraping, Scraping emails and phone numbers legally, GDPR guidelines for data scraping, Data minimisation principle for web scraping
We’ve all been hearing about the ongoing cases of companies failing lawsuits against web scraping activities. Worth mentioning are the cases of LinkedIn vs. HiQ on public data scraping and the case of Facebook Inc. vs. BrandTotal Ltd. on scraping data from Facebook. What is more interesting is that in one case it was ruled in favour of the data scraper, but in the other - of the company whose platform is being scraped. Seeing such cases with different outcomes raises questions, especially due to the recent General Data Protection Regulation (GDPR), on how lawful web scraping of publicly available data actually is?
September 01, 2021
Web Scraper extension new features update, Automatized element attribute selector Web Scraper, Syncing local and cloud sitemaps automatically, Cloud synchronization for Web Scraper sitemaps, Web Scraper sitemap search bar functionality, Web Scraper pagination selector guide, Data preview and element count in Web Scraper, How to create pagination in Web Scraper, Inspecting and validating selectors Web Scraper, Web Scraper additional data preview feature
The moment has come that we are ready to release the most requested feature of all time! Creating pagination correctly has been one of the most frequently reported problems; however, that is about to change. The pagination selector is here, and so are other additional updates that will make scraping with Web Scraper easier.
August 02, 2021
Web scraping applications in data science, Web scraping for e-commerce product data, Web scraping meaning and definition, How web scraping works step by step, Web scraping for lead generation and research, Uses of web scraping in business and marketing, Legal considerations for web scraping, Detecting web scraping activity on websites, Which websites allow web scraping, Making money with web scraping data
For discovery and greater understanding, questions are a must. Therefore, we have collected the most frequently asked questions by the public about different web scraping topics.
June 14, 2021
Automated data export to Google Sheets, Visualize scraped data in Google Sheets, How to append Web Scraper data to Google Sheets, Automatic updating of scraped data in spreadsheets, Google Append feature for cloud data export, Scheduler-enabled Google Sheets export for automation, Create dynamic charts from Web Scraper data, Export and visualize cryptocurrency data automatically, Streamline data visualization with automated Google Sheets, Google Sheets integration for Web Scraper Cloud
Most people could agree that observing a picture, a simple graph, or a pie chart is easier and more efficient than scrolling through blocks of text or trying to parse out useful insights from looking at numerous columns in a spreadsheet. This common knowledge is the basis of why visualisation is so important.
Also, in a rapidly changing world, people seek ways of becoming more efficient, ways of increasing the time spent focusing on the insights, rather than pouring endless hours and effort into collecting the necessary assets to gain those end results that determine so much. This is why automation nowadays is a key topic.
June 01, 2021
Customer review data extraction techniques, Improving business decisions with review data, How to monitor online reviews effectively, Web scraping customer reviews for market research, Sentiment analysis of product reviews, Automating customer review collection online, Customer review analysis for business insights, Using customer feedback for product development, Competitive analysis using customer reviews, Gathering online reviews for social proof
Just like a vehicle tire leaves an imprint in the mud, which can be washed away only by a great storm or rainfall, an impression leaves an impact on a product, which then becomes the formatting foundation of an opinion that can not be altered easily. For this simple reason, creating an interesting, positive, and captivating impression on your customers will go a long way toward your business's success and overall reputation.
May 14, 2021
Web scraping from HTML to AI, Early web crawlers and search engines, Rise of automated web data collection, Evolution of web data extraction, Web scraping and competitive advantage, Web scraping software history, History of web scraping tools, Future trends in web scraping technology, Timeline of web scraping development, Visual web scrapers for non-programmers
Web scraping is becoming a more widely known term. Most associate it with web data extraction, the most efficient and simplest way of copying large chunks of information online; however, did you know that web scraping was born for a completely different purpose, and it took almost two decades for it to transform into the web scraping we are familiar with now?
April 30, 2021
Data quality settings for web scraping, Web Scraper Cloud data quality control, Automated scraping job notifications, Web Scraper Cloud data validation, Scraping job performance tracking, Cloud-based scraping job management, Improve web scraping reliability, Web Scraper Cloud job monitoring tools, Real-time scraping error notifications, Automated web scraping alerts
With a constant development process and continuous growth, we are happy to have released a new notification system as well as a data quality feature to allow further automation optionality.
March 15, 2021
Legal aspects of web scraping, How to gather data from websites, Web scraping for business intelligence, Web scraping tools for beginners, Types of web scrapers explained, Automate data collection from websites, Cloud-based web scraping solutions, Browser extension web scrapers, What is web scraping and how it works, Web data extraction software
It is no lie that data is power in many ways. For different reasons and applications, different information available online can be used to gain an advantage in various spheres of life, especially in business.