Web Scraping to Google Sheets

Easily Web Scrape website to Google Sheets. Pull website data to your selected spreadsheet cell!

KPIBees Gsuite Google Add-on install: https://gsuite.google.com/marketplace/app/kpibees/623897559595

Open any spreadsheet and go to the Add-ons menu. Then launch KPIBees.

Select the Web Scraper connector.

There are 3 types of strategies that you can use to pull data from a website to Google Sheets. We'll do an example for each one!

In the first example, we will illustrate how to fetch a HTML table from a webpage.

Let's say we want to get this table with the oldest people that ever lived! https://en.wikipedia.org/wiki/Oldest_people

Add the url of the page that we want to fetch. We will select to fetch the first table from the page.

Here it is! The output of the query was pulled to the selected spreadsheet cell!

Using this input, we can select which table to retrieve from the page, in the order of occurrence!

All Data Retrieval strategies have an Advanced parameters section.

Using this section you can narrow the data pulling using an XPath, add login for the pages that need authentication, or even wait for the page to fully load longer then the set 5 seconds before scraping start.

The Extended Cleaning flag removes parts of the page that don't seem to be important for the Scrapping (such as Footers or Headers).

Let's try another retrieval strategy. The "Get Text Content" strategy is extremely precise. It will always retrieve the content identified through a XPath.

The final Data Retrieval strategy that we will show is a smart algorithm that attempts to figure out the elements of the page which should be retrieved.

A lot of times it will manage to figure out on its own the most important parts of your page.

Other times, it needs a little help, so you need to provide an XPath.

If you're stumbling, comment below and we will do our best to help!