Can I scrape a website with pagination?

Yes, you can scrape a website with pagination using ImportFromWeb as long as the URL structure changes for each page.

For instance, let’s consider the example of scraping Amazon search results. The page number of the search results appears as a parameter in the URL (https://www.amazon.com/s?k=laptop&page=2&ref=sr_pg_2). Thus, you can build a sample of 10, 20,… search page URLs.

Then, to extract data from, let’s say 10 pages of Amazon search results, you would set up the formula like this:

=IMPORTFROMWEB(A1:A11, "asin,title,price")


In this example, A1:A11 contains the 10 Amazon search URLs, and the data selectors are specified to extract the desired information.