Extract data when URL doesn't change?


#1

I have a situation wherein I need to extract data from multiple pages, but the URL doesn’t change when proceeding from one page to the next, so I’m not clear on how to enter unique URLs into the tool to extract data past page 1.

e.g.

Page 1 results URL: domain.com/data
Page 2 results URL: domain.com/data
etc…

Any suggestions?


#2

There are few ways, but i’m not sure how to help without enough information.

There is a URL Generator, which helps you generate url for different pages. What is the site/url that you are trying to scrap?


#3

There is a section on this in the User Guide: https://guide.import.io/dealing-with-infinite-scroll.html

It shows you how to deal with this is a couple of different ways.