How to scrap data from a webpage with INFINITE scroll and closed API?
Same here, there are many such sites like twitter where the data is huge but the extractor gets only the top results in the run.
In the normal help sections theres an explanation that is quite elaborate:
I hope this helps!
Thanks Leadgen, unable to find the pagenum with twitter:(
Can you post the site you are trying to scrape so I can take a look at it?