How can I crawl just the Pet Supplies section of Amazon?


#1

I have set up a crawler, to get the title and price information of items on Amazon UK

In the ‘Where to crawl?’ field, I have removed:


and replaced it with:

but when I run the crawler, it doesn’t return any results.

What I am doing wrong?


#2

I will not be surprised if amazon are actively stopping this from happening depending upon ip address and various other factors.

Depending upon your usecase this data is available via amazon product API.

I hope this helps.


#3

Okay, I’ll see what can be done via the API. Thanks.