Is it possible that a crawler IP gets banned by a site?


#1

Things were working nicely but I think the site didn’t appreciate going through multiple pages on their site.


#2

That’s normal behavior, you need to use an IP Rotator to overcome this.