How to scrape user's data without being banned by the server?
- by embedded
I'm developing a site which monitors user's date.
It uses the cURL over PHP.
It first gets authorized using cookie and then parses the required data.
My problem is that it needs to fire multiple requests to the server (for all registered users) and this may
Get me banned by the remote server.
I would like to know if there is something I could do to prevent being banned.
(This activity is legal - the users have provided their login information)
Thanks