Why can't GoogleBot forget a 404 File Does Not Exist?
- by Sam
Hi folks,
For two months now, googlebot is trying to get a file which does not exist anymore. This is just one example out of many: I had renamed the file to a better name and removed the old file. Now, why does Google insist on getting a file which it already has seen does not exist for months? doesn't it just give up and get on being a happy bot?
My Error log file is filled with these repeating lines all wanting to get that one file, although they know for already long time that its not there:
What to do in these situations?
Are there automatic redirection rules that handle via 301 to the home page?
[Sat Mar 05 01:55:41 2011] [error] [client 66.249.66.177] File does not exist:
/var/www/vhosts/website.org/httpdocs/extraNeus.php
[Sat Mar 05 01:58:20 2011] [error] [client 66.249.66.177] File does not exist:
/var/www/vhosts/website.org/httpdocs/extraNeus.php
[Sat Mar 05 02:03:57 2011] [error] [client 66.249.66.177] File does not exist:
/var/www/vhosts/website.org/httpdocs/extraNeus.php
on and on ... and on...
