Managing 404 error pages with noindex and url rewrite

Posted by ZenMaster on Pro Webmasters See other posts from Pro Webmasters or by ZenMaster
Published on 2012-06-30T15:58:27Z Indexed on 2012/06/30 21:25 UTC
Read the original article Hit count: 439

Filed under:

url-rewriting

|

404

|

google-index

|

noindex

Currently I use custom 404 error pages, having the following meta on them :

<meta content="noindex" name="robots">

My guess is this way Google will remove deleted pages faster from the index, anyone has experienced a case where it does ?

Also, is it better to have the url path rewritten to the actual error page, like the url pattern: http://{mysite}/{404_error_page} or is it best to keep the old deleted page's url when serving a 404 error ?

© Pro Webmasters or respective owner

Related posts about url-rewriting

Domain name rewriting and URL rewriting in the meantime in .htaccess

as seen on Server Fault - Search for 'Server Fault'
Ugly URLs: www.domainname.com/en/piece/piece.php?piece_id=1 www.domainname.com/en/piece/piece.php?piece_id=2 www.domainname.com/en/piece/piece.php?piece_id=3 ... Friendly URLs: piece.domainname.com/en/1 piece.domainname.com/en/2 piece.domainname.com/en/3 ... I want to present website users… >>> More
URL rewriting in .htaccess

as seen on Server Fault - Search for 'Server Fault'
Ugly URLs: www.domainname.com/en/piece/piece.php?piece_id=1 www.domainname.com/en/piece/piece.php?piece_id=2 www.domainname.com/en/piece/piece.php?piece_id=3 ... Friendly URLs: piece.domainname.com/en/1 piece.domainname.com/en/2 piece.domainname.com/en/3 ... I want to present website users only friendly… >>> More
ASP.NET MVC without Url Rewriting/Pretty Url

as seen on Stack Overflow - Search for 'Stack Overflow'
Hi, I have hosting with IXWebHosting, but ISAPI_Rewrite is not enabled on their Windows Server. So I want to deploy my site without Url Rewriting/Pretty Url. Is it possible? Thanks in advance, Munim >>> More
URL rewriting with mod_rewrite

as seen on Stack Overflow - Search for 'Stack Overflow'
The web server is Apache. I want to rewrite URL so a user won't know the actual directory. For example: The original URL: www.mydomainname.com/en/piecework/piecework.php?piecework_id=11 Expected URL: piecework.mydomainname.com/en/11 I added the following statements in .htaccess: RewriteCond… >>> More
Urlrewriting.net pages are not causing postbacks

as seen on Stack Overflow - Search for 'Stack Overflow'
I'm using webforms with UrlRewriting.Net to rewrite pages, e.g. http://www.example.com/stuff.aspx?c=30 becomes http://www.example.com/stuff/30-this-stuff.aspx. It works in so far as the correct content is loading; however, none of the postbacks are working (mostly buttons on the page)… >>> More

Related posts about 404

ubuntu/apt-get update said "Failed to Fetch http:// .... 404 not found"

as seen on Server Fault - Search for 'Server Fault'
Hi all, I'm trying to run apt-get update on ubuntu 9.10 I've configured my proxy server and I can access the internet without any problem: /etc/apt# wget "http://www.google.com" Resolving (...) Proxy request sent, awaiting response... 200 OK Length: 292 [text/html] Saving to: `index.html' 100%[=================================================================================================================================>]… >>> More
Cannot update, apt-get cannot fetch index files

as seen on Ask Ubuntu - Search for 'Ask Ubuntu'
I have a fresh install of Ubuntu 11.10 from the iso 'ubuntu-11.10-desktop-amd64.iso'. I installed this in VMWare Fusion 4.1.1 running on OSX 10.7.3. When setting up the VM, I allowed easy install to take care of creating my user and installing VMWare tools. No problems during installation, everything… >>> More
Protecting Apache with Fail2Ban

as seen on Pro Webmasters - Search for 'Pro Webmasters'
Having checked my Apache logs for the last two days I have noticed several attempts to access URLs such as /phpmyadmin, /phpldapadmin: 121.14.241.135 - - [09/Jun/2012:04:37:35 +0100] "GET /w00tw00t.at.blackhats.romanian.anti-sec:) HTTP/1.1" 404 415 "-" "ZmEu" 121.14.241.135 - - [09/Jun/2012:04:37:35… >>> More
Django flatpages raising 404 when DEBUG is False (404 and 500 templates exist)

as seen on Stack Overflow - Search for 'Stack Overflow'
I'm using Django 1.1.1 stable. When DEBUG is set to True Django flatpages works correctly; when DEBUG is False every flatpage I try to access raises a custom 404 error (my error template is obviously working correctly). Searching around on the internet suggests creating 404 and 500 templates which… >>> More
x.gif in Apache logs

as seen on Server Fault - Search for 'Server Fault'
I manage a Django site where we host the media on a subdomain. There shouldn't be any requests for media to the main domain. However I keep seeing these requests for "x.gif" showing up in the access logs on the domain that's handled by WSGI (not the media domain). Can anyone explain what this is… >>> More