Ping and crawling not working, site still resolving
- by Andrew Alexander
Ok, so we're trying to figure out why the site of one of our clients isn't being crawled by Google (we've ruled out robots.txt or meta tags)
When we go to the site, either IP address or domain name, the site resolves, everything works.
However, Google is getting a 302 redirect (which it apparently isn't following for crawling), and when we ping the address, it times out (note, the site is still resolving in the browser throughout all of this).
The site is built in ASP.Net (I assume C#) and so my thoughts were that it was an errant redirect rule, or some other sort of server side issue. We also thought that it might be due to incorrect domain pointing (but if we try to ping the IP, it doesn't work, so that sorta rules that out).
We're really not sure what is causing all of these errors, or even if they have one single source.
Anyone have any ideas what could be going on? Do you need any more information?
To boil it down in a TL; dr:
* Site resolving in browser, both IP and domain name. No problems here.
* Site not being crawled by Google (gets a 302 it doesn't seem to follow) - it is not due to robots.txt or meta tags
* Ping is not working for the IP address. This is very odd, because again, the IP address seems to work fine in the browser.
* Our thoughts are either redirect rule issue, domain pointing issue, or possibly some errant code - or some combination of the three
