Google Bot trying to access my web app's sitemap
- by geekrutherford
Interesting find today...
I was perusing the event log on our web server today for any unexpected ASP.NET exceptions/errors. Found the following:
Exception information:
Exception type: HttpException
Exception message: Path '/builder/builder.sitemap' is forbidden.
Request information:
Request URL: https://www.bondwave.com:443/builder/builder.sitemap
Request path: /builder/builder.sitemap
User host address: 66.249.71.247
User:
Is authenticated: False
Authentication Type:
Thread account name: NT AUTHORITY\NETWORK SERVICE
At first I thought this was maybe an attempt by a hacker to mess with the sitemap. Using a handy web site (www.network-tools.com) I did a lookup on the IP address and found it was a Google bot trying to crawl the application. In this case, I would expect an exception or 403 since the site requires authentication anyway.
