Tool to Verify Site URLs/SiteMap?

Posted by LockeCJ on Stack Overflow See other posts from Stack Overflow or by LockeCJ
Published on 2010-06-03T21:08:26Z Indexed on 2010/06/07 11:12 UTC
Read the original article Hit count: 300

Filed under:

seo

|

url-rewriting

|

wget

I'm moving a site from one e-commerce software to another, and I've created URL Rewriter rules to do 301 redirects from the Old URLs to the new ones. I've tested them with a small sample of URLs, but I'm looking for some sort of tool that will let me test as many of the URLs as possible. Does anyone know of a tool that I can feed a list of URLs (or a sitemap.xml). This tool will attempt to retrieve each URL, and then report the status code for each. The result should be a list of URLs with the status code, something like this:

www.site.com/oldurlformat1/ 301 Permanently Moved

www.site.com/newurlformat1/ 200 OK

www.site.com/oldurlformat2/ 301 Permanently Moved

www.site.com/newurlformat2/ 200 OK

I can almost do this with wget, but getting the summary/report at the end is where I'm stuck.

© Stack Overflow or respective owner

Related posts about seo

Do i need a full time seo employee? [closed]

as seen on Pro Webmasters - Search for 'Pro Webmasters'
I need seo done for 1 site that's still new. It's a niche listings/ecommerce site. And i need to make a hiring decision for this - whether there's a need for a full time employee dedicated to seo or is part time or a contract sufficient? Here's some info and assumptions : 1)The site's dynamic -… >>> More
1 SEO Article Vs 5 SEO Articles?

as seen on Ezine Articles - Search for 'Ezine Articles'
You've probably clicked on this article because you think it's a interesting article but the answer seems very easy or straight forward. If you think 5 SEO articles wins or is more beneficial to your business, then your like me. >>> More
SEO Training OR SEO Outsourcing

as seen on Ezine Articles - Search for 'Ezine Articles'
There is a lot of focus on outsourcing search optimization work, but this may not always be the best option. This article looks at why SEO Training can often be a better option because it results in more unique content which is better for search engines. >>> More
The Chinese SEO in the Internet SEO Formula

as seen on Ezine Articles - Search for 'Ezine Articles'
Most ecommerce websites are designed in order to drive the Chinese internet users to the website thus delivering a good user experience that converts the users into customers. According to a statistical report on the internet development in China, conducted during the year 2009, the Chinese SEO of… >>> More
Get Professional SEO Service From SEO Experts

as seen on Ezine Articles - Search for 'Ezine Articles'
SEO service is imperative to online business. Business today has gone digital. With its power to perform international promotion, almost every brand is on a bid to establish an online presence. However, it's not easy to gain online presence without proper SEO service. >>> More

Related posts about url-rewriting

Domain name rewriting and URL rewriting in the meantime in .htaccess

as seen on Server Fault - Search for 'Server Fault'
Ugly URLs: www.domainname.com/en/piece/piece.php?piece_id=1 www.domainname.com/en/piece/piece.php?piece_id=2 www.domainname.com/en/piece/piece.php?piece_id=3 ... Friendly URLs: piece.domainname.com/en/1 piece.domainname.com/en/2 piece.domainname.com/en/3 ... I want to present website users… >>> More
URL rewriting in .htaccess

as seen on Server Fault - Search for 'Server Fault'
Ugly URLs: www.domainname.com/en/piece/piece.php?piece_id=1 www.domainname.com/en/piece/piece.php?piece_id=2 www.domainname.com/en/piece/piece.php?piece_id=3 ... Friendly URLs: piece.domainname.com/en/1 piece.domainname.com/en/2 piece.domainname.com/en/3 ... I want to present website users only friendly… >>> More
ASP.NET MVC without Url Rewriting/Pretty Url

as seen on Stack Overflow - Search for 'Stack Overflow'
Hi, I have hosting with IXWebHosting, but ISAPI_Rewrite is not enabled on their Windows Server. So I want to deploy my site without Url Rewriting/Pretty Url. Is it possible? Thanks in advance, Munim >>> More
URL rewriting with mod_rewrite

as seen on Stack Overflow - Search for 'Stack Overflow'
The web server is Apache. I want to rewrite URL so a user won't know the actual directory. For example: The original URL: www.mydomainname.com/en/piecework/piecework.php?piecework_id=11 Expected URL: piecework.mydomainname.com/en/11 I added the following statements in .htaccess: RewriteCond… >>> More
Urlrewriting.net pages are not causing postbacks

as seen on Stack Overflow - Search for 'Stack Overflow'
I'm using webforms with UrlRewriting.Net to rewrite pages, e.g. http://www.example.com/stuff.aspx?c=30 becomes http://www.example.com/stuff/30-this-stuff.aspx. It works in so far as the correct content is loading; however, none of the postbacks are working (mostly buttons on the page)… >>> More