Software for building a sitemap.

Posted by UXdesigner on Stack Overflow See other posts from Stack Overflow or by UXdesigner
Published on 2010-04-14T21:12:49Z Indexed on 2010/04/14 21:13 UTC
Read the original article Hit count: 315

Filed under:

sitemap

|

sitemaps

|

software

|

application

|

UX

If I had to create a content inventory for a website that doesn't have a sitemap, and I do not have access to modify the website, but the site is very large. How can I build a sitemap out of that website without having to browse it entirely ? I tried with Visio's sitemap builder, but it fails great time. Let's say for example: I Want to create a sitemap of Stackoverflow. Do you guys know a software to build it ?

© Stack Overflow or respective owner

Related posts about sitemap

problem with Webmaster Google Sitemap

as seen on Pro Webmasters - Search for 'Pro Webmasters'
I have a wp mu 3.6.1 with domain mapping (0.5.4.3) with w3tc (0.9.3) and Google XML Sitemaps (4.0 BETA). I have 4 different sitemaps. sub-1.com/sitemap.xml sub-2.com/sitemap.xml sub-3.com/sitemap.xml sub-4.com/sitemap.xml on google webmaster i got 59 errors & 14 warnings. Sitemap errorsErrors: We… >>> More
The Sitemap Paradox

as seen on Pro Webmasters - Search for 'Pro Webmasters'
We use a sitemap on Stack Overflow, but I have mixed feelings about it. Web crawlers usually discover pages from links within the site and from other sites. Sitemaps supplement this data to allow crawlers that support Sitemaps to pick up all URLs in the Sitemap and learn about those URLs using… >>> More
Sitemaps - do I need to submit each sitemap in sitemap_index.xml to Google Webmaster tools?

as seen on Pro Webmasters - Search for 'Pro Webmasters'
I am having a Wordpress blog on my CentOS server. There is no sitemap.xml in the root directory but there is sitemap_index.xml file in the root directory which contains the following code: <?xml-stylesheet type="text/xsl" href="http://mywebsite.com/wp-content/plugins/wordpress-seo/css/xml-sitemap-xsl… >>> More
Yahoo sitemap validation

as seen on Pro Webmasters - Search for 'Pro Webmasters'
Hello, I am trying to submit sitemap.xml (index) to Yahoo Site Explorer but with no luck. I tried using website feed option in the site explorer to submit the sitemap, but I got validation errors. However, when submitting the same sitemap to google webmaster tools, the sitemap was validated successfully… >>> More
Modify code to change timestamp timezone in sitemap

as seen on Stack Overflow - Search for 'Stack Overflow'
Below is the code from a plugin I use for sitemaps. I would like to know if there's a way to "enforce" a different timezone on all date variable and functions in it. If not, how do I modify the code to change the timestamp to reflect a different timezone? Say for example, to America/New_York timezone… >>> More

Related posts about sitemaps

.XML Sitemaps and HTML Sitemaps Clarification

as seen on Pro Webmasters - Search for 'Pro Webmasters'
I've got a website with about 170 pages and I want to create an effective Sitemap for it as it is long due. The website is internally linked very well but I still want to take advantage of creating a sitemap to allow SE's to crawl my site easier and to hopefully increase my websites PR. Though I am… >>> More
Learning the Difference Between XML and HTML Sitemaps

as seen on Ezine Articles - Search for 'Ezine Articles'
There are many differences to XML and HTML sitemaps. Find out those difference, and why you should have both for your site. >>> More
How to efficiently serve massive sitemaps in django

as seen on Stack Overflow - Search for 'Stack Overflow'
I have a site with about 150K pages in its sitemap. I'm using the sitemap index generator to make the sitemaps, but really, I need a way of caching it, because building the 150 sitemaps of 1,000 links each is brutal on my server.[1] I COULD cache each of these sitemap pages with memcached, which… >>> More
Website Sitemaps and <priority>, is it working?

as seen on Stack Overflow - Search for 'Stack Overflow'
Hi, My "Privacy Policy" page is seen more important by Google than other really more important pages on my website. I'm currently creating a script to generate a sitemap, should I bother with the priority? How do you effectively assign priorities to pages? I consider one of my page important but… >>> More
Caching sitemaps in django

as seen on Stack Overflow - Search for 'Stack Overflow'
I implemented a simple sitemap class using django's default sitemap app. As it was taking a long time to execute, I added manual caching: class ShortReviewsSitemap(Sitemap): changefreq = "hourly" priority = 0.7 def items(self): # try to retrieve from cache result = get_cache(CACHE_SITEMAP_SHORT_REVIEWS… >>> More