Website downloader library

Posted by Midhat on Stack Overflow See other posts from Stack Overflow or by Midhat
Published on 2010-03-15T14:50:31Z Indexed on 2010/03/15 15:09 UTC
Read the original article Hit count: 353

Filed under:

offline-browsing

|

website-download

I need to put a little project together for myself, and I need some functionality to download a page for offline viewing. Is there a library that will download a given page and its embedded images, and edit the img tags to reflect the local locations of the images.

I know there are a lot of website downloaders out there, but I cant find something that i can use directly in my code.

I have some basic scripts done in python, so Python is very welcome. but pretty much any language will do.

© Stack Overflow or respective owner

Related posts about offline-browsing

How to make easily PDF version of a web?

as seen on Super User - Search for 'Super User'
I'm trying to make an offline version of a web and I'm looking for a tool that would do the task automatically for the whole web (circa 1000 pages of HTML + images). Is there anything like that and free? I know it is quite challenge for a program but maybe I'll be lucky :). EDIT: It should be a… >>> More
Plain Html and javascript execution offline

as seen on Stack Overflow - Search for 'Stack Overflow'
Can HTML and javascript run offline like an application? I'm looking to running the webpage offline like silverlight OOB applications. But if the browser closes, I want some way to run the webpage again without going online. Is this possible? >>> More
How to make easily PDF version of a web?

as seen on Stack Overflow - Search for 'Stack Overflow'
I'm trying to make an offline version of a web and I'm looking for a tool that would do the task automatically for the whole web (circa 1000 pages of HTML + images). Is there anything like that and free? I know it is quite challenge for a program but maybe I'll be lucky :). Thanks! >>> More
Website downloader library

as seen on Stack Overflow - Search for 'Stack Overflow'
I need to put a little project together for myself, and I need some functionality to download a page for offline viewing. Is there a library that will download a given page and its embedded images, and edit the img tags to reflect the local locations of the images. I know there are a lot of website… >>> More
Once an HTML document has a manifest (cache.manifest), how can you remove it?

as seen on Stack Overflow - Search for 'Stack Overflow'
It seems that once you have a manifest entry, a la: <html manifest="cache.manifest"> Then that page (the master entry in the cache) will always be cached (at least by Safari) until the user does something to remove the cache, even if you later remove the manifest attribute from the html tag… >>> More

Related posts about website-download

Website downloader library

as seen on Stack Overflow - Search for 'Stack Overflow'
I need to put a little project together for myself, and I need some functionality to download a page for offline viewing. Is there a library that will download a given page and its embedded images, and edit the img tags to reflect the local locations of the images. I know there are a lot of website… >>> More
How To Verify Users With A Captcha Blog Comments Sample

as seen on Dot net Slackers - Search for 'Dot net Slackers'
Check out this 6 minute ASPxCaptcha introduction video that shows you how to easily setup and use the new ASPxCaptcha control in your website: Download Sample The screencast features a demo of a blog commenting web page. You can download the sample code in C# and VB.NET versions here: Captcha… >>> More
How does joomla breadcrumbs work internally?

as seen on Stack Overflow - Search for 'Stack Overflow'
I've already gone thru: http://docs.joomla.org/How_to_add_breadcrumbs and http://api.joomla.org/Joomla-Framework/Application/JPathway.html but they don't help. I have not found any more info in any books or internet. My website download forms has 1000's of pages generated thru script. I want to… >>> More
Bandwidth preserving browsing mode

as seen on Super User - Search for 'Super User'
I'm looking at some methods to browse the web, in situations where bandwidth is scarce (such as, flaky wifi connection, or mobile phone internet provider who overcharges the bandwidth). One thing that would save alot of bandwidth is not downloading images while browsing. This approach has two main… >>> More
Why does my company's software download get blocked by anti-virus programs when downloading from the company website but not other websites?

as seen on Super User - Search for 'Super User'
My company distributes software via website download off of a URL that is on our company's website. The download is an .EXE. We are getting calls from multiple customers saying the download is being blocked. We can help them download by turning off the virus-scan software, but wondering what is… >>> More