Free Large datasets to experiment with Hadoop

Posted by Sundar on Stack Overflow See other posts from Stack Overflow or by Sundar
Published on 2010-04-20T10:54:11Z Indexed on 2010/04/22 22:23 UTC
Read the original article Hit count: 479

Filed under:

opendata

|

resources

|

hadoop

Do you know any large datasets to experiment with Hadoop which is free/low cost? Any pointers/links related is appreciated.

Prefernce:

Atleast one GB of data.
Production log data of webserver.

Few of them which I found so far:

Also can we run our own crawler to gather data from sites e.g. Wikipedia? Any pointers on how to do this is appreciated as well.

Related posts about resources

Snow Leopard doesn't repair permissions, despite showing / saying its fixed them?

as seen on Super User - Search for 'Super User'
Sometime ago, I used carbon copy as I was replacing my hard drive in my Mac Mini running Snow Leopard. Afterwards, on my new drive I had some permission problems. I've tried several times running a repair permissions / repair disk from disk util. It shows that there are problems and I think it says… >>> More
Android: retrieving all Drawable resources from Resources object

as seen on Stack Overflow - Search for 'Stack Overflow'
In my Android project, I want to loop through the entire collection of Drawable resources. Normally, you can only retrieve a specific resource via its ID using something like: InputStream is = Resources.getSystem().openRawResource(resourceId) However, I want to get all Drawable resources where… >>> More
Make Eclipse use src/test/resources instead of src/main/resources

as seen on Stack Overflow - Search for 'Stack Overflow'
Hi! I'm writing a little Maven application in Eclipse. I store some property files and my application context in the directory src/main/resources. I now want to make Eclipse use properties in the directory src/test/resources. So when I run and debug the program in Eclipse, these test properties… >>> More
puppet duplicate resources and virtual resources

as seen on Server Fault - Search for 'Server Fault'
Overview Hi just started using Puppet and have been unable to suss something. Problem Because of normalization when I add 2 classes to a node with packages that have the same dependencies it fails. In simple terms have duplicate resources - in this case the package libssl. Note: packages are… >>> More
CHAT ROOMs 7 by 6

as seen on Stack Overflow - Search for 'Stack Overflow'
I am looking for chatroom on one page with 7 loggedin users and 6+rows for say 42 users.these users will keep on adding wthnew users.Need urgent help.A PRETTY UNUSUAL Q FOR MOST OF U.What is MORE REQ new features: Usernames are unique to users currently chatting You can see a "currently chatting"… >>> More

Developer IT

Free Large datasets to experiment with Hadoop - Developer IT

Free Large datasets to experiment with Hadoop

opendata

resources

hadoop

Related posts about opendata

La ville de Paris rejoint le mouvement OpenData, et publie sous licence libre les données de ses services municipaux

Free Large datasets to experiment with Hadoop

Related posts about resources

Snow Leopard doesn't repair permissions, despite showing / saying its fixed them?

Android: retrieving all Drawable resources from Resources object

Make Eclipse use src/test/resources instead of src/main/resources

puppet duplicate resources and virtual resources

CHAT ROOMs 7 by 6

Categories cloud