Discussion in LinkedIn group on load testing Hadoop with large public domain datasets

Discussion thread on LinkedIn Group:

• http://www.linkedin.com/groups/Does-anyone-know-about-any-988957%2ES%2E277887767?view=&srchtype=discussedNews&gid=988957&item=277887767&type=member&trk=eml-anet_dig-b_pd-ttl-cn&fromEmail=&ut=0jXhbsFMLhRBY1

Benchmarking and Stress Testing an Hadoop Cluster With TeraSort, TestDFSIO & Co.

• http://www.michael-noll.com/blog/2011/04/09/benchmarking-and-stress-testing-an-hadoop-cluster-with-terasort-testdfsio-nnbench-mrbench/#!

Project Gutenberg (approximately 30,000 books)

• http://www.gutenberg.org/wiki/Gutenberg:Feeds

Wikipedia (full download)

• http://en.wikipedia.org/wiki/Wikipedia:Database_download

Datasets available through Amazon, such as the Human Genome Project and US Census Database

• http://aws.amazon.com/publicdatasets/#!