The ClueWeb09 dataset was created to support research on information retrieval and related human language technologies. It consists of about 1 billion web pages in ten languages that were collected in January and February 2009. The dataset is used by several tracks of the TREC conference.
1,040,809,705 web pages, in 10 languages 5 TB, compressed. (25 TB, uncompressed.)
|Skapare||The Lemur Project|
The ClueWeb09 Dataset. The Lemur Project.
Retrieved 03:48, May 25, 2013 (UTC).
the Data Hub