Focused Crawling for Automated IsiXhosa Corpus Building - Final Crawl Data & Analysis

IsiXhosa is a low-resource language, which means that it does not have many large, high-quality corpora. This makes it difficult to perform many kinds of research with the language. This data accompanies the paper "Focused Crawling for Automated IsiXhosa Corpus Building", which examines the use of focused Web crawling for automatic corpus generation.

This archive includes the raw (zipped) output of the crawl (JSONLines), the seed URLs used in the crawl process, a brief analysis of outgoing links from each site, and an OpenDocument Spreadsheet containing graphs and analysis of the data with regards to vocabulary growth and size (using a randomly shuffled version of the raw output).