University of Cape Town
Browse
1/1
4 files

Focused Crawling for Automated IsiXhosa Corpus Building - Final Crawl Data & Analysis

dataset
posted on 2024-05-30, 07:43 authored by Cael MarquardCael Marquard, Hussein SulemanHussein Suleman

IsiXhosa is a low-resource language, which means that it does not have many large, high-quality corpora. This makes it difficult to perform many kinds of research with the language. This data accompanies the paper "Focused Crawling for Automated IsiXhosa Corpus Building", which examines the use of focused Web crawling for automatic corpus generation.

This archive includes the raw (zipped) output of the crawl (JSONLines), the seed URLs used in the crawl process, a brief analysis of outgoing links from each site, and an OpenDocument Spreadsheet containing graphs and analysis of the data with regards to vocabulary growth and size (using a randomly shuffled version of the raw output).

History

Department/Unit

Computer Science

Usage metrics

    Computer Science

    Exports

    RefWorks
    BibTeX
    Ref. manager
    Endnote
    DataCite
    NLM
    DC