orWaC: Oromo web corpus

The Oromo web corpus (orWaC) is a language corpus made up of texts collected from the Internet. The corpus was prepared according to standards described in the document A Corpus Factory for Many Languages (Kilgarriff et al. at LREC 2010).

Data was crawled by the SpiderLing web spider January 2016 with the final size 4 million words.

Document count – the most frequent web domains and domain size distribution:

Top level domains Web domains Second level domain size distribution
org 5,676 *.jw.org 2,695 At least 1000 documents 2
com 2,054 qeerroo.org 1,010 At least 500 documents 4
net 839 vidoser.org 632 At least 100 documents 16
et 213 gadaa.net|com 518 At least 50 documents 21
*.voaafaanoromoo.com 438 At least 10 documents 45
oromedia.net 304 At least 5 documents 60
bilisummaa.com 291 At least 1 document 190
*.blogspot.com 287
oromiatimes.org 276

The content of news/politics and religious sites has a significant presence in the corpus sources.

The corpus was created in the framework of the HaBiT project (Harvesting big text data for under-resourced languages), see more at https://habit-project.eu/wiki/OromoCorpus

Part-of-speech tagset

The Oromo WaC corpus contains POS annotation based on Universal dependencies, a multilingual parser development.

Tools to work with the Oromo Web corpus

A complete set of Sketch Engine tools is available to work with this Amharic Web corpus to generate:

  • word sketch – Oromo collocations categorized by grammatical relations
  • thesaurus – synonyms and similar words for every word
  • word lists – lists of Oromo nouns, verbs, adjectives etc. organized by frequency
  • n-grams – frequency list of multi-word units
  • concordance – examples in context

Bibliography

Corpus factory method

Kilgarriff, A., Reddy, S., Pomikálek, J., & Avinesh, P. V. S. (2010, May). A corpus factory for many languages. In LREC.

Search the Oromo Web corpus

Sketch Engine offers a range of tools to work with the Oromo Web corpus.

or

Other text corpora in Sketch Engine

Sketch Engine offers 350+ language corpora.

Use Sketch Engine in minutes

Generating collocations, frequency lists, examples in contexts, n-grams or extracting terms is easy with Sketch Engine. Use our Quick Start Guide to learn it in minutes.