noTenTen: Corpus of the Norwegian Web
The Norwegian Web Corpus (noTenTen) is a language corpus made up of texts collected from the Internet. The corpus belongs to the TenTen corpus family which is a set of the web corpora built using the same method with a target size 10+ billion words. Sketch Engine currently provides access to TenTen corpora in more than 30 languages.
Data was crawled by the SpiderLing web spider in February 2012 and February 2015 with the total size over 2.5 billion words of Bokmål and Nynorsk written standards for the Norwegian language.
Overview of corpus size
In 2016, the whole corpus was divided into two separate corpora according to the written standard for Norwegian:
- Norwegian Web 2015 (Bokmål) – 1.17 billion words
- Norwegian Web 2015 (Nynorsk) – 44 million words
Detailed information about TenTen corpora is on the separate page Common TenTen corpora attributes.
The czTenTen corpus was POS annotated by with Oslo-Bergen Tagger using this tagset summary.
The tags are available in two corpus attributes:
- tag – a part of speech
- tag_attrs – a morphological detail
For instance, where the original tag is “pron ent pers hum nom 1” (pronoun singular personal human nominative 1):
- tag = “pron”
- tag_attrs = “ent pers hum nom 1”