daTenTen: Corpus of the Danish Web

The Danish Web Corpus (daTenTen) is a language corpus made up of texts collected from the Internet. The corpus belongs to the TenTen corpus family which is a set of the web corpora built using the same method with a target size 10+ billion words. Sketch Engine currently provides access to TenTen corpora in more than 30 languages.

Data was crawled by the SpiderLing web spider in January 2014 and comprised of more than 2 billion words that are processed by ePos tagger and CST’s lemmatizer.

Detailed information about TenTen corpora is on the separate page Common TenTen corpora attributes.

Part-of-speech tagset

The daTenTen corpus is tagged with the Danish ePos tagset. The former version of this corpus was tagged by CST’s TaggerXML using the following tagset.

daTenTen corpus in detail

The chart shows the distribution of the parts of speech in the Danish Web corpus 2014.

Further information about texts in the corpus

Basic information

Frequency*
Tokens 2 387
Words 2 041
Sentences 127
Web pages 5

* the figures above are rounded to million

Distribution of top-level domains

Tools to work with the Danish Web corpus

A complete set of Sketch Engine tools is available to work with this Danish corpus to generate:

  • word sketch – Danish collocations categorized by grammatical relations
  • thesaurus – synonyms and similar words for every word
  • word lists – lists of Danish nouns, verbs, adjectives etc. organized by frequency
  • n-grams – frequency list of multi-word units
  • concordance – examples in context

Changelog

version 5 (October 2017)

  • new lemmatizing and tagging with ePos tagger

version 4 (April 2015)

  • Tagging of word “Big” corrected to tag “EGEN”

version 3 (March 2015)

  • POS tags with slashes corrected, unwanted HTML tags filtered out

version 2 (4 September 2014)

  • Norwegian filtered out

version 1 (1 July 2014)

  • lempos added
  • better cleaning of messy data and tagger mistakes

version 0 (12 March 2014)

  • daTenTen14 – 2.4 billion tokens
  • crawled by SpiderLing in Jan 2014

Bibliography

TenTen corpora

Jakubíček, M., Kilgarriff, A., Kovář, V., Rychlý, P., & Suchomel, V. (2013, July). The TenTen corpus family. In 7th International Corpus Linguistics Conference CL (pp. 125-127).

Suchomel, V., & Pomikálek, J. (2012). Efficient web crawling for large text corpora. In Proceedings of the seventh Web as Corpus Workshop (WAC7) (pp. 39-43)

Search the Danish corpus

Sketch Engine offers a range of tools to work with the daTenTen corpus.

or

Other text corpora in Sketch Engine

Sketch Engine offers 350+ language corpora.

Use Sketch Engine in minutes

Generating collocations, frequency lists, examples in contexts, n-grams or extracting terms is easy with Sketch Engine. Use our Quick Start Guide to learn it in minutes.