deWaC – German corpus from the .de domain

The German web corpus (deWaC) is a language corpus made up of texts collected from the Internet. The corpus was prepared according to standards described in the document A Corpus Factory for Many Languages (Kilgarriff et al. at LREC 2010).

Data was crawled by the SpiderLing web spider in 2009 and comprises more than 1,34 billion words.

sdeWaC: Parsed German web corpus

The sdeWaC corpus is a 750-million-word subset of German web corpus prepared by Janina Kopp and Niels Ott in 2012. The sdeWaC does not contain duplications. It was parsed by TreeTagger and FSPar dependency parser which created annotations of sentence analysis.

Part-of-speech tagset

The corpus is tagged with TreeTagger using the Stuttgart-Tubingen tagset.

Tools to work with the German web corpus

A complete set of Sketch Engine tools is available to work with these German corpora to generate:

  • word sketch – German collocations categorized by grammatical relations
  • thesaurus – synonyms and similar words for every word
  • word lists – lists of German nouns, verbs, adjectives etc. organized by frequency
  • n-grams – frequency list of multi-word units
  • concordance – examples in context

Changelog

sdeWaC (2012)

  • without duplications
  • parsed by TreeTagger and FSPar dependency parser

deWaC (2009)

  • initial version 1,3 billion words
  • tagged by TreeTagger

Bibliography

BARONI, Marco, et al. The WaCky wide web: a collection of very large linguistically processed web-crawled corporaLanguage resources and evaluation, 2009, 43.3: 209-226.

Corpus factory method

Adam Kilgarriff, Siva Reddy, Jan Pomikálek, and Avinesh PVS. A corpus factory for many languages. In LREC workshop on Web Services and Processing Pipelines, Malta, May 2010.

German word sketch (sdeWaC)

Ivanova, K., Heid, U., Im Walde, S. S., Kilgarriff, A., & Pomikálek, J. (2008, May). Evaluating a German Sketch Grammar: A Case Study on Noun Phrase Case. In LREC.

Search the German corpus

Sketch Engine offers a range of tools to work with the German web corpus.

or

Other text corpora in Sketch Engine

Sketch Engine offers 400+ language corpora.

Use Sketch Engine in minutes

Generating collocations, frequency lists, examples in contexts, n-grams or extracting terms is easy with Sketch Engine. Use our Quick Start Guide to learn it in minutes.