jpWaC: Japanese web corpus

The Japanese web corpus (jpWaC) is a language corpus made up of texts collected from the Internet. The corpus was prepared by Tomaž Erjavec using a list of URLs provided by Serge Sharoff at the University of Leeds. The standards of corpus preparation are described in the document A Corpus Factory for Many Languages (Kilgarriff et al. at LREC 2010).

The corpus was segmented, part-of-speech tagged and lemmatised using Chasen, an open-source toolset for Japanese. Word sketches were prepared by Irena Srdanovic.

Part-of-speech tagset

The Japanese WaC corpus has the following part-of-speech tagset legend.

Tools to work with the Japanese Web corpus

A complete set of Sketch Engine tools is available to work with this jpWaC corpus to generate:

  • word sketch – Japanese collocations categorized by grammatical relations
  • thesaurus – synonyms and similar words for every word
  • word lists – lists of Japanese nouns, verbs, adjectives etc. organized by frequency
  • n-grams – frequency list of multi-word units
  • concordance – examples in context

Changelog

version 2.0 (25 February 2011)

  • added a new corpus attribute jp_tag which contains Japanese names of the part-of-speech tags

Bibliography

Corpus factory method

Kilgarriff, A., Reddy, S., Pomikálek, J., & Avinesh, P. V. S. (2010, May). A corpus factory for many languages. In LREC.

Japenese word sketches

Srdanović, I., Naomi, I. D. A., Bučar, C. S., Kilgarriff, A., & Kovář, V. (2011). Japanese Word Sketches: Advances and ProblemsActa Linguistica Asiatica1(2), 63-82.

Search the Japanese Web corpus

Sketch Engine offers a range of tools to work with the Japanese Web corpus.

or

Other text corpora in Sketch Engine

Sketch Engine offers 350+ language corpora.

Use Sketch Engine in minutes

Generating collocations, frequency lists, examples in contexts, n-grams or extracting terms is easy with Sketch Engine. Use our Quick Start Guide to learn it in minutes.