Context

The Leipzig Corpora Collection presents corpora in different languages using the same format and comparable sources. All data are available as plain text files and can be imported into a MySQL database by using the provided import script. They are intended both for scientific use by corpus linguists as well as for applications such as knowledge extraction programs.

Content

This dataset contains 3 million sentences taken from newspaper texts in 2015. Non-sentences and foreign language material was removed. In addition to the sentences themselves, this dataset contains information on the frequency of each word. More information about the format and content of these files can be found here.

The corpora are automatically collected from carefully selected public sources without considering in detail the content of the contained text. No responsibility is taken for the content of the data. In particular, the views and opinions expressed in specific parts of the data remain exclusively with the authors.

Acknowledgements

This dataset is released under a CC-BY 4.0 license. If you use this dataset in your work, please cite the following paper:

D. Goldhahn, T. Eckart & U. Quasthoff: Building Large Monolingual Dictionaries at the Leipzig Corpora Collection: From 100 to 200 Languages.
In: Proceedings of the 8th International Language Resources and Evaluation (LREC'12), 2012