# The Danish Gigaword Project

arXiv: https://arxiv.org/abs/2005.03521 · HTML: https://mlsanity.com/paper/2005.03521/

## Key facts

- Cited by 17 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 7 May 2020.

## Built on by (most cited first, 17 of 17)

- [The Scandinavian Embedding Benchmarks: Comprehensive Assessment of Multilingual and Monolingual Text Embedding](https://mlsanity.com/paper/2406.02396/) (2024)
- [A Survey of Corpora for Germanic Low-Resource Languages and Dialects](https://mlsanity.com/paper/2304.09805/) (2023)
- [Transfer to a Low-Resource Language via Close Relatives: The Case Study on Faroese](https://mlsanity.com/paper/2304.08823/) (2023)
- [DaCy: A Unified Framework for Danish NLP](https://mlsanity.com/paper/2107.05295/) (2021)
- [Continual Learning Under Language Shift](https://mlsanity.com/paper/2311.01200/) (2023)
- [GPT-SW3: An Autoregressive Language Model for the Nordic Languages](https://mlsanity.com/paper/2305.12987/) (2023)
- [A Survey of Large Language Models for European Languages](https://mlsanity.com/paper/2408.15040/) (2024)
- [Training a T5 Using Lab-sized Resources](https://mlsanity.com/paper/2208.12097/) (2022)
- [Danish Foundation Models](https://mlsanity.com/paper/2311.07264/) (2023)
- [Dynaword: From One-shot to Continuously Developed Datasets](https://mlsanity.com/paper/2508.02271/) (2025)
- [Topic Model Robustness to Automatic Speech Recognition Errors in Podcast Transcripts](https://mlsanity.com/paper/2109.12306/) (2021)
- [Impoverished Language Technology: The Lack of (Social) Class in NLP](https://mlsanity.com/paper/2403.03874/) (2024)
- [The ITU Faroese Pairs Dataset](https://mlsanity.com/paper/2206.08727/) (2022)
- [DANSK and DaCy 2.6.0: Domain Generalization of Danish Named Entity Recognition](https://mlsanity.com/paper/2402.18209/) (2024)
- [Data Processing for the OpenGPT-X Model Family](https://mlsanity.com/paper/2410.08800/) (2024)
- [MrBERT: Modern Multilingual Encoders via Vocabulary, Domain, and Dimensional Adaptation](https://mlsanity.com/paper/2602.21379/) (2026)
- [Retrieving Biblical Intertextual References in Karen Blixen's Seven Gothic Tales](https://mlsanity.com/paper/2609.35765/) (2026)

## Abstract (arXiv)

Danish language technology has been hindered by a lack of broad-coverage corpora at the scale modern NLP prefers. This paper describes the Danish Gigaword Corpus, the result of a focused effort to provide a diverse and freely-available one billion word corpus of Danish text. The Danish Gigaword corpus covers a wide array of time periods, domains, speakers' socio-economic status, and Danish dialects.
