mlsanityData to 14 Oct 2026

NorBench -- A Benchmark for Norwegian Language Models

arXiv 2305.03880 ↗First posted 6 May 2023cs.CLcited by 23

Not on the map. Why?

Abstract (arXiv)

We present NorBench: a streamlined suite of NLP tasks and probes for evaluating Norwegian language models (LMs) on standardized data splits and evaluation metrics. We also introduce a range of new Norwegian language models (both encoder and encoder-decoder based). Finally, we compare and analyze their performance, along with other existing LMs, across the different benchmark tests of NorBench.

Key facts. Cited by 23 papers in the map (data through 14 Oct 2026). Builds on 29 of its 50 references that are in the map. First posted on arXiv 6 May 2023.

Builds on

29 of 50 references.

References · 29

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  3. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
  4. 2018GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understandingcited by 4,899
  5. 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,935
  6. 2020DeBERTa: Decoding-enhanced BERT with Disentangled Attentioncited by 2,181
  7. 2020mT5: A massively multilingual pre-trained text-to-text transformercited by 1,818
  8. 2018A Call for Clarity in Reporting BLEU Scorescited by 1,799
  9. 2019SuperGLUE: A Stickier Benchmark for General-Purpose Language Understanding Systemscited by 1,729
  10. 2016Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translationcited by 1,475
  11. 2021Scaling Language Models: Methods, Analysis & Insights from Training Gophercited by 1,202
  12. 2019SpanBERT: Improving Pre-training by Representing and Predicting Spanscited by 834
17 more
  1. 2021Deduplicating Training Data Makes Language Models Bettercited by 714
  2. 2021Documenting Large Webtext Corpora: A Case Study on the Colossal Clean Crawled Corpuscited by 492
  3. 2016Deep Biaffine Attention for Neural Dependency Parsingcited by 334
  4. 201975 Languages, 1 Model: Parsing Universal Dependencies Universallycited by 90
  5. 2021NormFormer: Improved Transformer Pretraining with Extra Normalizationcited by 83
  6. 2020GLGE: A New General Language Generation Evaluation Benchmarkcited by 47
  7. 2023Trained on 100 million words and still in shape: BERT meets British National Corpuscited by 39
  8. 2019A Fine-Grained Sentiment Dataset for Norwegiancited by 23
  9. 2021Operationalizing a National Digital Library: The Case for a Norwegian Transformer Modelcited by 23
  10. 2021Large-Scale Contextualised Language Modelling for Norwegiancited by 21
  11. 2019NorNE: Annotating Named Entities for Norwegiancited by 18
  12. 2017NoReC: The Norwegian Review Corpuscited by 17
  13. 2023ScandEval: A Benchmark for Scandinavian Natural Language Processingcited by 16
  14. 2022Measuring Harmful Representations in Scandinavian Language Modelscited by 7
  15. 2023NorQuAD: Norwegian Question Answering Datasetcited by 7
  16. 2023Entity-Level Sentiment Analysis (ELSA): An exploratory task surveycited by 5
  17. 2023Measuring Normative and Descriptive Biases in Language Models Using Census Datacited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 3; 2024: 8; 2025: 7; 2026: 5.

23 papers.

Sort:

By area:

  1. 2025Between Circuits and Chomsky: Pre-pretraining on Formal Languages Imparts Linguistic Biasescited by 37
  2. 2024Encoder vs Decoder: Comparative Analysis of Encoder and Decoder Language Models on Multilingual NLU Taskscited by 34
  3. 2024The Scandinavian Embedding Benchmarks: Comprehensive Assessment of Multilingual and Monolingual Text Embeddingcited by 26
  4. 2024Small Languages, Big Models: A Study of Continual Training on Languages of Norwaycited by 12
  5. 2023NoCoLA: The Norwegian Corpus of Linguistic Acceptabilitycited by 10
  6. 2023NLEBench+NorGLM: A Comprehensive Empirical Analysis and Benchmark Dataset for Generative Language Models in Norwegiancited by 9
  7. 2024The Impact of Copyrighted Material on Large Language Models: A Norwegian Perspectivecited by 8
  8. 2025NorEval: A Norwegian Language Understanding and Generation Evaluation Benchmarkcited by 8
  9. 2025HPLT 3.0: Very Large-Scale Multilingual Resources for LLMs and MT. Mono- and Bi-lingual Data, Multilingual Evaluation, and Pre-Trained Modelscited by 7
  10. 2024It's Difficult to be Neutral -- Human and LLM-based Sentiment Annotation of Patient Commentscited by 4
  11. 2024Exploring Multiple Strategies to Improve Multilingual Coreference Resolution in CorefUDcited by 3
  12. 2025skLEP: A Slovak General Language Understanding Benchmarkcited by 3
11 more
  1. 2025Add Noise, Tasks, or Layers? MaiNLP at the VarDial 2025 Shared Task on Norwegian Dialectal Slot and Intent Detectioncited by 2
  2. 2025Multi-label Scandinavian Language Identification (SLIDE)cited by 2
  3. 2024Entity-Level Sentiment: More than the Sum of Its Partscited by 1
  4. 2024HiTZ at VarDial 2025 NorSID: Overcoming Data Scarcity with Language Transfer and Automatic Data Annotationcited by 1
  5. 2025Mixed Feelings: Cross-Domain Sentiment Classification of Patient Feedbackcited by 1
  6. 2026When No Benchmark Exists: Validating Comparative LLM Safety Scoring Without Ground-Truth Labelscited by 1
  7. 2023Mean BERTs make erratic language teachers: the effectiveness of latent bootstrapping in low-resource settingscited by 0
  8. 2026NorwAI's Large Language Models: Technical Reportcited by 0
  9. 2026Diagnosing Translated Benchmarks: An Automated Quality Assurance Study of the EU20 Benchmark Suitecited by 0
  10. 2026KliniskVestBERT: BERT Model Specialised to Norwegian Clinical Textscited by 0
  11. 2026SAGA: Score-Weighted Adaptive Generation Alignment for Low-Resource Nordic Language Modelscited by 0