# Crowdsourcing Relative Rankings of Multi-Word Expressions: Experts versus Non-Experts

arXiv: https://arxiv.org/abs/2206.08724 · HTML: https://mlsanity.com/paper/2206.08724/

## Key facts

- No citing papers in the map yet (data through 14 Oct 2026).
- Builds on 1 of its 78 references that are in the map.
- First posted on arXiv 17 Jun 2022.

## Builds on (most cited first, 1 of 1)

- [SweLL on the rise: Swedish Learner Language corpus for European Reference Level studies](https://mlsanity.com/paper/1604.06583/) (2016)

## Abstract (arXiv)

In this study we investigate to which degree experts and non-experts agree on questions of difficulty in a crowdsourcing experiment. We ask non-experts (second language learners of Swedish) and two groups of experts (teachers of Swedish as a second/foreign language and CEFR experts) to rank multi-word expressions in a crowdsourcing experiment. We find that the resulting rankings by all the three tested groups correlate to a very high degree, which suggests that judgments produced in a comparative setting are not influenced by professional insights into Swedish as a second language.