mlsanityData to 7 Oct 2026

SimVerb-3500: A Large-Scale Evaluation Set of Verb Similarity

arXiv 1608.00869 ↗First posted 2 Aug 2016cs.CLcited by 44

Not on the map. Why?

Abstract (arXiv)

Verbs play a critical role in the meaning of sentences, but these ubiquitous words have received little attention in recent distributional semantics research. We introduce SimVerb-3500, an evaluation resource that provides human ratings for the similarity of 3,500 verb pairs. SimVerb-3500 covers all normed verb types from the USF free-association database, providing at least three examples for every VerbNet class. This broad coverage facilitates detailed analyses of how syntactic and semantic phenomena together influence human understanding of verb meaning. Further, with significantly larger development and test sets than existing benchmarks, SimVerb-3500 enables more robust evaluation of representation learning architectures and promotes the development of methods tailored to verbs. We hope that SimVerb-3500 will enable a richer understanding of the diversity and complexity of verb semantics and guide the development of systems that can effectively represent and interpret this meaning.

Key facts. Cited by 44 papers in the map (data through 7 Oct 2026). First posted on arXiv 2 Aug 2016.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 14; 2022: 15; 2023: 5; 2024: 6; 2025: 3; 2026: 1.

44 papers.

Sort:

  1. 2021All Bark and No Bite: Rogue Dimensions in Transformer Language Models Obscure Representational Qualitycited by 150
  2. 2021The Zero Resource Speech Challenge 2021: Spoken language modellingcited by 47
  3. 2022Self-supervised language learning from raw audio: Lessons from the Zero Resource Speech Challengecited by 34
  4. 2024Is Child-Directed Speech Effective Training Data for Language Models?cited by 24
  5. 2021Learning to Remove: Towards Isotropic Pre-trained BERT Embeddingcited by 23
  6. 2022Just Rank: Rethinking Evaluation with Word and Sentence Similaritiescited by 20
  7. 2023Discovering Universal Geometry in Embeddings with ICAcited by 19
  8. 2021Obtaining Better Static Word Embeddings Using Contextual Embedding Modelscited by 18
  9. 2023Visual Grounding Helps Learn Word Meanings in Low-Data Regimescited by 16
  10. 2022Learning Fair Representations via Rate-Distortion Maximizationcited by 15
  11. 2023Backpack Language Modelscited by 15
  12. 2022Contrastive Visual Semantic Pretraining Magnifies the Semantics of Natural Language Representationscited by 14
32 more
  1. 2021Word Embeddings via Causal Inference: Gender Bias Reducing and Semantic Information Preservingcited by 11
  2. 2021RAW-C: Relatedness of Ambiguous Words--in Context (A New Lexical Resource for English)cited by 10
  3. 2021Learning Zero-Shot Multifaceted Visually Grounded Word Embeddings via Multi-Task Trainingcited by 8
  4. 2022Are word boundaries useful for unsupervised language learning?cited by 8
  5. 2021Multi-sense embeddings through a word sense disambiguation processcited by 7
  6. 2021On the Interplay Between Fine-tuning and Composition in Transformerscited by 6
  7. 2024Lexicon-Level Contrastive Visual-Grounding Improves Language Modelingcited by 6
  8. 2022Language with Vision: a Study on Grounded Word and Sentence Embeddingscited by 5
  9. 2021Lacking the embedding of a word? Look it up into a traditional dictionarycited by 4
  10. 2023Multi-Relational Hyperbolic Word Embeddings from Natural Language Definitionscited by 4
  11. 2023A Neighbourhood-Aware Differential Privacy Mechanism for Static Word Embeddingscited by 4
  12. 2025A Distributional Perspective on Word Learning in Neural Language Modelscited by 4
  13. 2026Bringing Up a Bilingual BabyLM: Investigating Multilingual Language Acquisition Using Small-Scale Modelscited by 4
  14. 2021RetroGAN: A Cyclic Post-Specialization System for Improving Out-of-Knowledge and Rare Word Representationscited by 3
  15. 2024Measuring Contextual Informativeness in Child-Directed Textcited by 3
  16. 2025Multi-Sense Embeddings for Language Models and Knowledge Distillationcited by 3
  17. 2021Identifying and Mitigating Gender Bias in Hyperbolic Word Embeddingscited by 2
  18. 2022Evaluation of taxonomic and neural embedding methods for calculating semantic similaritycited by 2
  19. 2024Are ELECTRA's Sentence Embeddings Beyond Repair? The Case of Semantic Textual Similaritycited by 2
  20. 2022Probabilistic Embeddings with Laplacian Graph Priorscited by 1
  21. 2022Lexical semantics enhanced neural word embeddingscited by 1
  22. 2022"No, they did not": Dialogue response dynamics in pre-trained language modelscited by 1
  23. 2024Understanding Higher-Order Correlations Among Semantic Components in Embeddingscited by 1
  24. 2025One Word Is Not Enough: Simple Prompts Improve Word Embeddingscited by 1
  25. 2021Automating Transfer Credit Assessment in Student Mobility -- A Natural Language Processing-based Approachcited by 0
  26. 2021On the Impact of Knowledge-based Linguistic Annotations in the Quality of Scientific Embeddingscited by 0
  27. 2022Permutation invariant matrix statistics and computational language taskscited by 0
  28. 2022An Attention-Based Model for Predicting Contextual Informativeness and Curriculum Learning Applicationscited by 0
  29. 2022How direct is the link between words and images?cited by 0
  30. 2022Visual Grounding of Inter-lingual Word-Embeddingscited by 0
  31. 2022Homophone Reveals the Truth: A Reality Check for Speech2Veccited by 0
  32. 2024Predicting Word Similarity in Context with Referential Translation Machinescited by 0