mlsanityData to 7 Oct 2026

CHEW: A Dataset of CHanging Events in Wikipedia

arXiv 2406.19116 ↗First posted 27 Jun 2024cs.CL cs.AI cs.LGcited by 1

Not on the map. Why?

Abstract (arXiv)

We introduce CHEW, a novel dataset of changing events in Wikipedia expressed in naturally occurring text. We use CHEW for probing LLMs for their timeline understanding of Wikipedia entities and events in generative and classification experiments. Our results suggest that LLMs, despite having temporal information available, struggle to construct accurate timelines. We further show the usefulness of CHEW-derived embeddings for identifying meaning shift.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 23 of its 29 references that are in the map. First posted on arXiv 27 Jun 2024.

Builds on

23 of 29 references.

References · 23

  1. 2022Training language models to follow instructions with human feedbackcited by 15,712
  2. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  3. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  4. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
  5. 2020Don't Stop Pretraining: Adapt Language Models to Domains and Taskscited by 1,548
  6. 2021Knowledge Neurons in Pretrained Transformerscited by 590
  7. 2021Editing Factual Knowledge in Language Modelscited by 548
  8. 2024LLM2Vec: Large Language Models Are Secretly Powerful Text Encoderscited by 396
  9. 2021Time-Aware Language Models as Temporal Knowledge Basescited by 290
  10. 2022RealTime QA: What's the Answer Right Now?cited by 239
  11. 2021Mind the Gap: Assessing Temporal Generalization in Neural Language Modelscited by 226
  12. 2020Modifying Memories in Transformer Modelscited by 222
11 more
  1. 2022TimeLMs: Diachronic Language Models from Twittercited by 129
  2. 2022StreamingQA: A Benchmark for Adaptation to New Knowledge over Time in Question Answering Modelscited by 123
  3. 2022TemporalWiki: A Lifelong Benchmark for Training and Evaluating Ever-Evolving Language Modelscited by 117
  4. 2020SemEval-2020 Task 1: Unsupervised Lexical Semantic Change Detectioncited by 105
  5. 2020Analysing Lexical Semantic Change with Contextualised Word Representationscited by 92
  6. 2021Time Waits for No One! Analysis and Challenges of Temporal Misalignmentcited by 91
  7. 2021Temporal Effects on Pre-trained Models for Language Processing Taskscited by 46
  8. 2021Dict-BERT: Enhancing Language Model Pre-training with Dictionarycited by 38
  9. 2018Short-Term Meaning Shift: A Distributional Explorationcited by 23
  10. 2022TempoWiC: An Evaluation Benchmark for Detecting Meaning Shift in Social Mediacited by 19
  11. 2023Interpretable Word Sense Representations via Definition Generation: The Case of Semantic Change Analysiscited by 19

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.

  1. 2025Memorization vs. Reasoning: Updating LLMs with New Knowledgecited by 12