mlsanityData to 14 Oct 2026

Temporal Information Retrieval via Time-Specifier Model Merging

arXiv 2507.06782 ↗First posted 9 Jul 2025cs.IR cs.AI cs.LGcited by 5

Not on the map. Why?

Abstract (arXiv)

The rapid expansion of digital information and knowledge across structured and unstructured sources has heightened the importance of Information Retrieval (IR). While dense retrieval methods have substantially improved semantic matching for general queries, they consistently underperform on queries with explicit temporal constraints--often those containing numerical expressions and time specifiers such as ``in 2015.'' Existing approaches to Temporal Information Retrieval (TIR) improve temporal reasoning but often suffer from catastrophic forgetting, leading to reduced performance on non-temporal queries. To address this, we propose Time-Specifier Model Merging (TSM), a novel method that enhances temporal retrieval while preserving accuracy on non-temporal queries. TSM trains specialized retrievers for individual time specifiers and merges them in to a unified model, enabling precise handling of temporal constraints without compromising non-temporal retrieval. Extensive experiments on both temporal and non-temporal datasets demonstrate that TSM significantly improves performance on temporally constrained queries while maintaining strong results on non-temporal queries, consistently outperforming other baseline methods. Our code is available at https://github.com/seungyoonee/TSM .

Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 27 of its 36 references that are in the map. First posted on arXiv 9 Jul 2025.

Builds on

27 of 36 references.

References · 27

  1. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  2. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  3. 2016Overcoming catastrophic forgetting in neural networkscited by 4,787
  4. 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,824
  5. 2016Learning without Forgettingcited by 2,496
  6. 2017Decoupled Weight Decay Regularizationcited by 1,831
  7. 2016MS MARCO: A Human Generated MAchine Reading COmprehension Datasetcited by 1,605
  8. 2021BEIR: A Heterogenous Benchmark for Zero-shot Evaluation of Information Retrieval Modelscited by 1,252
  9. 2021Unsupervised Dense Information Retrieval with Contrastive Learningcited by 1,216
  10. 2019Generalization through Memorization: Nearest Neighbor Language Modelscited by 800
  11. 2013An Empirical Investigation of Catastrophic Forgetting in Gradient-Based Neural Networkscited by 722
  12. 2023An Empirical Study of Catastrophic Forgetting in Large Language Models During Continual Fine-tuningcited by 639
15 more
  1. 2021Time-Aware Language Models as Temporal Knowledge Basescited by 296
  2. 2021Ensemble deep learning: A reviewcited by 284
  3. 2024Model Merging in LLMs, MLLMs, and Beyond: Methods, Theories, Applications and Opportunitiescited by 254
  4. 2024Arcee's MergeKit: A Toolkit for Merging Large Language Modelscited by 194
  5. 2021A Dataset for Answering Time-Sensitive Questionscited by 154
  6. 2017Encoder Based Lifelong Learningcited by 102
  7. 2019Multi-passage BERT: A Globally Normalized BERT Model for Open-domain Question Answeringcited by 96
  8. 2024Model Stock: All we need is just a few fine-tuned modelscited by 92
  9. 2021A Survey on Complex Knowledge Base Question Answering: Methods, Challenges and Solutionscited by 78
  10. 2021Time Masking for Temporal Language Modelscited by 46
  11. 2023LM-Cocktail: Resilient Tuning of Language Models via Model Mergingcited by 44
  12. 2024Mitigating Catastrophic Forgetting in Language Transfer via Model Mergingcited by 36
  13. 2022BiTimeBERT: Extending Pre-Trained Language Representations with Bi-Temporal Informationcited by 17
  14. 2025TempRetriever: Fusion-based Temporal Dense Passage Retrieval for Time-Sensitive Questionscited by 15
  15. 2023Salient Span Masking for Temporal Understandingcited by 14

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 4.

5 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026TEMPO: A Realistic Multi-Domain Benchmark for Temporal Reasoning-Intensive Retrieval
  2. 2024It's About Time: Incorporating Temporality in Retrieval Augmented Language Models
  3. 2026Difficulty-Gated Fusion of Reasoning Views for Temporal Retrieval
  4. 2026TEMPS: Temporal Sentence Embeddings for Temporal Information Retrieval
  5. 2026IA-RAG: Interval-Algebra-Driven Temporal Reasoning for Dynamic Knowledge Retrieval
  6. 2026TS-Haystack: A Multi-Task Retrieval Benchmark for Long-Context Time-Series Reasoning
  7. 2024MRAG: A Modular Retrieval Framework for Time-Sensitive Question Answering
  8. 2026TimelyRAG: Semantic-Temporal Hybrid Retrieval for Time-Critical Question Answering in Overlapping-Evolving Documents