Temporal Information Retrieval via Time-Specifier Model Merging
Not on the map. Why?
Abstract (arXiv)
The rapid expansion of digital information and knowledge across structured and unstructured sources has heightened the importance of Information Retrieval (IR). While dense retrieval methods have substantially improved semantic matching for general queries, they consistently underperform on queries with explicit temporal constraints--often those containing numerical expressions and time specifiers such as ``in 2015.'' Existing approaches to Temporal Information Retrieval (TIR) improve temporal reasoning but often suffer from catastrophic forgetting, leading to reduced performance on non-temporal queries. To address this, we propose Time-Specifier Model Merging (TSM), a novel method that enhances temporal retrieval while preserving accuracy on non-temporal queries. TSM trains specialized retrievers for individual time specifiers and merges them in to a unified model, enabling precise handling of temporal constraints without compromising non-temporal retrieval. Extensive experiments on both temporal and non-temporal datasets demonstrate that TSM significantly improves performance on temporally constrained queries while maintaining strong results on non-temporal queries, consistently outperforming other baseline methods. Our code is available at https://github.com/seungyoonee/TSM .
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 27 of its 36 references that are in the map. First posted on arXiv 9 Jul 2025.
Builds on
27 of 36 references.
References · 27
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2016Overcoming catastrophic forgetting in neural networkscited by 4,787
- 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,824
- 2016Learning without Forgettingcited by 2,496
- 2017Decoupled Weight Decay Regularizationcited by 1,831
- 2016MS MARCO: A Human Generated MAchine Reading COmprehension Datasetcited by 1,605
- 2021BEIR: A Heterogenous Benchmark for Zero-shot Evaluation of Information Retrieval Modelscited by 1,252
- 2021Unsupervised Dense Information Retrieval with Contrastive Learningcited by 1,216
- 2019Generalization through Memorization: Nearest Neighbor Language Modelscited by 800
- 2013An Empirical Investigation of Catastrophic Forgetting in Gradient-Based Neural Networkscited by 722
- 2023An Empirical Study of Catastrophic Forgetting in Large Language Models During Continual Fine-tuningcited by 639
15 more
- 2021Time-Aware Language Models as Temporal Knowledge Basescited by 296
- 2021Ensemble deep learning: A reviewcited by 284
- 2024Model Merging in LLMs, MLLMs, and Beyond: Methods, Theories, Applications and Opportunitiescited by 254
- 2024Arcee's MergeKit: A Toolkit for Merging Large Language Modelscited by 194
- 2021A Dataset for Answering Time-Sensitive Questionscited by 154
- 2017Encoder Based Lifelong Learningcited by 102
- 2019Multi-passage BERT: A Globally Normalized BERT Model for Open-domain Question Answeringcited by 96
- 2024Model Stock: All we need is just a few fine-tuned modelscited by 92
- 2021A Survey on Complex Knowledge Base Question Answering: Methods, Challenges and Solutionscited by 78
- 2021Time Masking for Temporal Language Modelscited by 46
- 2023LM-Cocktail: Resilient Tuning of Language Models via Model Mergingcited by 44
- 2024Mitigating Catastrophic Forgetting in Language Transfer via Model Mergingcited by 36
- 2022BiTimeBERT: Extending Pre-Trained Language Representations with Bi-Temporal Informationcited by 17
- 2025TempRetriever: Fusion-based Temporal Dense Passage Retrieval for Time-Sensitive Questionscited by 15
- 2023Salient Span Masking for Temporal Understandingcited by 14
Built on by
Citing papers per year: 2025: 1; 2026: 4.
5 papers.
- 2026Taxonomy of the Retrieval System Framework: Pitfalls and Paradigmscited by 4
- 2026Efficient Temporal-aware Matryoshka Adaptation for Temporal Information Retrievalcited by 2
- 2025Re3: Learning to Balance Relevance & Recency for Temporal Information Retrievalcited by 0
- 2026ChunQiuTR: Time-Keyed Temporal Retrieval in Classical Chinese Annalscited by 0
- 2026Q-TIE: A Lightweight and Generalizable Re-ranking Framework for Temporal Information Retrievalcited by 0
- 2026Q-TIE: A Lightweight and Generalizable Re-ranking Framework for Temporal Information Retrieval20 Sep 2026
- 2026ChunQiuTR: Time-Keyed Temporal Retrieval in Classical Chinese Annals8 Apr 2026
- 2026Taxonomy of the Retrieval System Framework: Pitfalls and Paradigms27 Jan 2026
- 2026Efficient Temporal-aware Matryoshka Adaptation for Temporal Information Retrieval9 Jan 2026
- 2025Re3: Learning to Balance Relevance & Recency for Temporal Information Retrieval1 Sep 2025
Similar, not cited
Close in wording, no citation either way
- 2026TEMPO: A Realistic Multi-Domain Benchmark for Temporal Reasoning-Intensive Retrieval
- 2024It's About Time: Incorporating Temporality in Retrieval Augmented Language Models
- 2026Difficulty-Gated Fusion of Reasoning Views for Temporal Retrieval
- 2026TEMPS: Temporal Sentence Embeddings for Temporal Information Retrieval
- 2026IA-RAG: Interval-Algebra-Driven Temporal Reasoning for Dynamic Knowledge Retrieval
- 2026TS-Haystack: A Multi-Task Retrieval Benchmark for Long-Context Time-Series Reasoning
- 2024MRAG: A Modular Retrieval Framework for Time-Sensitive Question Answering
- 2026TimelyRAG: Semantic-Temporal Hybrid Retrieval for Time-Critical Question Answering in Overlapping-Evolving Documents