mlsanityData to 14 Oct 2026

TEMPS: Temporal Sentence Embeddings for Temporal Information Retrieval

arXiv 2609.28048 ↗First posted 23 Sep 2026cs.CL cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Modern information retrieval (IR) systems rarely represent time, yet many information needs depend on it: in clinical, journalistic, and legal search, when an event occurred can decide whether a document is relevant. Dense retrievers and Retrieval-Augmented Generation (RAG) pipelines match queries to documents well on topic but poorly on time, so they surface content that is on-topic yet temporally wrong. We introduce Temporal Textual Similarity (TTS), a task that measures how well two anchored texts align in time, independent of their topical similarity. We then present TEMPS (Temporal Embedding Model for Precise Search), a modular temporal branch that attaches to a frozen semantic retriever and trains on that signal. It resolves anchored temporal expressions to intervals and moment-matches each one to a Gaussian; the resulting ordering supervises an anchor-date-conditioned encoder, whose score we fuse with the semantic score at inference. Grounding supplies the supervision, so training uses no hand-labeled temporal data. The temporal score itself is the Gaussian-KL inclusion measure from distributional embeddings; what TEMPS adds is the grounding and the moment-matched supervision. On three temporal benchmarks, TEMPS improves MRR for every semantic backbone tested and, on TS- Retriever, lifts R@1 from 19.92 to 25.39 over the prior temporal state of the art.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 21 of its 51 references that are in the map. First posted on arXiv 23 Sep 2026.

Builds on

21 of 51 references.

References · 21

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  3. 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,824
  4. 2021SimCSE: Simple Contrastive Learning of Sentence Embeddingscited by 2,173
  5. 2022Text Embeddings by Weakly-Supervised Contrastive Pre-trainingcited by 1,253
  6. 2021Unsupervised Dense Information Retrieval with Contrastive Learningcited by 1,216
  7. 2020ColBERT: Efficient and Effective Passage Search via Contextualized Late Interaction over BERTcited by 1,178
  8. 2024M3-Embedding: Multi-Linguality, Multi-Functionality, Multi-Granularity Text Embeddings Through Self-Knowledge Distillationcited by 1,073
  9. 2017SemEval-2017 Task 1: Semantic Textual Similarity - Multilingual and Cross-lingual Focused Evaluationcited by 1,001
  10. 2020MPNet: Masked and Permuted Pre-training for Language Understandingcited by 981
  11. 2023C-Pack: Packed Resources For General Chinese Embeddingscited by 578
  12. 2024Smarter, Better, Faster, Longer: A Modern Bidirectional Encoder for Fast, Memory Efficient, and Long Context Finetuning and Inferencecited by 554
9 more
  1. 2022Large Language Models Struggle to Learn Long-Tail Knowledgecited by 458
  2. 2017Deep Gaussian Embedding of Graphs: Unsupervised Inductive Learning via Rankingcited by 335
  3. 2021Efficiently Teaching an Effective Dense Retriever with Balanced Topic Aware Samplingcited by 238
  4. 2021A Dataset for Answering Time-Sensitive Questionscited by 154
  5. 2023Jina Embeddings 2: 8192-Token General-Purpose Text Embeddings for Long Documentscited by 104
  6. 2014Word Representations via Gaussian Embeddingcited by 96
  7. 2021Complex Temporal Question Answering on Knowledge Graphscited by 69
  8. 2022BiTimeBERT: Extending Pre-Trained Language Representations with Bi-Temporal Informationcited by 17
  9. 2022Multilingual Normalization of Temporal Expressions with Masked Language Modelscited by 7

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025TempRetriever: Fusion-based Temporal Dense Passage Retrieval for Time-Sensitive Questions
  2. 2026Q-TIE: A Lightweight and Generalizable Re-ranking Framework for Temporal Information Retrieval
  3. 2026TEMPO: A Realistic Multi-Domain Benchmark for Temporal Reasoning-Intensive Retrieval
  4. 2026Efficient Temporal-aware Matryoshka Adaptation for Temporal Information Retrieval
  5. 2024Towards Effective Time-Aware Language Representation: Exploring Enhanced Temporal Understanding in Language Models
  6. 2025Temporal Information Retrieval via Time-Specifier Model Merging
  7. 2026Temporal Preference Optimization for Unsupervised Retrieval
  8. 2024It's About Time: Incorporating Temporality in Retrieval Augmented Language Models