mlsanityData to 7 Oct 2026

WISTERIA: Weak Implicit Signal-based Temporal Relation Extraction with Attention

arXiv 2603.23319 ↗First posted 24 Mar 2026cs.CL cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Temporal Relation Extraction (TRE) requires identifying how two events or temporal expressions are related in time. Existing attention-based models often highlight globally salient tokens but overlook the pair-specific cues that actually determine the temporal relation. We propose WISTERIA (Weak Implicit Signal-based Temporal Relation Extraction with Attention), a framework that examines whether the top-K attention components conditioned on each event pair truly encode interpretable evidence for temporal classification. Unlike prior works assuming explicit markers such as before, after, or when, WISTERIA considers signals as any lexical, syntactic, or morphological element implicitly expressing temporal order. By combining multi-head attention with pair-conditioned top-K pooling, the model isolates the most informative contextual tokens for each pair. We conduct extensive experiments on TimeBank-Dense, MATRES, TDDMan, and TDDAuto, including linguistic analyses of top-K tokens. Results show that WISTERIA achieves competitive accuracy and reveals pair-level rationales aligned with temporal linguistic cues, offering a localized and interpretable view of temporal reasoning.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 20 of its 35 references that are in the map. First posted on arXiv 24 Mar 2026.

Builds on

20 of 35 references.

References · 20

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  4. 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,530
  5. 2019Generating Long Sequences with Sparse Transformerscited by 1,523
  6. 2018Self-Attention with Relative Position Representationscited by 1,112
  7. 2019Attention is not Explanationcited by 916
  8. 2019Attention is not not Explanationcited by 629
  9. 2018Efficient Attention: Attention with Linear Complexitiescited by 366
  10. 2016Deep Biaffine Attention for Neural Dependency Parsingcited by 334
  11. 2019Adaptively Sparse Transformerscited by 154
  12. 2020Self-attention encoding and pooling for speaker recognitioncited by 33
8 more
  1. 2019An Improved Neural Baseline for Temporal Relation Extractioncited by 32
  2. 2020Clinical Temporal Relation Extraction with Probabilistic Soft Logic Regularization and Global Inferencecited by 20
  3. 2021Extracting Temporal Event Relation with Syntax-guided Graph Transformercited by 16
  4. 2020Domain Knowledge Empowered Structured Neural Net for End-to-End Event Temporal Relation Extractioncited by 15
  5. 2023More than Classification: A Unified Framework for Event Temporal Relation Extractioncited by 14
  6. 2020Severing the Edge Between Before and After: Neural Architectures for Temporal Ordering of Eventscited by 12
  7. 2020Effective Distant Supervision for Temporal Relation Extractioncited by 8
  8. 2022Distilling Multi-Scale Knowledge for Event Temporal Relation Extractioncited by 6

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Identifying Temporal Features within Transcoders for Time Sensitive Factual Recall
  2. 2025ChronoSense: Exploring Temporal Understanding in Large Language Models with Time Intervals of Events
  3. 2025Causality Matters: How Temporal Information Emerges in Video Language Models
  4. 2025The Temporal Game: A New Perspective on Temporal Relation Extraction
  5. 2024Event Temporal Relation Extraction based on Retrieval-Augmented on LLMs
  6. 2024Will LLMs Replace the Encoder-Only Models in Temporal Relation Classification?
  7. 2025Beyond Semantics: How Temporal Biases Shape Retrieval in Transformer and State-Space Models
  8. 2026Time Travel Engine: A Shared Latent Chronological Manifold Enables Historical Navigation in Large Language Models