mlsanityData to 14 Oct 2026

Event Interaction in Low-Rank Bottlenecks for Temporal Relation Extraction

arXiv 2609.06731 ↗First posted 6 Sep 2026cs.CL cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Temporal relation extraction determines whether an event occurs before, after, or simultaneously with another event, and therefore relies on accurately modeling how the two events interact. Mainstream systems achieve this by concatenating event spans or using shallow fusion, which works well when all model parameters are trainable. However, in parameter-efficient fine-tuning, low-rank bottlenecks restrict information flow and prevent these interaction signals from passing through, leading to clear performance drops. To address this limitation, we propose a theoretically grounded architecture, Convolutional Bottleneck Interaction (CBI), which first applies lightweight depthwise convolution to enhance event representations and then uses element-wise multiplication to capture effective event-event interactions inside the bottleneck. Across five datasets and seven backbone models in the Adapter and LoRA settings, CBI provides consistent and substantial gains, up to +31.7 micro F1, while adding minimal computational cost, showing that explicit interaction inside low-rank spaces is crucial for temporal relation extraction. The code is available at https://github.com/VRCMF/CIF.git.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 22 of its 36 references that are in the map. First posted on arXiv 6 Sep 2026.

Builds on

22 of 36 references.

References · 22

  1. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
  2. 2018Deep contextualized word representationscited by 2,290
  3. 2021BitFit: Simple Parameter-efficient Fine-tuning for Transformer-based Masked Language-modelscited by 1,245
  4. 2020AdapterFusion: Non-Destructive Task Composition for Transfer Learningcited by 788
  5. 2018A Multi-Axis Annotation Scheme for Event Temporal Relationscited by 75
  6. 2019Joint Reasoning for Temporal and Causal Relationscited by 62
  7. 2021TIMEDIAL: Temporal Commonsense Reasoning in Dialogcited by 55
  8. 2023Zero-shot Temporal Relation Extraction with ChatGPTcited by 53
  9. 2023UniAdapter: Unified Parameter-Efficient Transfer Learning for Cross-modal Modelingcited by 40
  10. 2024Generating Long-form Story Using Dynamic Hierarchical Outlining with Memory-Enhancementcited by 30
  11. 2018Improving Temporal Relation Extraction with a Globally Acquired Statistical Resourcecited by 17
  12. 2023More than Classification: A Unified Framework for Event Temporal Relation Extractioncited by 15
10 more
  1. 2025Rethinking Safety in LLM Fine-tuning: An Optimization Perspectivecited by 14
  2. 2020Severing the Edge Between Before and After: Neural Architectures for Temporal Ordering of Eventscited by 12
  3. 2020A Survey on Temporal Reasoning for Temporal Information Extraction from Text (Extended Abstract)cited by 10
  4. 2018Temporal Event Knowledge Acquisition via Identifying Narrativescited by 6
  5. 2024Will LLMs Replace the Encoder-Only Models in Temporal Relation Classification?cited by 6
  6. 2024Introducing Routing Functions to Vision-Language Parameter-Efficient Fine-Tuning with Low-Rank Bottleneckscited by 4
  7. 2024A Wander Through the Multimodal Landscape: Efficient Transfer Learning via Low-rank Sequence Multimodal Adaptercited by 4
  8. 2025Temporal Relation Extraction in Clinical Texts: A Span-based Graph Transformer Approachcited by 4
  9. 2025Language Fusion for Parameter-Efficient Cross-lingual Transfercited by 3
  10. 2025GDLLM: A Global Distance-aware Modeling Approach Based on Large Language Models for Event Temporal Relation Extractioncited by 2

Built on by

Not cited yet.