BiMind: A Dual-Head Reasoning Model with Attention-Geometry Adapter for Incorrect Information Detection
On the map: LLM reasoning → Test-time compute and efficient thinking
Abstract (arXiv)
Incorrect information poses significant challenges by disrupting content veracity and integrity, yet most detection approaches struggle to jointly balance textual content verification with external knowledge modification under collapsed attention geometries. To address this issue, we propose a dual-head reasoning framework, BiMind, which disentangles content-internal reasoning from knowledge-augmented reasoning. In BiMind, we introduce three core innovations: (i) an attention geometry adapter that reshapes attention logits via token-conditioned offsets and mitigates attention collapse; (ii) a self-retrieval knowledge mechanism, which constructs an in-domain semantic memory through kNN retrieval and injects retrieved neighbors via feature-wise linear modulation; (iii) the uncertainty-aware fusion strategies, including entropy-gated fusion and a trainable agreement head, stabilized by a symmetric Kullback-Leibler agreement regularizer. To quantify the knowledge contributions, we define a novel metric, Value-of-eXperience (VoX), to measure instance-wise logit gains from knowledge-augmented reasoning. Experiment results on public datasets demonstrate that our BiMind model outperforms advanced detection approaches and provides interpretable diagnostics on when and why knowledge matters.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. Builds on 9 of its 72 references that are in the map. First posted on arXiv 7 Apr 2026.
Builds on
9 of 72 references.
References · 9
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
- 2020DeBERTa: Decoding-enhanced BERT with Disentangled Attentioncited by 2,181
- 2018Graph Convolutional Networks for Text Classificationcited by 345
- 2020MM-COVID: A Multilingual and Multimodal Data Repository for Combating COVID-19 Disinformationcited by 37
- 2019Network-based Fake News Detection: A Pattern-driven Approachcited by 33
- 2025Contextual Integrity in LLMs via Reasoning and Reinforcement Learningcited by 31
- 2021Explainable Tsetlin Machine framework for fake news detection with credibility score assessmentcited by 23
- 2022Combining Machine Learning with Knowledge Engineering to detect Fake News in Social Networks-a surveycited by 4
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025Attention Reveals More Than Tokens: Training-Free Long-Context Reasoning with Attention-guided Retrieval
- 2026Through the Bottleneck: How Multi-head Latent Attention Separates Content from Position in Language Models
- 2026Retrieval-Infused Reasoning Sandbox: A Benchmark for Decoupling Retrieval and Reasoning Capabilities
- 2025Semantic Integrity Matters: Benchmarking and Preserving High-Density Reasoning in KV Cache Compression
- 2026Decoupled Reasoning with Implicit Fact Tokens (DRIFT): A Dual-Model Framework for Efficient Long-Context Inference
- 2026When to Retrieve During Reasoning: Adaptive Retrieval for Large Reasoning Models
- 2024Not All Heads Matter: A Head-Level KV Cache Compression Method with Integrated Retrieval and Reasoning
- 2026VERA: Identifying and Leveraging Visual Evidence Retrieval Heads in Long-Context Understanding