mlsanityData to 7 Oct 2026

ALDEN: Reinforcement Learning for Active Navigation and Evidence Gathering in Long Documents

arXiv 2510.25668 ↗First posted 29 Oct 2025cs.AI cs.MMcited by 2

On the map: Multimodal LLMs / vision-language models → Document understanding and multimodal RAG

Abstract (arXiv)

Vision-language models (VLMs) excel at interpreting text-rich images but struggle with long, visually complex documents that demand analysis and integration of information spread across multiple pages. Existing approaches typically rely on fixed reasoning templates or rigid pipelines, which force VLMs into a passive role and hinder both efficiency and generalization. We present Active Long-DocumEnt Navigation (ALDEN), a multi-turn reinforcement learning framework that fine-tunes VLMs as interactive agents capable of actively navigating long, visually rich documents. ALDEN introduces a novel fetch action that directly accesses the page by index, complementing the classic search action and better exploiting document structure. For dense process supervision and efficient training, we propose a rule-based cross-level reward that provides both turn- and token-level signals. To address the empirically observed training instability caused by numerous visual tokens from long documents, we further propose a visual-semantic anchoring mechanism that applies a dual-path KL-divergence constraint to stabilize visual and textual representations separately during training. Trained on a corpus constructed from three open-source datasets, ALDEN achieves state-of-the-art performance on five long-document benchmarks. Overall, ALDEN marks a step beyond passive document reading toward agents that autonomously navigate and reason across long, visually rich documents, offering a robust path to more accurate and efficient long-document understanding.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Document understanding and multimodal RAG, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 43 of its 45 references that are in the map. First posted on arXiv 29 Oct 2025.

Builds on

43 of 45 references.

Closest ancestors · 6

Same direction, newest first

  1. 2024LongDocURL: a Comprehensive Multimodal Long Document Benchmark Integrating Understanding, Reasoning, and Locating24 Dec
  2. 2024SV-RAG: LoRA-Contextualizing Adaptation of MLLMs for Long Document Understanding2 Nov
  3. 2024PDF-WuKong: A Large Multimodal Model for Efficient Long PDF Reading with End-to-End Sparse Sampling8 Oct
  4. 2024ColPali: Efficient Document Retrieval with Vision Language Models27 Jun
  5. 2024TextMonkey: An OCR-Free Large Multimodal Model for Understanding Document7 Mar
  6. 2023DocPedia: Unleashing the Power of Large Multimodal Model in the Frequency Domain for Versatile Document Understanding20 Nov

Other references · 37

  1. 2022Training language models to follow instructions with human feedbackcited by 15,712
  2. 2017Proximal Policy Optimization Algorithmscited by 14,441
  3. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  4. 2025Qwen2.5-VL Technical Reportcited by 5,418
  5. 2024GPT-4o System Cardcited by 4,467
  6. 2023Improved Baselines with Visual Instruction Tuningcited by 4,362
  7. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
  8. 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,669
  9. 2015High-Dimensional Continuous Control Using Generalized Advantage Estimationcited by 1,916
  10. 2022ChartQA: A Benchmark for Question Answering about Charts with Visual and Logical Reasoningcited by 1,449
  11. 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,419
  12. 2025Search-R1: Training LLMs to Reason and Leverage Search Engines with Reinforcement Learningcited by 1,371
25 more
  1. 2020DocVQA: A Dataset for VQA on Document Imagescited by 1,288
  2. 2022Text Embeddings by Weakly-Supervised Contrastive Pre-trainingcited by 1,216
  3. 2024Phi-4 Technical Reportcited by 675
  4. 2021ColBERTv2: Effective and Efficient Retrieval via Lightweight Late Interactioncited by 464
  5. 2021InfographicVQAcited by 430
  6. 2025R1-Searcher: Incentivizing the Search Capability in LLMs via Reinforcement Learningcited by 322
  7. 2025SmolVLM: Redefining small and efficient multimodal modelscited by 226
  8. 2024ArCHer: Training Language Model Agents via Hierarchical Multi-Turn RLcited by 212
  9. 2023SlideVQA: A Dataset for Document Visual Question Answering on Multiple Imagescited by 175
  10. 2024MMLongBench-Doc: Benchmarking Long-context Document Understanding with Visualizationscited by 174
  11. 2023Document Understanding Dataset and Evaluation (DUDE)cited by 132
  12. 2024mPLUG-DocOwl2: High-resolution Compressing for OCR-free Multi-page Document Understandingcited by 113
  13. 2024M3DocRAG: Multi-modal Retrieval is What You Need for Multi-page Multi-document Understandingcited by 110
  14. 2024Unifying Multimodal Retrieval via Document Screenshot Embeddingcited by 107
  15. 2022Hierarchical multimodal transformers for Multi-Page DocVQAcited by 102
  16. 2023KOSMOS-2.5: A Multimodal Literate Modelcited by 95
  17. 2025MDocAgent: A Multi-Modal Multi-Agent Framework for Document Understandingcited by 66
  18. 2025ViDoRAG: Visual Document Retrieval-Augmented Generation via Dynamic Iterative Reasoning Agentscited by 64
  19. 2024UDA: A Benchmark Suite for Retrieval Augmented Generation in Real-world Document Analysiscited by 40
  20. 2022VRDU: A Benchmark for Visually-rich Document Understandingcited by 35
  21. 2024SceMQA: A Scientific College Entrance Level Multimodal Question Answering Benchmarkcited by 35
  22. 2024GRAM: Global Reasoning for Multi-Page VQAcited by 23
  23. 2022V-Doc : Visual questions answers with Documentscited by 19
  24. 2024Leopard: A Vision Language Model For Text-Rich Multi-Image Taskscited by 18
  25. 2024Deep Learning based Key Information Extraction from Business Documents: Systematic Literature Reviewcited by 6

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026MM-Doc-R1: Training Agents for Long Document Visual Question Answering through Multi-turn Reinforcement Learning
  2. 2025DocR1: Evidence Page-Guided GRPO for Multi-Page Document Understanding
  3. 2025SCoPE VLM: Selective Context Processing for Efficient Document Navigation in Vision-Language Models
  4. 2026DocAtlas: Long-Document Understanding as Mutable-State Interaction
  5. 2025Resolving Evidence Sparsity: Agentic Context Engineering for Long-Document Understanding
  6. 2026Visual-Seeker: Towards Visual-Native Multimodal Agentic Search via Active Visual Reasoning
  7. 2025Look as You Think: Unifying Reasoning and Visual Evidence Attribution for Verifiable Document RAG via Reinforcement Learning
  8. 2025DocLens : A Tool-Augmented Multi-Agent Framework for Long Visual Document Understanding