DocVQA: A Dataset for VQA on Document Images
Not on the map. Why?
Cited by 657 in Multimodal LLMs / vision-language models, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
We present a new dataset for Visual Question Answering (VQA) on document images called DocVQA. The dataset consists of 50,000 questions defined on 12,000+ document images. Detailed analysis of the dataset in comparison with similar datasets for VQA and reading comprehension is presented. We report several baseline results by adopting existing VQA and reading comprehension models. Although the existing models perform reasonably well on certain types of questions, there is large performance gap compared to human performance (94.36% accuracy). The models need to improve specifically on questions where understanding structure of the document is crucial. The dataset, code and leaderboard are available at docvqa.org
Key facts. Cited by 1,317 papers in the map (data through 14 Oct 2026). First posted on arXiv 1 Jul 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 19; 2022: 31; 2023: 90; 2024: 282; 2025: 411; 2026: 484.
1,317 papers.
Sort:
By area:
- 2025Qwen3-VL Technical Reportcited by 2,793
- 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,719
- 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyondcited by 2,224
- 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,834
- 2025Gemma 3 Technical Reportcited by 1,824
- 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,510
- 2023MVBench: A Comprehensive Multi-modal Video Understanding Benchmarkcited by 1,109
- 2024How Far Are We to GPT-4V? Closing the Gap to Commercial Multimodal Models with Open-Source Suitescited by 1,050
- 2024Cambrian-1: A Fully Open, Vision-Centric Exploration of Multimodal LLMscited by 838
- 2023LLaMA-Adapter: Efficient Fine-tuning of Language Models with Zero-init Attentioncited by 781
- 2024Emu3: Next-Token Prediction is All You Needcited by 781
- 2025Qwen2.5-Omni Technical Reportcited by 736
38 more
- 2023CogAgent: A Visual Language Model for GUI Agentscited by 704
- 2025Vision-R1: Incentivizing Reasoning Capability in Multimodal Large Language Modelscited by 665
- 2023LLaMA-Adapter V2: Parameter-Efficient Visual Instruction Modelcited by 602
- 2025VideoLLaMA 3: Frontier Multimodal Foundation Models for Image and Video Understandingcited by 518
- 2024Long Context Transfer from Language to Visioncited by 515
- 2022LayoutLMv3: Pre-training for Document AI with Unified Text and Image Maskingcited by 485
- 2023OCRBench: On the Hidden Mystery of OCR in Large Multimodal Modelscited by 476
- 2024VLMEvalKit: An Open-Source Toolkit for Evaluating Large Multi-Modality Modelscited by 455
- 2024LLaVA-CoT: Let Vision Language Models Reason Step-by-Stepcited by 454
- 2021InfographicVQAcited by 437
- 2021OCR-free Document Understanding Transformercited by 407
- 2022Pix2Struct: Screenshot Parsing as Pretraining for Visual Language Understandingcited by 366
- 2024Mini-Gemini: Mining the Potential of Multi-modality Vision Language Modelscited by 365
- 2023Monkey: Image Resolution and Text Label Are Important Things for Large Multi-modal Modelscited by 357
- 2024LMMs-Eval: Reality Check on the Evaluation of Large Multimodal Modelscited by 353
- 2024Molmo and PixMo: Open Weights and Open Data for State-of-the-Art Vision-Language Modelscited by 329
- 2024What matters when building vision-language models?cited by 326
- 2025Perception Encoder: The best visual embeddings are not at the output of the networkcited by 326
- 2024SpatialRGPT: Grounded Spatial Reasoning in Vision Language Modelscited by 311
- 2024PyramidDrop: Accelerating Your Large Vision-Language Models via Pyramid Visual Redundancy Reductioncited by 294
- 2024MME-RealWorld: Could Your Multimodal LLM Challenge High-Resolution Real-World Scenarios that are Difficult for Humans?cited by 292
- 2024We-Math: Does Your Large Multimodal Model Achieve Human-like Mathematical Reasoning?cited by 286
- 2024Visual CoT: Advancing Multi-Modal Language Models with a Comprehensive Dataset and Benchmark for Chain-of-Thought Reasoningcited by 280
- 2024MM-LLMs: Recent Advances in MultiModal Large Language Modelscited by 278
- 2023LLaVAR: Enhanced Visual Instruction Tuning for Text-Rich Image Understandingcited by 274
- 2023PaLI-X: On Scaling up a Multilingual Vision and Language Modelcited by 255
- 2025LLaVA-OneVision-1.5: Fully Open Framework for Democratized Multimodal Trainingcited by 244
- 2024Enhancing the Reasoning Ability of Multimodal Large Language Models via Mixed Preference Optimizationcited by 239
- 2025SmolVLM: Redefining small and efficient multimodal modelscited by 237
- 2024MM1: Methods, Analysis & Insights from Multimodal LLM Pre-trainingcited by 232
- 2024VLM2Vec: Training Vision-Language Models for Massive Multimodal Embedding Taskscited by 228
- 2024mPLUG-DocOwl 1.5: Unified Structure Learning for OCR-free Document Understandingcited by 220
- 2023LVLM-eHub: A Comprehensive Evaluation Benchmark for Large Vision-Language Modelscited by 217
- 2024CogVLM2: Visual Language Models for Image and Video Understandingcited by 217
- 2024MANTIS: Interleaved Multi-Image Instruction Tuningcited by 216
- 2025SFT or RL? An Early Investigation into Training R1-Like Reasoning Large Vision-Language Modelscited by 212
- 2024NVILA: Efficient Frontier Visual Language Modelscited by 209
- 2024PaliGemma 2: A Family of Versatile VLMs for Transfercited by 207
50 most cited of 1,317 All 1,317 (JSON)
- 2026Read, Parse, Describe: Unified Document Parsing with Visual Element Description Generation14 Oct 2026
- 2026Beyond Static Cues: Unified Dynamic Detection of MLLM Backdoors via Dual-Flow Trajectory Analysis14 Oct 2026
- 2026ChemArgus: Automated Scientific Diagnostics for Lab-Grade Multimodal Chemistry Reasoning: A Frontier Benchmark14 Oct 2026
- 2026When Non-Adversarial Noise Hurts Learning: Benchmarking Skill Self-Evolution in Agents14 Oct 2026
- 2026LED-BENCH: A Benchmark for Large-format Engineering Drawing Understanding14 Oct 2026
- 2026ActICL: Post-Training for Agentic Multimodal In-Context Learning14 Oct 2026
- 2026Vision-Language Models Integrate Conflicting Evidence Like Biased Bayesian Observers14 Oct 2026
- 2026Just Respect the Semantics: Image-Token Compression via Pre-LLM Semantic Variable-Resolution Tokenization and In-LLM Relevance Pruning13 Oct 2026
- 2026Rethinking Projector Training in Multimodal LLMs13 Oct 2026
- 2026Bifocal: Training-Free Mixed Granularity Visual Token Pruning for Multimodal LLMs13 Oct 2026
- 2026TextualRL: Textual Reinforcement Learning for Context Management13 Oct 2026
- 2026DVTR-KD: Distilling Vision-Language Models via Intermediate Visual Token Reconstruction13 Oct 2026
38 more
- 2026VL-DocIR: A Benchmark for Vision-Based Long Document Information Retrieval12 Oct 2026
- 2026VAttnPO: Visual Attention-Guided Policy Optimization12 Oct 2026
- 2026Visually Legible but Adversarial: Watermark-Constrained Attacks on End-to-End VLMs for Document Understanding11 Oct 2026
- 2026Rethinking Supervision in Document Unwarping: A Self-consistent Flow-free Approach11 Oct 2026
- 2026LongHisDoc: A Comprehensive Benchmark for Chinese Long Historical Document Understanding10 Oct 2026
- 2026RealityBench: Simulated Environments to Evaluate a Vision Language Model's Ability to Document Human Physical Work9 Oct 2026
- 2026Do you "see" what I "see"? A Multi-panel Visual Question Answer Dataset for Large Language Model Chart Analysis9 Oct 2026
- 2026When MLLMs miss what humans read: diagnosing and learning to read squint text9 Oct 2026
- 2026SheafPrune: Sheaf-Guided Graph Propagation for Visual Token Pruning9 Oct 2026
- 2026SAGE: Efficient Protected Vision-Language Inference on Smart Glasses8 Oct 2026
- 2026Decide Before You Look: Learning Which Retrieved Memories Deserve Pixels6 Oct 2026
- 2026Byte Language Models: Scaling, Emergent Abstractions, and Information Allocation5 Oct 2026
- 2026A Strong Baseline for Evaluating Vision Encoders in Multimodal Large Language Models4 Oct 2026
- 2026Residual Visual Credit Optimization: Conserved Evidence Routing for Multimodal Reinforcement Learning4 Oct 2026
- 2026Learning to Decide, Not to Reason: Parameter-Efficient Decision Operators via Low-Rank Activation Steering3 Oct 2026
- 2026Found but Not Read: When Extracted Text Closes the Retrieval-Reading Gap in Document Vision-Language Models2 Oct 2026
- 2026Where-OPD: Spatially Guided On-Policy Self-Distillation of MLLMs with Synthetic Scenes1 Oct 2026
- 2026Walking the Embedding Space: Datastore Extraction from Multimodal RAG1 Oct 2026
- 2026SkillSpec: Consensus-Gated Agent Skill Evolution via Representation Specialization30 Sep 2026
- 2026HAWK: Rethinking Multimodal Drafting for Speculative Decoding30 Sep 2026
- 2026Evidence First, Arithmetic Second: A System Report and Failure Analysis for DocSem30 Sep 2026
- 2026Recovering Off-Policy Supervision for Speculative Decoding30 Sep 2026
- 2026EpiCon: Collective Agent Learning through Co-Evolving Multimodal Memory29 Sep 2026
- 2026PolyOCR-Venus: Unified OCR Foundation Models for Text-Centric Visual Intelligence29 Sep 2026
- 2026Hierarchical Compression of Vision-Language Model Benchmarks29 Sep 2026
- 2026SkillCome: Group Contrast Skill Optimization with Dual Memory29 Sep 2026
- 2026Momentum-Coupled Rubric Adaptation for Detailed Image Captioning29 Sep 2026
- 2026FocusVTC: Efficient and High-Performance Visual Text Compression with Adaptive Resolution29 Sep 2026
- 2026Xiaomi-OCR-0 Technical Report28 Sep 2026
- 2026SAGE: A Statistical Acceptance Gate for Self-Evolving Agents28 Sep 2026
- 2026How Far Are We from Removing the Visual Encoder? Scaling Laws for Encoder-Free Multimodal Pretraining28 Sep 2026
- 2026Beyond Selection: Token Parameterization for Extreme Visual Token Compression28 Sep 2026
- 2026SPIDER: Multi-Layer Semantic Token Pruning and Adaptive Sub-Layer Skipping in Multimodal Large Language Models28 Sep 2026
- 2026Resolution as a First-Class Decision: Task-Conditioned Routing for Efficient Multimodal Large Language Models28 Sep 2026
- 2026When Does an Image Determine the Answer? Benchmarking Visual Answerability across Charts and Scenes28 Sep 2026
- 2026MiCo: Mutual Information Coverage Optimization through Semantic Erasure Modeling for Efficient MLLM Inference28 Sep 2026
- 2026ConvCue: Complementary Visual Inductive Biases for Vision-Language Models28 Sep 2026
- 2026MoR-MLLM: Mixture of Recursions for Efficient Multimodal Large Language Models27 Sep 2026
50 newest of 1,317 All 1,317 (JSON)
- 2025Qwen3-VL Technical Reportcited by 2,793
- 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,719
- 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyondcited by 2,224
- 2023MVBench: A Comprehensive Multi-modal Video Understanding Benchmarkcited by 1,109
- 2024How Far Are We to GPT-4V? Closing the Gap to Commercial Multimodal Models with Open-Source Suitescited by 1,050
- 2024Cambrian-1: A Fully Open, Vision-Centric Exploration of Multimodal LLMscited by 838
- 2023CogAgent: A Visual Language Model for GUI Agentscited by 704
- 2024Long Context Transfer from Language to Visioncited by 515
- 2023OCRBench: On the Hidden Mystery of OCR in Large Multimodal Modelscited by 476
- 2024Mini-Gemini: Mining the Potential of Multi-modality Vision Language Modelscited by 365
- 2023Monkey: Image Resolution and Text Label Are Important Things for Large Multi-modal Modelscited by 357
- 2024LMMs-Eval: Reality Check on the Evaluation of Large Multimodal Modelscited by 353
12 most cited of 573 All 573 (JSON)
- 2026Beyond Static Cues: Unified Dynamic Detection of MLLM Backdoors via Dual-Flow Trajectory Analysis14 Oct 2026
- 2026ActICL: Post-Training for Agentic Multimodal In-Context Learning14 Oct 2026
- 2026Vision-Language Models Integrate Conflicting Evidence Like Biased Bayesian Observers14 Oct 2026
- 2026Bifocal: Training-Free Mixed Granularity Visual Token Pruning for Multimodal LLMs13 Oct 2026
- 2026DVTR-KD: Distilling Vision-Language Models via Intermediate Visual Token Reconstruction13 Oct 2026
- 2026RealityBench: Simulated Environments to Evaluate a Vision Language Model's Ability to Document Human Physical Work9 Oct 2026
- 2026When MLLMs miss what humans read: diagnosing and learning to read squint text9 Oct 2026
- 2026SheafPrune: Sheaf-Guided Graph Propagation for Visual Token Pruning9 Oct 2026
- 2026A Strong Baseline for Evaluating Vision Encoders in Multimodal Large Language Models4 Oct 2026
- 2026Found but Not Read: When Extracted Text Closes the Retrieval-Reading Gap in Document Vision-Language Models2 Oct 2026
- 2026Walking the Embedding Space: Datastore Extraction from Multimodal RAG1 Oct 2026
- 2026Hierarchical Compression of Vision-Language Model Benchmarks29 Sep 2026
12 newest of 573 All 573 (JSON)
- 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,510
- 2025Qwen2.5-Omni Technical Reportcited by 736
- 2025Vision-R1: Incentivizing Reasoning Capability in Multimodal Large Language Modelscited by 665
- 2023LLaMA-Adapter V2: Parameter-Efficient Visual Instruction Modelcited by 602
- 2024LLaVA-CoT: Let Vision Language Models Reason Step-by-Stepcited by 454
- 2024SpatialRGPT: Grounded Spatial Reasoning in Vision Language Modelscited by 311
- 2024We-Math: Does Your Large Multimodal Model Achieve Human-like Mathematical Reasoning?cited by 286
- 2024Visual CoT: Advancing Multi-Modal Language Models with a Comprehensive Dataset and Benchmark for Chain-of-Thought Reasoningcited by 280
- 2024Enhancing the Reasoning Ability of Multimodal Large Language Models via Mixed Preference Optimizationcited by 239
- 2025SFT or RL? An Early Investigation into Training R1-Like Reasoning Large Vision-Language Modelscited by 212
- 2024Mulberry: Empowering MLLM with o1-like Reasoning and Reflection via Collective Monte Carlo Tree Searchcited by 175
- 2025LlamaV-o1: Rethinking Step-by-step Visual Reasoning in LLMscited by 147
12 most cited of 136 All 136 (JSON)
- 2026ChemArgus: Automated Scientific Diagnostics for Lab-Grade Multimodal Chemistry Reasoning: A Frontier Benchmark14 Oct 2026
- 2026Rethinking Projector Training in Multimodal LLMs13 Oct 2026
- 2026Residual Visual Credit Optimization: Conserved Evidence Routing for Multimodal Reinforcement Learning4 Oct 2026
- 2026Learning to Decide, Not to Reason: Parameter-Efficient Decision Operators via Low-Rank Activation Steering3 Oct 2026
- 2026HAWK: Rethinking Multimodal Drafting for Speculative Decoding30 Sep 2026
- 2026FocusVTC: Efficient and High-Performance Visual Text Compression with Adaptive Resolution29 Sep 2026
- 2026MoR-MLLM: Mixture of Recursions for Efficient Multimodal Large Language Models27 Sep 2026
- 2026MM-OPD: Towards One More Bottleneck Between Perception and Reasoning26 Sep 2026
- 2026Grounded and Faithful P&ID Reasoning: Constraining Vision-Language Models with Recovered Evidence Graphs5 Sep 2026
- 2026OCR-MetaReasoning Benchmark: Evaluating the Meta-Reasoning Ability of MLLMs in Text-Rich Image Understanding31 Aug 2026
- 2026PACE: A Unified Condense-and-Extract Paradigm for Fast VLM Inference27 Aug 2026
- 2026SCAFFOLD: A Large-Scale Structured Dataset of Computer Science Research Figures with Diagram QA and Chain-of-Thought Reasoning Traces20 Aug 2026
12 newest of 136 All 136 (JSON)
- 2026Trace2Skill: Distill Trajectory-Local Lessons into Transferable Agent Skillscited by 187
- 2026SkillOpt: Executive Strategy for Self-Evolving Agent Skillscited by 148
- 2024InfiAgent-DABench: Evaluating Agents on Data Analysis Taskscited by 140
- 2025Magma: A Foundation Model for Multimodal AI Agentscited by 139
- 2025Scaling Computer-Use Grounding via User Interface Decomposition and Synthesiscited by 139
- 2024OfficeBench: Benchmarking Language Agents across Multiple Applications for Office Automationcited by 70
- 2025MM-BrowseComp: A Comprehensive Benchmark for Multimodal Browsing Agentscited by 42
- 2026MMDeepResearch-Bench: A Benchmark for Multimodal Deep Research Agentscited by 22
- 2026SkillOpt-Lite: Better and Faster Agent Self-evolution via One Line of Vibecited by 20
- 2025SpiritSight Agent: Advanced GUI Agent with One Lookcited by 18
- 2025Resolving Evidence Sparsity: Agentic Context Engineering for Long-Document Understandingcited by 18
- 2026HY-Embodied-0.5: Embodied Foundation Models for Real-World Agentscited by 18
12 most cited of 41 All 41 (JSON)
- 2026When Non-Adversarial Noise Hurts Learning: Benchmarking Skill Self-Evolution in Agents14 Oct 2026
- 2026TextualRL: Textual Reinforcement Learning for Context Management13 Oct 2026
- 2026SkillSpec: Consensus-Gated Agent Skill Evolution via Representation Specialization30 Sep 2026
- 2026SAGE: A Statistical Acceptance Gate for Self-Evolving Agents28 Sep 2026
- 2026GraphSkillEvo: Evolutionary Optimization of Graph-Structured Agent Skills18 Sep 2026
- 2026A Unified Evaluation Framework for Trustworthy Large Language Models, Agentic AI, and Multimodal Systems17 Sep 2026
- 2026COBRA-Skills: Contextual Bandit-Guided Evolution for Agent Skill Optimization10 Sep 2026
- 2026Mr.LHDR: A Benchmark for Multimodal Real-World Long-Horizon Deep Research Agents10 Sep 2026
- 2026LLaDA-UI: Bringing Block-wise Diffusion to Vision-Language GUI Agents9 Sep 2026
- 2026SkillAdam: Stable and Efficient Skill Evolution for Agents8 Sep 2026
- 2026WorldBench: Culturally Grounded Benchmark for Multilingual Agents1 Sep 2026
- 2026PPTBench: Can Coding Agents Reconstruct the Visual World through Structured, Editable Slides31 Aug 2026
12 newest of 41 All 41 (JSON)
- 2024M3DocRAG: Multi-modal Retrieval is What You Need for Multi-page Multi-document Understandingcited by 111
- 2025ViDoRAG: Visual Document Retrieval-Augmented Generation via Dynamic Iterative Reasoning Agentscited by 66
- 2025VDocRAG: Retrieval-Augmented Generation over Visually-Rich Documentscited by 59
- 2025Ask in Any Modality: A Comprehensive Survey on Multimodal Retrieval-Augmented Generationcited by 42
- 2024VisDoM: Multi-Document QA with Visually Rich Elements Using Multimodal Retrieval-Augmented Generationcited by 41
- 2024UDA: A Benchmark Suite for Retrieval Augmented Generation in Real-world Document Analysiscited by 40
- 2025Benchmarking Retrieval-Augmented Multimodal Generation for Document Question Answeringcited by 36
- 2025REAL-MM-RAG: A Real-World Multi-Modal Retrieval Benchmarkcited by 35
- 2025Retrieval Augmented Generation and Understanding in Vision: A Survey and New Outlookcited by 32
- 2026ViDoRe V3: A Comprehensive Evaluation of Retrieval Augmented Generation in Complex Real-World Scenarioscited by 26
- 2025UNIDOC-BENCH: A Unified Benchmark for Document-Centric Multimodal RAGcited by 21
- 2025UniversalRAG: Retrieval-Augmented Generation over Corpora of Diverse Modalities and Granularitiescited by 20
12 most cited of 33 All 33 (JSON)
- 2026Document Retrieval-Aware Chunking (D-RAC): Universal Retrieval-Aware Ingestion of Enterprise Documents via PDF Normalization and Multimodal Markdown Conversion21 Sep 2026
- 2026Doc-REFRAG: Rethinking Multimodal Document Retrieval-Augmented Generation31 Aug 2026
- 2026ConceptFormer: Learning Adaptive Latent Concepts for Query-Document Alignment in Visual Document Retrieval16 Aug 2026
- 2026Does More Retrieved Evidence Help Visual Retrieval-Augmented Generation with Diffusion Language Models?7 Aug 2026
- 2026DeCoRAG: Cognitive Decoupling and Semantic-Aware Cropping for Complex Document Understanding27 Jul 2026
- 2026HC-RAG: Evidence-Centric Retrieval-Augmented Generation over Heterogeneous Financial Filings3 Jun 2026
- 2026CHaystack: Benchmarking Chinese Document Retrieval and VQA30 May 2026
- 2026StateRAG: Typed State Contracts for Complex Retrieval-Augmented Generation25 May 2026
- 2026Lightweight and Production-Ready PDF Visual Element Parsing25 Apr 2026
- 2026LFRAG: Layout-oriented Fine-grained Retrieval-Augmented Generation on Multimodal Document Understanding18 Apr 2026
- 2026ViDoRe V3: A Comprehensive Evaluation of Retrieval Augmented Generation in Complex Real-World Scenarios13 Jan 2026
- 2026Web Retrieval-Aware Chunking (W-RAC) for Efficient and Cost-Effective Retrieval-Augmented Generation Systems8 Jan 2026
12 newest of 33 All 33 (JSON)
- 2025Towards Storage-Efficient Visual Document Retrieval: An Empirical Study on Reducing Patch-Level Embeddingscited by 26
- 2025When Token Pruning is Worse than Random: Understanding Visual Token Information in VLLMscited by 12
- 2023DEED: Dynamic Early Exit on Decoder for Accelerating Encoder-Decoder Transformer Modelscited by 7
- 2026OScaR: The Occam's Razor for Extreme KV Cache Quantization in LLMs and Beyondcited by 5
- 2025When Less is Enough: Adaptive Token Reduction for Efficient Image Representationcited by 2
- 2026Combating Textual Noise and Redundancy: Entropy-Aware Dense Visual Token Pruningcited by 2
- 2026Do All Visual Tokens Matter Equally? Object-Evidence Preserving Token Merging for Vision-Language Retrievalcited by 2
- 2026Not All Visual Tokens Are Equally Safe to Remove:Consequence-Sensitive Visual Token Compressioncited by 2
- 2026TABED: Test-Time Adaptive Ensemble Drafting for Robust Speculative Decoding in LVLMscited by 1
- 2026On the Design Fundamentals of Pixel Text Representation Learningcited by 1
- 2026LAST: The Last Query Token Guides Visual Token Pruning for Edge-Cloud Collaborative MLLM Inferencecited by 0
- 2026Beyond Accuracy: Auditing Spatial Provenance in Visual Token Pruning for OCR-Critical MLLM Inferencecited by 0
12 most cited of 14 All 14 (JSON)
- 2026Just Respect the Semantics: Image-Token Compression via Pre-LLM Semantic Variable-Resolution Tokenization and In-LLM Relevance Pruning13 Oct 2026
- 2026Recovering Off-Policy Supervision for Speculative Decoding30 Sep 2026
- 2026On the Design Fundamentals of Pixel Text Representation Learning1 Sep 2026
- 2026Not All Visual Tokens Are Equally Safe to Remove:Consequence-Sensitive Visual Token Compression10 Aug 2026
- 2026LAST: The Last Query Token Guides Visual Token Pruning for Edge-Cloud Collaborative MLLM Inference30 Jul 2026
- 2026Beyond Accuracy: Auditing Spatial Provenance in Visual Token Pruning for OCR-Critical MLLM Inference29 Jul 2026
- 2026Do All Visual Tokens Matter Equally? Object-Evidence Preserving Token Merging for Vision-Language Retrieval6 Jul 2026
- 2026Combating Textual Noise and Redundancy: Entropy-Aware Dense Visual Token Pruning2 Jul 2026
- 2026OScaR: The Occam's Razor for Extreme KV Cache Quantization in LLMs and Beyond19 May 2026
- 2026TABED: Test-Time Adaptive Ensemble Drafting for Robust Speculative Decoding in LVLMs28 Jan 2026
- 2025When Token Pruning is Worse than Random: Understanding Visual Token Information in VLLMs8 Dec 2025
- 2025Towards Storage-Efficient Visual Document Retrieval: An Empirical Study on Reducing Patch-Level Embeddings5 Jun 2025
12 newest of 14 All 14 (JSON)
- 2025OneCAT: Decoder-Only Auto-Regressive Model for Unified Understanding and Generationcited by 50
- 2026Beyond Language Modeling: An Exploration of Multimodal Pretrainingcited by 37
- 2025LongCat-Flash-Omni Technical Reportcited by 26
- 2025Ming-Flash-Omni: A Sparse, Unified Architecture for Multimodal Perception and Generationcited by 22
- 2025Uni-MoE-2.0-Omni: Scaling Language-Centric Omnimodal Large Model with Advanced MoE, Training and Datacited by 21
- 2026ERNIE 5.0 Technical Reportcited by 11
- 2025MoPEQ: Mixture of Mixed Precision Quantized Expertscited by 5
- 2026Improving MoE Compute Efficiency by Composing Weight and Data Sparsitycited by 1
- 2026ReaLB: Real-Time Load Balancing for Multimodal MoE Inferencecited by 1
- 2026VEN-VL: A Visual Ensemble MoE Framework for Effective and Efficient Multi-Modal Understandingcited by 0
- 2026VEN-VL: A Visual Ensemble MoE Framework for Effective and Efficient Multi-Modal Understanding25 May 2026
- 2026ReaLB: Real-Time Load Balancing for Multimodal MoE Inference21 Apr 2026
- 2026Beyond Language Modeling: An Exploration of Multimodal Pretraining3 Mar 2026
- 2026ERNIE 5.0 Technical Report4 Feb 2026
- 2026Improving MoE Compute Efficiency by Composing Weight and Data Sparsity21 Jan 2026
- 2025Uni-MoE-2.0-Omni: Scaling Language-Centric Omnimodal Large Model with Advanced MoE, Training and Data16 Nov 2025
- 2025LongCat-Flash-Omni Technical Report31 Oct 2025
- 2025Ming-Flash-Omni: A Sparse, Unified Architecture for Multimodal Perception and Generation28 Oct 2025
- 2025OneCAT: Decoder-Only Auto-Regressive Model for Unified Understanding and Generation3 Sep 2025
- 2025MoPEQ: Mixture of Mixed Precision Quantized Experts2 Sep 2025
- 2024Emu3: Next-Token Prediction is All You Needcited by 781
- 2025Lavida-O: Elastic Large Masked Diffusion Models for Unified Multimodal Understanding and Generationcited by 15
- 2026LLaDA2.0-Uni: Unifying Multimodal Understanding and Generation with Diffusion Large Language Modelcited by 13
- 2026LLaDA-o: An Effective and Length-Adaptive Omni Diffusion Modelcited by 10
- 2025Sparse-LaViDa: Sparse Multimodal Discrete Diffusion Language Modelscited by 6
- 2026DODO: Discrete OCR Diffusion Modelscited by 2
- 2026Efficient Long-Context Modeling in Diffusion Language Models via Block Approximate Sparse Attentioncited by 1
- 2026Efficient Long-Context Modeling in Diffusion Language Models via Block Approximate Sparse Attention19 May 2026
- 2026LLaDA2.0-Uni: Unifying Multimodal Understanding and Generation with Diffusion Large Language Model22 Apr 2026
- 2026LLaDA-o: An Effective and Length-Adaptive Omni Diffusion Model1 Mar 2026
- 2026DODO: Discrete OCR Diffusion Models18 Feb 2026
- 2025Sparse-LaViDa: Sparse Multimodal Discrete Diffusion Language Models16 Dec 2025
- 2025Lavida-O: Elastic Large Masked Diffusion Models for Unified Multimodal Understanding and Generation23 Sep 2025
- 2024Emu3: Next-Token Prediction is All You Need27 Sep 2024
- 2025MoLoRAG: Bootstrapping Document Understanding via Multi-modal Logic-aware Retrievalcited by 17
- 2024VQA Training Sets are Self-play Environments for Generating Few-shot Poolscited by 1
- 2025A-SEA3L-QA: A Fully Automated Self-Evolving, Adversarial Workflow for Arabic Long-Context Question-Answer Generationcited by 0
- 2026SPARK: Self-Play with Asymmetric Reward from Knowledge Graphscited by 0
- 2026PRISM: Priority-aware Rubric Internalization via Structured Multimodal Data Synthesiscited by 0
- 2026StraTune: Adaptive Selection of Revision Operators for Self-Evolving LLM Skillscited by 0
- 2026StraTune: Adaptive Selection of Revision Operators for Self-Evolving LLM Skills26 Sep 2026
- 2026PRISM: Priority-aware Rubric Internalization via Structured Multimodal Data Synthesis5 Aug 2026
- 2026SPARK: Self-Play with Asymmetric Reward from Knowledge Graphs7 May 2026
- 2025MoLoRAG: Bootstrapping Document Understanding via Multi-modal Logic-aware Retrieval6 Sep 2025
- 2025A-SEA3L-QA: A Fully Automated Self-Evolving, Adversarial Workflow for Arabic Long-Context Question-Answer Generation2 Sep 2025
- 2024VQA Training Sets are Self-play Environments for Generating Few-shot Pools30 May 2024
- 2024VideoSAVi: Self-Aligned Video Language Models without Human Supervisioncited by 7
- 2026FocalOrder: Focal Preference Optimization for Reading Order Detectioncited by 1
- 2026TMS: Trajectory-Mixed Supervision for Reward-Free, On-Policy SFTcited by 1
- 2026Data-DPO: Direct Preference Optimization for Target Model Data Selection in LLM Post-Trainingcited by 0
- 2026Data-DPO: Direct Preference Optimization for Target Model Data Selection in LLM Post-Training5 Aug 2026
- 2026TMS: Trajectory-Mixed Supervision for Reward-Free, On-Policy SFT3 Feb 2026
- 2026FocalOrder: Focal Preference Optimization for Reading Order Detection12 Jan 2026
- 2024VideoSAVi: Self-Aligned Video Language Models without Human Supervision1 Dec 2024
- 2026Uni-OPD: Unifying On-Policy Distillation with a Dual-Perspective Recipecited by 49
- 2024DocKD: Knowledge Distillation from LLMs for Open-World Document Understanding Modelscited by 3
- 2024DistilDoc: Knowledge Distillation for Visually-Rich Document Applicationscited by 1
- 2026Where-OPD: Spatially Guided On-Policy Self-Distillation of MLLMs with Synthetic Scenescited by 0
- 2026Where-OPD: Spatially Guided On-Policy Self-Distillation of MLLMs with Synthetic Scenes1 Oct 2026
- 2026Uni-OPD: Unifying On-Policy Distillation with a Dual-Perspective Recipe5 May 2026
- 2024DocKD: Knowledge Distillation from LLMs for Open-World Document Understanding Models4 Oct 2024
- 2024DistilDoc: Knowledge Distillation for Visually-Rich Document Applications12 Jun 2024
- 2026Not All Tokens Are Equal: Region-Aware Consistency Repair of Backdoors in MLLMscited by 0
- 2026Nemotron 3.5 Content Safety Moderator: A Compact Multimodal, Multilingual, and Reasoning Enabled Content Safety Moderatorcited by 0
- 2026Repeat-After-Me: Black-Box Adaptive Visual Prompt Injectioncited by 0
- 2026Repeat-After-Me: Black-Box Adaptive Visual Prompt Injection3 Sep 2026
- 2026Nemotron 3.5 Content Safety Moderator: A Compact Multimodal, Multilingual, and Reasoning Enabled Content Safety Moderator27 Aug 2026
- 2026Not All Tokens Are Equal: Region-Aware Consistency Repair of Backdoors in MLLMs25 Aug 2026
- 2025ChatVLA: Unified Multimodal Understanding and Robot Control with Vision-Language-Action Modelcited by 113
- 2026Scaling by Diversified Experience for Vision-Language-Action Modelscited by 0
- 2026Does VLA Even Know the Basics? Measuring Commonsense and World Knowledge Retention in Vision-Language-Action Modelscited by 0
- 2026Does VLA Even Know the Basics? Measuring Commonsense and World Knowledge Retention in Vision-Language-Action Models17 Jun 2026
- 2026Scaling by Diversified Experience for Vision-Language-Action Models8 Jun 2026
- 2025ChatVLA: Unified Multimodal Understanding and Robot Control with Vision-Language-Action Model20 Feb 2025
- 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,834
- 2025Gemma 3 Technical Reportcited by 1,824
- 2023LLaMA-Adapter: Efficient Fine-tuning of Language Models with Zero-init Attentioncited by 781
- 2025VideoLLaMA 3: Frontier Multimodal Foundation Models for Image and Video Understandingcited by 518
- 2022LayoutLMv3: Pre-training for Document AI with Unified Text and Image Maskingcited by 485
- 2024VLMEvalKit: An Open-Source Toolkit for Evaluating Large Multi-Modality Modelscited by 455
- 2021InfographicVQAcited by 437
- 2021OCR-free Document Understanding Transformercited by 407
- 2022Pix2Struct: Screenshot Parsing as Pretraining for Visual Language Understandingcited by 366
- 2025Perception Encoder: The best visual embeddings are not at the output of the networkcited by 326
- 2023LLaVAR: Enhanced Visual Instruction Tuning for Text-Rich Image Understandingcited by 274
- 2023PaLI-X: On Scaling up a Multilingual Vision and Language Modelcited by 255
12 most cited of 479 All 479 (JSON)
- 2026Read, Parse, Describe: Unified Document Parsing with Visual Element Description Generation14 Oct 2026
- 2026LED-BENCH: A Benchmark for Large-format Engineering Drawing Understanding14 Oct 2026
- 2026VL-DocIR: A Benchmark for Vision-Based Long Document Information Retrieval12 Oct 2026
- 2026VAttnPO: Visual Attention-Guided Policy Optimization12 Oct 2026
- 2026Visually Legible but Adversarial: Watermark-Constrained Attacks on End-to-End VLMs for Document Understanding11 Oct 2026
- 2026Rethinking Supervision in Document Unwarping: A Self-consistent Flow-free Approach11 Oct 2026
- 2026LongHisDoc: A Comprehensive Benchmark for Chinese Long Historical Document Understanding10 Oct 2026
- 2026Do you "see" what I "see"? A Multi-panel Visual Question Answer Dataset for Large Language Model Chart Analysis9 Oct 2026
- 2026SAGE: Efficient Protected Vision-Language Inference on Smart Glasses8 Oct 2026
- 2026Decide Before You Look: Learning Which Retrieved Memories Deserve Pixels6 Oct 2026
- 2026Byte Language Models: Scaling, Emergent Abstractions, and Information Allocation5 Oct 2026
- 2026Evidence First, Arithmetic Second: A System Report and Failure Analysis for DocSem30 Sep 2026
12 newest of 479 All 479 (JSON)