FocusVTC: Efficient and High-Performance Visual Text Compression with Adaptive Resolution
On the map: LLM reasoning → Multimodal reasoning
Abstract (arXiv)
Long-context reasoning in large language models incurs substantial computation and memory costs. Visual text compression (VTC) reduces input length by rendering text as images, but fixed-resolution rendering creates a compression-performance trade-off: low DPI saves tokens at the expense of legibility, whereas high DPI spends tokens on irrelevant content. We introduce FocusVTC, which breaks this trade-off through adaptive resolution while preserving general multimodal capabilities. It combines compressed low-DPI global views with selective region enhancement, integrating enhanced views into ongoing reasoning. We construct 29.4K high-quality Reasoning-Evidence Localization (REL) chain-of-thought examples (REL-CoT) that link reasoning traces to page indices and bounding boxes. Multi-resolution REL supervised fine-tuning (REL-SFT) teaches the model to localize relevant regions, and Group Relative Policy Optimization learns when to enhance resolution and how to use the resulting observations, without a separate continual-pretraining stage. At 72 DPI on RULER v1, FocusVTC scores 87.4 at 2.9× input compression, including tool observations, versus 57.5 for Glyph at 3.0× input compression. It surpasses its text-input backbone on LongBench (56.40 versus 55.86), improves the MRCR macro-average by 13.91 points, and achieves a 51.19 macro-average on VTCBench. The MRCR latency evaluation also shows a 2.79× online end-to-end speedup over Text. General multimodal capabilities are preserved, with MMMU increasing from 65.12 to 66.73 and MME from 2424.02 to 2457.62.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 41 of its 48 references that are in the map. First posted on arXiv 29 Sep 2026.
Builds on
41 of 48 references.
Closest ancestors · 5
Same direction, newest first
- 2026SEER: Long-Context Reasoning via Selective Visual-Text Compression16 Aug
- 2026VTC-R1: Vision-Text Compression for Efficient Long-Context Reasoning29 Jan
- 2025DocVAL: Validated Chain-of-Thought Distillation for Grounded Document VQA27 Nov
- 2025DeepEyes: Incentivizing "Thinking with Images" via Reinforcement Learning20 May
- 2022ChartQA: A Benchmark for Question Answering about Charts with Visual and Logical Reasoning19 Mar
Other references · 36
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2025Qwen3 Technical Reportcited by 8,820
- 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,944
- 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,754
- 2022FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenesscited by 3,673
- 2017TriviaQA: A Large Scale Distantly Supervised Challenge Dataset for Reading Comprehensioncited by 2,955
- 2025Qwen3-VL Technical Reportcited by 2,793
- 2023MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGIcited by 2,080
- 2023MME: A Comprehensive Evaluation Benchmark for Multimodal Large Language Modelscited by 1,652
- 2023LongBench: A Bilingual, Multitask Benchmark for Long Context Understandingcited by 1,417
24 more
- 2024RULER: What's the Real Context Size of Your Long-Context Language Models?cited by 1,346
- 2020DocVQA: A Dataset for VQA on Document Imagescited by 1,317
- 2020Constructing A Multi-hop QA Dataset for Comprehensive Evaluation of Reasoning Stepscited by 1,282
- 2021MuSiQue: Multihop Questions via Single-hop Question Compositioncited by 916
- 2023YaRN: Efficient Context Window Extension of Large Language Modelscited by 601
- 2021FinQA: A Dataset of Numerical Reasoning over Financial Datacited by 562
- 2023OCRBench: On the Hidden Mystery of OCR in Large Multimodal Modelscited by 476
- 2021InfographicVQAcited by 437
- 2025Native Sparse Attention: Hardware-Aligned and Natively Trainable Sparse Attentioncited by 407
- 2023LLMLingua: Compressing Prompts for Accelerated Inference of Large Language Modelscited by 287
- 2023RECOMP: Improving Retrieval-Augmented LMs with Compression and Selective Augmentationcited by 256
- 2025DeepSeek-OCR: Contexts Optical Compressioncited by 183
- 2024ChatQA: Surpassing GPT-4 on Conversational QA and RAGcited by 90
- 2024Michelangelo: Long Context Evaluations Beyond Haystacks via Latent Structure Queriescited by 88
- 2024ChatQA 2: Bridging the Gap to Proprietary LLMs in Long Context and RAG Capabilitiescited by 53
- 2025Glyph: Scaling Context Windows via Visual-Text Compressioncited by 49
- 2025Vision-centric Token Compression in Large Language Modelcited by 21
- 2024Leveraging Visual Tokens for Extended Text Contexts in Multi-Modal Learningcited by 17
- 2025VTCBench: Can Vision-Language Models Understand Long Context with Vision-Text Compression?cited by 11
- 2026Decoupling semantics from vision: A framework for faithful visual-text compression evaluationcited by 2
- 2026Same Semantics, Different Paths: Self-Improving Alignment for Vision-Text Compressioncited by 2
- 2026Visual Text Compression as Measure Transportcited by 1
- 2026Magnifying What Matters: Attention-Guided Adaptive Rendering for Visual Text Comprehensioncited by 1
- 2026Reading is not Reasoning: Bridging the Agentic Policy Gap in Vision-Text Compressioncited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026LensVLM: Selective Context Expansion for Compressed Visual Representation of Text
- 2026Resolution as a First-Class Decision: Task-Conditioned Routing for Efficient Multimodal Large Language Models
- 2026Chain-of-Thought Compression Should Not Be Blind: V-Skip for Efficient Multimodal Reasoning via Dual-Path Anchoring
- 2026VLZip: Unified Visual and Textual Compression for Interleaved Long-Context Modeling
- 2026LookWise: Knowing When and Where to Look for Fine-Grained Visual Reasoning in Multimodal Large Language Models
- 2026ApET: Approximation-Error Guided Token Compression for Efficient VLMs
- 2026CodeShrink: Adaptive Visual Compression for Efficient Multimodal Code Understanding
- 2026ResAdapt: Adaptive Resolution for Efficient Multimodal Reasoning