Youtu-VL: Unleashing Visual Potential via Unified Vision-Language Supervision
On the map: Multimodal LLMs / vision-language models → MLLM training and visual instruction tuning
Abstract (arXiv)
Despite the significant advancements represented by Vision-Language Models (VLMs), current architectures often exhibit limitations in retaining fine-grained visual information, leading to coarse-grained multimodal comprehension. We attribute this deficiency to a suboptimal training paradigm inherent in prevailing VLMs, which exhibits a text-dominant optimization bias by conceptualizing visual signals merely as passive conditional inputs rather than supervisory targets. To mitigate this, we introduce Youtu-VL, a framework leveraging the Vision-Language Unified Autoregressive Supervision (VLUAS) paradigm, which fundamentally shifts the optimization objective from ``vision-as-input'' to ``vision-as-target.'' By integrating visual tokens directly into the prediction stream, Youtu-VL applies unified autoregressive supervision to both visual details and linguistic content. Furthermore, we extend this paradigm to encompass vision-centric tasks, enabling a standard VLM to perform vision-centric tasks without task-specific additions. Extensive empirical evaluations demonstrate that Youtu-VL achieves competitive performance on both general multimodal tasks and vision-centric tasks, establishing a robust foundation for the development of comprehensive generalist visual agents.
Key facts. Cited by 15 papers in the map (data through 14 Oct 2026). Placed in MLLM training and visual instruction tuning, one of 16 directions in Multimodal LLMs / vision-language models. First posted on arXiv 27 Jan 2026.
Builds on
0 of 0 references.
No references here yet.
Built on by
Citing papers per year: 2026: 15.
15 papers.
Sort:
By area:
- 2026Youtu-Parsing: Perception, Structuring and Recognition via High-Parallelism Decodingcited by 10
- 2026Vision as Unified Multimodal Generationcited by 7
- 2026From Chatbot to Digital Colleague: The Paradigm Shift Toward Persistent Autonomous AIcited by 6
- 2026Qwen3-VL-Seg: Unlocking Open-World Referring Segmentation with Vision-Language Groundingcited by 5
- 2026Unlocking Dense Metric Depth Estimation in VLMscited by 4
- 2026Back on Track: Aligning Rewards and States for Reasoning in Diffusion Large Language Modelscited by 4
- 2026AgentCVR: Active Multi-Agent Cross-Video Reasoning via Script-Simulated Reinforcement Learningcited by 1
- 2026VIABLE: A Visually Impaired Assistance Benchmark for VLM-as-a-Judge Evaluationcited by 1
- 2026Mixture-of-Thought-Tokens: Unifying Perception and Reasoning for Free-form Multimodal Groundingcited by 1
- 2026BUS: Brain-Inspired Unsupervised Self-Reflection via Backward Prediction for Multimodal Reasoningcited by 0
- 2026Vision-Language Grounding as Bidirectional Concept Correspondencecited by 0
- 2026DepthEvidence: Unifying Metric Depth Prediction and Geometric Reasoning in Multimodal Language Modelscited by 0
- 2026ReferFlow: Beyond Final-Target Localization for Complex Referring Expressions14 Oct 2026
- 2026When Charts Deceive Web Agents: A Paired Benchmark for Misleading Visualization-Grounded Tasks9 Oct 2026
- 2026FORUM: Frozen Outputs Reconciled Using Model Agreement for Visual Grounding27 Sep 2026
- 2026DepthEvidence: Unifying Metric Depth Prediction and Geometric Reasoning in Multimodal Language Models25 Sep 2026
- 2026Vision-Language Grounding as Bidirectional Concept Correspondence8 Aug 2026
- 2026Mixture-of-Thought-Tokens: Unifying Perception and Reasoning for Free-form Multimodal Grounding27 Jul 2026
- 2026BUS: Brain-Inspired Unsupervised Self-Reflection via Backward Prediction for Multimodal Reasoning8 Jul 2026
- 2026Vision as Unified Multimodal Generation7 Jul 2026
- 2026From Chatbot to Digital Colleague: The Paradigm Shift Toward Persistent Autonomous AI12 Jun 2026
- 2026Back on Track: Aligning Rewards and States for Reasoning in Diffusion Large Language Models7 Jun 2026
- 2026VIABLE: A Visually Impaired Assistance Benchmark for VLM-as-a-Judge Evaluation29 May 2026
- 2026AgentCVR: Active Multi-Agent Cross-Video Reasoning via Script-Simulated Reinforcement Learning28 May 2026
- 2026Back on Track: Aligning Rewards and States for Reasoning in Diffusion Large Language Modelscited by 4
- 2026AgentCVR: Active Multi-Agent Cross-Video Reasoning via Script-Simulated Reinforcement Learningcited by 1
- 2026Mixture-of-Thought-Tokens: Unifying Perception and Reasoning for Free-form Multimodal Groundingcited by 1
- 2026BUS: Brain-Inspired Unsupervised Self-Reflection via Backward Prediction for Multimodal Reasoningcited by 0
- 2026DepthEvidence: Unifying Metric Depth Prediction and Geometric Reasoning in Multimodal Language Modelscited by 0
- 2026DepthEvidence: Unifying Metric Depth Prediction and Geometric Reasoning in Multimodal Language Models25 Sep 2026
- 2026Mixture-of-Thought-Tokens: Unifying Perception and Reasoning for Free-form Multimodal Grounding27 Jul 2026
- 2026BUS: Brain-Inspired Unsupervised Self-Reflection via Backward Prediction for Multimodal Reasoning8 Jul 2026
- 2026Back on Track: Aligning Rewards and States for Reasoning in Diffusion Large Language Models7 Jun 2026
- 2026AgentCVR: Active Multi-Agent Cross-Video Reasoning via Script-Simulated Reinforcement Learning28 May 2026
- 2026Youtu-Parsing: Perception, Structuring and Recognition via High-Parallelism Decodingcited by 10
- 2026Vision as Unified Multimodal Generationcited by 7
- 2026From Chatbot to Digital Colleague: The Paradigm Shift Toward Persistent Autonomous AIcited by 6
- 2026Qwen3-VL-Seg: Unlocking Open-World Referring Segmentation with Vision-Language Groundingcited by 5
- 2026VIABLE: A Visually Impaired Assistance Benchmark for VLM-as-a-Judge Evaluationcited by 1
- 2026Vision-Language Grounding as Bidirectional Concept Correspondencecited by 0
- 2026Vision-Language Grounding as Bidirectional Concept Correspondence8 Aug 2026
- 2026Vision as Unified Multimodal Generation7 Jul 2026
- 2026From Chatbot to Digital Colleague: The Paradigm Shift Toward Persistent Autonomous AI12 Jun 2026
- 2026VIABLE: A Visually Impaired Assistance Benchmark for VLM-as-a-Judge Evaluation29 May 2026
- 2026Qwen3-VL-Seg: Unlocking Open-World Referring Segmentation with Vision-Language Grounding8 May 2026
- 2026Youtu-Parsing: Perception, Structuring and Recognition via High-Parallelism Decoding28 Jan 2026
Similar, not cited
Close in wording, no citation either way
- 2026VIVAS: Vitalizing Visual Perception in VLM Pre-training via Vision-language Unified Autoregressive Supervision
- 2026UVU: Improving Multimodal Understanding via Vision-Language Unified Autoregressive Paradigm
- 2026Boosting Visual Instruction Tuning with Self-Supervised Guidance
- 2022Vision-Language Intelligence: Tasks, Representation Learning, and Large Models
- 2025Seeing Beyond Words: Self-Supervised Visual Learning for Multimodal Large Language Models
- 2025VL-GenRM: Enhancing Vision-Language Verification via Vision Experts and Iterative Training
- 2022VLUE: A Multi-Task Benchmark for Evaluating Vision-Language Models
- 2024Activating Distributed Visual Region within LLMs for Efficient and Effective Vision-Language Training and Inference