mlsanityData to 14 Oct 2026

Youtu-VL: Unleashing Visual Potential via Unified Vision-Language Supervision

arXiv 2601.19798 ↗First posted 27 Jan 2026cs.CVcited by 15

On the map: Multimodal LLMs / vision-language models → MLLM training and visual instruction tuning

Abstract (arXiv)

Despite the significant advancements represented by Vision-Language Models (VLMs), current architectures often exhibit limitations in retaining fine-grained visual information, leading to coarse-grained multimodal comprehension. We attribute this deficiency to a suboptimal training paradigm inherent in prevailing VLMs, which exhibits a text-dominant optimization bias by conceptualizing visual signals merely as passive conditional inputs rather than supervisory targets. To mitigate this, we introduce Youtu-VL, a framework leveraging the Vision-Language Unified Autoregressive Supervision (VLUAS) paradigm, which fundamentally shifts the optimization objective from ``vision-as-input'' to ``vision-as-target.'' By integrating visual tokens directly into the prediction stream, Youtu-VL applies unified autoregressive supervision to both visual details and linguistic content. Furthermore, we extend this paradigm to encompass vision-centric tasks, enabling a standard VLM to perform vision-centric tasks without task-specific additions. Extensive empirical evaluations demonstrate that Youtu-VL achieves competitive performance on both general multimodal tasks and vision-centric tasks, establishing a robust foundation for the development of comprehensive generalist visual agents.

Key facts. Cited by 15 papers in the map (data through 14 Oct 2026). Placed in MLLM training and visual instruction tuning, one of 16 directions in Multimodal LLMs / vision-language models. First posted on arXiv 27 Jan 2026.

Builds on

0 of 0 references.

No references here yet.

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 15.

15 papers.

Sort:

By area:

Similar, not cited

Close in wording, no citation either way

  1. 2026VIVAS: Vitalizing Visual Perception in VLM Pre-training via Vision-language Unified Autoregressive Supervision
  2. 2026UVU: Improving Multimodal Understanding via Vision-Language Unified Autoregressive Paradigm
  3. 2026Boosting Visual Instruction Tuning with Self-Supervised Guidance
  4. 2022Vision-Language Intelligence: Tasks, Representation Learning, and Large Models
  5. 2025Seeing Beyond Words: Self-Supervised Visual Learning for Multimodal Large Language Models
  6. 2025VL-GenRM: Enhancing Vision-Language Verification via Vision Experts and Iterative Training
  7. 2022VLUE: A Multi-Task Benchmark for Evaluating Vision-Language Models
  8. 2024Activating Distributed Visual Region within LLMs for Efficient and Effective Vision-Language Training and Inference