Qianfan-VL: Domain-Enhanced Universal Vision-Language Models
On the map: Multimodal LLMs / vision-language models → MLLM training and visual instruction tuning
Abstract (arXiv)
We present Qianfan-VL, a series of multimodal large language models ranging from 3B to 70B parameters, achieving state-of-the-art performance through innovative domain enhancement techniques. Our approach employs multi-stage progressive training and high-precision data synthesis pipelines, which prove to be critical technologies for enhancing domain-specific capabilities while maintaining strong general performance. Qianfan-VL achieves comparable results to leading open-source models on general benchmarks, with state-of-the-art performance on benchmarks such as CCBench, SEEDBench IMG, ScienceQA, and MMStar. The domain enhancement strategy delivers significant advantages in OCR and document understanding, validated on both public benchmarks (OCRBench 873, DocVQA 94.75%) and in-house evaluations. Notably, Qianfan-VL-8B and 70B variants incorporate long chain-of-thought capabilities, demonstrating superior performance on mathematical reasoning (MathVista 78.6%) and logical inference tasks. All models are trained entirely on Baidu's Kunlun P800 chips, validating the capability of large-scale AI infrastructure to train SOTA-level multimodal models with over 90% scaling efficiency on 5000 chips for a single task. This work establishes an effective methodology for developing domain-enhanced multimodal models suitable for diverse enterprise deployment scenarios.
Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Placed in MLLM training and visual instruction tuning, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 55 of its 60 references that are in the map. First posted on arXiv 19 Sep 2025.
Builds on
55 of 60 references.
Closest ancestors · 7
Same direction, newest first
- 2024SEED-Bench-2-Plus: Benchmarking Multimodal Large Language Models with Text-Rich Visual Comprehension25 Apr
- 2024MMT-Bench: A Comprehensive Multimodal Benchmark for Evaluating Large Vision-Language Models Towards Multitask AGI24 Apr
- 2024BLINK: Multimodal Large Language Models Can See but Not Perceive18 Apr
- 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Tasks21 Dec
- 2023MM-Vet: Evaluating Large Multimodal Models for Integrated Capabilities4 Aug
- 2023SEED-Bench: Benchmarking Multimodal LLMs with Generative Comprehension30 Jul
- 2023MMBench: Is Your Multi-modal Model an All-around Player?12 Jul
Other references · 48
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2023Visual Instruction Tuningcited by 7,869
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,386
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
- 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyondcited by 2,224
- 2023MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGIcited by 2,080
- 2022Learn to Explain: Multimodal Reasoning via Thought Chains for Science Question Answeringcited by 1,919
- 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,834
36 more
- 2023Evaluating Object Hallucination in Large Vision-Language Modelscited by 1,729
- 2019Towards VQA Models That Can Readcited by 1,718
- 2023MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contextscited by 1,614
- 2019Root Mean Square Layer Normalizationcited by 1,480
- 2022ChartQA: A Benchmark for Question Answering about Charts with Visual and Logical Reasoningcited by 1,479
- 2024Depth Anything V2cited by 1,422
- 2023GQA: Training Generalized Multi-Query Transformer Models from Multi-Head Checkpointscited by 1,346
- 2020DocVQA: A Dataset for VQA on Document Imagescited by 1,317
- 2024Are We on the Right Way for Evaluating Large Vision-Language Models?cited by 914
- 2016A Diagram Is Worth A Dozen Imagescited by 804
- 2022A-OKVQA: A Benchmark for Visual Question Answering using World Knowledgecited by 710
- 2024MathVerse: Does Your Multi-modal LLM Truly See the Diagrams in Visual Math Problems?cited by 586
- 2023HallusionBench: An Advanced Diagnostic Suite for Entangled Language Hallucination and Visual Illusion in Large Vision-Language Modelscited by 583
- 2024Measuring Multimodal Mathematical Reasoning with MATH-Vision Datasetcited by 526
- 2023OCRBench: On the Hidden Mystery of OCR in Large Multimodal Modelscited by 476
- 2024VLMEvalKit: An Open-Source Toolkit for Evaluating Large Multi-Modality Modelscited by 455
- 2016Synthetic Data for Text Localisation in Natural Imagescited by 396
- 2024ShareGPT4Video: Improving Video Understanding and Generation with Better Captionscited by 388
- 2022Dynamic Prompt Learning via Policy Gradient for Semi-structured Mathematical Reasoningcited by 350
- 2023LLaVAR: Enhanced Visual Instruction Tuning for Text-Rich Image Understandingcited by 274
- 2023Q-Bench: A Benchmark for General-Purpose Foundation Models on Low-level Visioncited by 249
- 2023Nougat: Neural Optical Understanding for Academic Documentscited by 245
- 2023Patch n' Pack: NaViT, a Vision Transformer for any Aspect Ratio and Resolutioncited by 229
- 2024mPLUG-DocOwl 1.5: Unified Structure Learning for OCR-free Document Understandingcited by 220
- 2023MMC: Advancing Multimodal Chart Understanding with Large-scale Instruction Tuningcited by 150
- 2025PaddleOCR 3.0 Technical Reportcited by 143
- 2024Unlocking the conversion of Web Screenshots into HTML Code with the WebSight Datasetcited by 129
- 2025ChartQAPro: A More Diverse and Challenging Benchmark for Chart Question Answeringcited by 108
- 2024MTVQA: Benchmarking Multilingual Text-Centric Visual Question Answeringcited by 93
- 2024MedTrinity-25M: A Large-scale Multimodal Dataset with Multigranular Annotations for Medicinecited by 81
- 2024A-Bench: Are LMMs Masters at Evaluating AI-generated Images?cited by 39
- 2019EATEN: Entity-aware Attention for Single Shot Visual Text Extractioncited by 29
- 2024VCR: A Task for Pixel-Level Complex Reasoning in Vision Language Models via Restoring Occluded Textcited by 15
- 2022Augraphy: A Data Augmentation Library for Document Imagescited by 14
- 2024BigDocs: An Open Dataset for Training Multimodal Models on Document and Code Taskscited by 12
- 2020Offline Handwritten Chinese Text Recognition with Convolutional Neural Networkscited by 5
Built on by
Citing papers per year: 2025: 2; 2026: 5.
7 papers.
- 2025VL-RouterBench: A Benchmark for Vision-Language Model Routingcited by 8
- 2025AndesVL Technical Report: An Efficient Mobile-side Multimodal Large Language Modelcited by 4
- 2026Omni-Judge: Can Omni-LLMs Serve as Human-Aligned Judges for Text-Conditioned Audio-Video Generation?cited by 3
- 2026Global-Local Dual Perception for MLLMs in High-Resolution Text-Rich Image Translationcited by 3
- 2026Detached Skip-Links and R-Probe: Decoupling Feature Aggregation from Gradient Propagation for MLLM OCRcited by 0
- 2026True (VIS) Lies: Analyzing How Generative AI Recognizes Intentionality, Rhetoric, and Misleadingness in Visualization Liescited by 0
- 2026Can Multimodal Large Language Models Truly Understand Small Objects?cited by 0
- 2026Can Multimodal Large Language Models Truly Understand Small Objects?24 Apr 2026
- 2026True (VIS) Lies: Analyzing How Generative AI Recognizes Intentionality, Rhetoric, and Misleadingness in Visualization Lies1 Apr 2026
- 2026Detached Skip-Links and R-Probe: Decoupling Feature Aggregation from Gradient Propagation for MLLM OCR20 Mar 2026
- 2026Global-Local Dual Perception for MLLMs in High-Resolution Text-Rich Image Translation25 Feb 2026
- 2026Omni-Judge: Can Omni-LLMs Serve as Human-Aligned Judges for Text-Conditioned Audio-Video Generation?2 Feb 2026
- 2025VL-RouterBench: A Benchmark for Vision-Language Model Routing29 Dec 2025
- 2025AndesVL Technical Report: An Efficient Mobile-side Multimodal Large Language Model13 Oct 2025
Similar, not cited
Close in wording, no citation either way
- 202620/20 Vision Language Models: A Prescription for Better VLMs through Data Curation Alone
- 2024PALO: A Polyglot Large Multimodal Model for 5B People
- 2025Qwen3-VL Technical Report
- 2026Explicit Logic Channel for Validation and Enhancement of MLLMs on Zero-Shot Tasks
- 2024Enhancing Advanced Visual Reasoning Ability of Large Language Models
- 2025Trust the Model: Compact VLMs as In-Context Judges for Image-Text Data Quality
- 2025Towards General Continuous Memory for Vision-Language Models
- 2024On Domain-Adaptive Post-Training for Multimodal Large Language Models