mlsanityData to 14 Oct 2026

Qianfan-VL: Domain-Enhanced Universal Vision-Language Models

arXiv 2509.18189 ↗First posted 19 Sep 2025cs.CV cs.AIcited by 7

On the map: Multimodal LLMs / vision-language models → MLLM training and visual instruction tuning

Abstract (arXiv)

We present Qianfan-VL, a series of multimodal large language models ranging from 3B to 70B parameters, achieving state-of-the-art performance through innovative domain enhancement techniques. Our approach employs multi-stage progressive training and high-precision data synthesis pipelines, which prove to be critical technologies for enhancing domain-specific capabilities while maintaining strong general performance. Qianfan-VL achieves comparable results to leading open-source models on general benchmarks, with state-of-the-art performance on benchmarks such as CCBench, SEEDBench IMG, ScienceQA, and MMStar. The domain enhancement strategy delivers significant advantages in OCR and document understanding, validated on both public benchmarks (OCRBench 873, DocVQA 94.75%) and in-house evaluations. Notably, Qianfan-VL-8B and 70B variants incorporate long chain-of-thought capabilities, demonstrating superior performance on mathematical reasoning (MathVista 78.6%) and logical inference tasks. All models are trained entirely on Baidu's Kunlun P800 chips, validating the capability of large-scale AI infrastructure to train SOTA-level multimodal models with over 90% scaling efficiency on 5000 chips for a single task. This work establishes an effective methodology for developing domain-enhanced multimodal models suitable for diverse enterprise deployment scenarios.

Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Placed in MLLM training and visual instruction tuning, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 55 of its 60 references that are in the map. First posted on arXiv 19 Sep 2025.

Builds on

55 of 60 references.

Closest ancestors · 7

Same direction, newest first

  1. 2024SEED-Bench-2-Plus: Benchmarking Multimodal Large Language Models with Text-Rich Visual Comprehension25 Apr
  2. 2024MMT-Bench: A Comprehensive Multimodal Benchmark for Evaluating Large Vision-Language Models Towards Multitask AGI24 Apr
  3. 2024BLINK: Multimodal Large Language Models Can See but Not Perceive18 Apr
  4. 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Tasks21 Dec
  5. 2023MM-Vet: Evaluating Large Multimodal Models for Integrated Capabilities4 Aug
  6. 2023SEED-Bench: Benchmarking Multimodal LLMs with Generative Comprehension30 Jul
  7. 2023MMBench: Is Your Multi-modal Model an All-around Player?12 Jul

Other references · 48

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  3. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  4. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  5. 2023Visual Instruction Tuningcited by 7,869
  6. 2025Qwen2.5-VL Technical Reportcited by 5,587
  7. 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,386
  8. 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
  9. 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyondcited by 2,224
  10. 2023MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGIcited by 2,080
  11. 2022Learn to Explain: Multimodal Reasoning via Thought Chains for Science Question Answeringcited by 1,919
  12. 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,834
36 more
  1. 2023Evaluating Object Hallucination in Large Vision-Language Modelscited by 1,729
  2. 2019Towards VQA Models That Can Readcited by 1,718
  3. 2023MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contextscited by 1,614
  4. 2019Root Mean Square Layer Normalizationcited by 1,480
  5. 2022ChartQA: A Benchmark for Question Answering about Charts with Visual and Logical Reasoningcited by 1,479
  6. 2024Depth Anything V2cited by 1,422
  7. 2023GQA: Training Generalized Multi-Query Transformer Models from Multi-Head Checkpointscited by 1,346
  8. 2020DocVQA: A Dataset for VQA on Document Imagescited by 1,317
  9. 2024Are We on the Right Way for Evaluating Large Vision-Language Models?cited by 914
  10. 2016A Diagram Is Worth A Dozen Imagescited by 804
  11. 2022A-OKVQA: A Benchmark for Visual Question Answering using World Knowledgecited by 710
  12. 2024MathVerse: Does Your Multi-modal LLM Truly See the Diagrams in Visual Math Problems?cited by 586
  13. 2023HallusionBench: An Advanced Diagnostic Suite for Entangled Language Hallucination and Visual Illusion in Large Vision-Language Modelscited by 583
  14. 2024Measuring Multimodal Mathematical Reasoning with MATH-Vision Datasetcited by 526
  15. 2023OCRBench: On the Hidden Mystery of OCR in Large Multimodal Modelscited by 476
  16. 2024VLMEvalKit: An Open-Source Toolkit for Evaluating Large Multi-Modality Modelscited by 455
  17. 2016Synthetic Data for Text Localisation in Natural Imagescited by 396
  18. 2024ShareGPT4Video: Improving Video Understanding and Generation with Better Captionscited by 388
  19. 2022Dynamic Prompt Learning via Policy Gradient for Semi-structured Mathematical Reasoningcited by 350
  20. 2023LLaVAR: Enhanced Visual Instruction Tuning for Text-Rich Image Understandingcited by 274
  21. 2023Q-Bench: A Benchmark for General-Purpose Foundation Models on Low-level Visioncited by 249
  22. 2023Nougat: Neural Optical Understanding for Academic Documentscited by 245
  23. 2023Patch n' Pack: NaViT, a Vision Transformer for any Aspect Ratio and Resolutioncited by 229
  24. 2024mPLUG-DocOwl 1.5: Unified Structure Learning for OCR-free Document Understandingcited by 220
  25. 2023MMC: Advancing Multimodal Chart Understanding with Large-scale Instruction Tuningcited by 150
  26. 2025PaddleOCR 3.0 Technical Reportcited by 143
  27. 2024Unlocking the conversion of Web Screenshots into HTML Code with the WebSight Datasetcited by 129
  28. 2025ChartQAPro: A More Diverse and Challenging Benchmark for Chart Question Answeringcited by 108
  29. 2024MTVQA: Benchmarking Multilingual Text-Centric Visual Question Answeringcited by 93
  30. 2024MedTrinity-25M: A Large-scale Multimodal Dataset with Multigranular Annotations for Medicinecited by 81
  31. 2024A-Bench: Are LMMs Masters at Evaluating AI-generated Images?cited by 39
  32. 2019EATEN: Entity-aware Attention for Single Shot Visual Text Extractioncited by 29
  33. 2024VCR: A Task for Pixel-Level Complex Reasoning in Vision Language Models via Restoring Occluded Textcited by 15
  34. 2022Augraphy: A Data Augmentation Library for Document Imagescited by 14
  35. 2024BigDocs: An Open Dataset for Training Multimodal Models on Document and Code Taskscited by 12
  36. 2020Offline Handwritten Chinese Text Recognition with Convolutional Neural Networkscited by 5

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 2; 2026: 5.

7 papers.

Similar, not cited

Close in wording, no citation either way

  1. 202620/20 Vision Language Models: A Prescription for Better VLMs through Data Curation Alone
  2. 2024PALO: A Polyglot Large Multimodal Model for 5B People
  3. 2025Qwen3-VL Technical Report
  4. 2026Explicit Logic Channel for Validation and Enhancement of MLLMs on Zero-Shot Tasks
  5. 2024Enhancing Advanced Visual Reasoning Ability of Large Language Models
  6. 2025Trust the Model: Compact VLMs as In-Context Judges for Image-Text Data Quality
  7. 2025Towards General Continuous Memory for Vision-Language Models
  8. 2024On Domain-Adaptive Post-Training for Multimodal Large Language Models