mlsanityData to 7 Oct 2026

Xuanwu: Evolving General Multimodal Models into an Industrial-Grade Foundation for Content Ecosystems

arXiv 2603.29211 ↗First posted 31 Mar 2026cs.AI cs.CL cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

In recent years, multimodal large models have continued to improve on general benchmarks. However, in real-world content moderation and adversarial settings, mainstream models still suffer from degraded generalization and catastrophic forgetting because of limited fine-grained visual perception and insufficient modeling of long-tail noise. In this paper, we present Xuanwu VL-2B as a case study of how general multimodal models can be developed into an industrial-grade foundation model for content ecosystems. The model adopts a compact InternViT-300M + MLP + Qwen3 1.7B architecture, balancing fine-grained visual perception, language-semantic alignment, and deployment cost within an approximately 2B-parameter budget. To balance business specialization with the retention of general capabilities, we developed a data iteration and curation mechanism and trained the model through a progressive three-stage pipeline: pre-training, mid-training, and post-training. Ablation studies and offline business evaluations show that Xuanwu VL-2B achieves an average score of 67.90 across seven OpenCompass multimodal metrics (vs. 64.27 for InternVL 3.5 2B), an average recall of 94.38% over seven independent business moderation tasks, and a weighted overall recall of 82.82% on policy-violating text in challenging adversarial OCR scenarios, outperforming Gemini-2.5-Pro (76.72%). These results show that, under a limited parameter budget, Xuanwu VL-2B achieves a practical balance among business alignment, visual perception, general capability retention, and deployment cost.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 137 of its 180 references that are in the map. First posted on arXiv 31 Mar 2026.

Builds on

137 of 180 references.

References · 137

  1. 2021Training Verifiers to Solve Math Word Problemscited by 9,743
  2. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  3. 2025Qwen3 Technical Reportcited by 8,195
  4. 2023Segment Anythingcited by 8,158
  5. 2021Evaluating Large Language Models Trained on Codecited by 8,053
  6. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
  7. 2023Visual Instruction Tuningcited by 7,792
  8. 2020Measuring Massive Multitask Language Understandingcited by 7,768
  9. 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,203
  10. 2021Program Synthesis with Large Language Modelscited by 3,509
  11. 2021Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsitycited by 3,014
  12. 2023GPQA: A Graduate-Level Google-Proof Q&A Benchmarkcited by 2,748
38 more
  1. 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,669
  2. 2023FlashAttention-2: Faster Attention with Better Parallelism and Work Partitioningcited by 2,551
  3. 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,534
  4. 2016Making the V in VQA Matter: Elevating the Role of Image Understanding in Visual Question Answeringcited by 2,498
  5. 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyondcited by 2,179
  6. 2023MMBench: Is Your Multi-modal Model an All-around Player?cited by 2,105
  7. 2023MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGIcited by 2,044
  8. 2022Learn to Explain: Multimodal Reasoning via Thought Chains for Science Question Answeringcited by 1,881
  9. 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,769
  10. 2022Challenging BIG-Bench Tasks and Whether Chain-of-Thought Can Solve Themcited by 1,767
  11. 2019Towards VQA Models That Can Readcited by 1,696
  12. 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scalingcited by 1,573
  13. 2022ChartQA: A Benchmark for Question Answering about Charts with Visual and Logical Reasoningcited by 1,449
  14. 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,419
  15. 2020DocVQA: A Dataset for VQA on Document Imagescited by 1,288
  16. 2016Real-Time Single Image and Video Super-Resolution Using an Efficient Sub-Pixel Convolutional Neural Networkcited by 1,199
  17. 2023Instruction-Following Evaluation for Large Language Modelscited by 1,143
  18. 2023WizardLM: Empowering large pre-trained language models to follow complex instructionscited by 1,116
  19. 2024MiniCPM-V: A GPT-4V Level MLLM on Your Phonecited by 1,061
  20. 2016Modeling Context in Referring Expressionscited by 1,054
  21. 2023ShareGPT4V: Improving Large Multi-Modal Models with Better Captionscited by 1,000
  22. 2024Are We on the Right Way for Evaluating Large Vision-Language Models?cited by 893
  23. 2018VizWiz Grand Challenge: Answering Visual Questions from Blind Peoplecited by 852
  24. 2024Cambrian-1: A Fully Open, Vision-Centric Exploration of Multimodal LLMscited by 822
  25. 2016A Diagram Is Worth A Dozen Imagescited by 793
  26. 2025Group Sequence Policy Optimizationcited by 788
  27. 2023MetaMath: Bootstrap Your Own Mathematical Questions for Large Language Modelscited by 724
  28. 2022A-OKVQA: A Benchmark for Visual Question Answering using World Knowledgecited by 702
  29. 2023C-Eval: A Multi-Level Multi-Discipline Chinese Evaluation Suite for Foundation Modelscited by 694
  30. 2023HallusionBench: An Advanced Diagnostic Suite for Entangled Language Hallucination and Visual Illusion in Large Vision-Language Modelscited by 572
  31. 2023DriveLM: Driving with Graph Visual Question Answeringcited by 527
  32. 2020The Hateful Memes Challenge: Detecting Hate Speech in Multimodal Memescited by 485
  33. 2023MAmmoTH: Building Math Generalist Models through Hybrid Instruction Tuningcited by 483
  34. 2020PathVQA: 30000+ Questions for Medical Visual Question Answeringcited by 467
  35. 2023OCRBench: On the Hidden Mystery of OCR in Large Multimodal Modelscited by 466
  36. 2018A Corpus for Reasoning About Natural Language Grounded in Photographscited by 457
  37. 2023Mitigating Hallucination in Large Multi-Modal Models via Robust Instruction Tuningcited by 439
  38. 2021OCR-free Document Understanding Transformercited by 400

50 most cited of 137 All 137 (JSON)

Built on by

Not cited yet.