# Bee: A High-Quality Corpus and Full-Stack Suite to Unlock Advanced Fully Open MLLMs

arXiv: https://arxiv.org/abs/2510.13795 · HTML: https://mlsanity.com/paper/2510.13795/

## Key facts

- Cited by 27 papers in the map (data through 14 Oct 2026).
- Placed in MLLM training and visual instruction tuning, one of 16 directions in Multimodal LLMs / vision-language models.
- First posted on arXiv 15 Oct 2025.

## Placed in

- Multimodal LLMs / vision-language models / [MLLM training and visual instruction tuning](https://mlsanity.com/mllm/mllm-training-and-visual-instruction-tuning/)

## Built on by (most cited first, 27 of 27)

- [Uni-OPD: Unifying On-Policy Distillation with a Dual-Perspective Recipe](https://mlsanity.com/paper/2605.03677/) (2026)
- [PresentBench: A Fine-Grained Rubric-Based Benchmark for Slide Generation](https://mlsanity.com/paper/2603.07244/) (2026)
- [VideoChat3: Fully Open Video MLLM for Efficient and Generalist Video Understanding](https://mlsanity.com/paper/2607.14935/) (2026)
- [Mage-VL: An Efficient Codec-Native Streaming Multimodal Foundation Model](https://mlsanity.com/paper/2607.24904/) (2026)
- [Towards Universal Video MLLMs with Attribute-Structured and Quality-Verified Instructions](https://mlsanity.com/paper/2602.13013/) (2026)
- [Innovator-VL: A Multimodal Large Language Model for Scientific Discovery](https://mlsanity.com/paper/2601.19325/) (2026)
- [Uni-Edit: Intelligent Editing Is A General Task For Unified Model Tuning](https://mlsanity.com/paper/2605.21487/) (2026)
- [Embodied-R1.5: Evolving Physical Intelligence via Embodied Foundation Models](https://mlsanity.com/paper/2606.11324/) (2026)
- [Skin Tokens: A Learned Compact Representation for Unified Autoregressive Rigging](https://mlsanity.com/paper/2602.04805/) (2026)
- [UI-Oceanus: Scaling GUI Agents with Synthetic Environmental Dynamics](https://mlsanity.com/paper/2604.02345/) (2026)
- [POINTS-GUI-G: GUI-Grounding Journey](https://mlsanity.com/paper/2602.06391/) (2026)
- [Improving Variable-Length Generation in Diffusion Language Models via Length Regularization](https://mlsanity.com/paper/2602.07546/) (2026)
- [Mamoda2.5: Enhancing Unified Multimodal Model with DiT-MoE](https://mlsanity.com/paper/2605.02641/) (2026)
- [3D HAMSTER: Bridging Planning and Control in Hierarchical Vision Language Action Models through 3D Trajectory Guidance](https://mlsanity.com/paper/2606.31329/) (2026)
- [UniCustom: Unified Visual Conditioning for Multi-Reference Image Generation](https://mlsanity.com/paper/2605.12088/) (2026)
- [Uncovering Understanding-Generation Synergy in Native Unified Multimodal Models: From Representation, Task to System](https://mlsanity.com/paper/2609.01607/) (2026)
- [POINTS-Seeker: An Open Recipe for Multimodal Search Agents with Visual Memory Management](https://mlsanity.com/paper/2604.14029/) (2026)
- [DeltaPrompts: Escaping the Zero-Delta Trap in Multimodal Distillation](https://mlsanity.com/paper/2605.15532/) (2026)
- [PerceptionDLM: Parallel Region Perception with Multimodal Diffusion Language Models](https://mlsanity.com/paper/2606.19534/) (2026)
- [A Skill-augmented Agentic Framework and Benchmark for Multi-Video Understanding](https://mlsanity.com/paper/2603.14733/) (2026)
- [FineViT: Progressively Unlocking Fine-Grained Perception with Dense Recaptions](https://mlsanity.com/paper/2603.17326/) (2026)
- [PorTEXTO: A European Portuguese Benchmark for Visual Text Extraction](https://mlsanity.com/paper/2606.19096/) (2026)
- [Bridging VideoQA and Video-Guided Agentic Tasks via Generalized Keyframe Extraction](https://mlsanity.com/paper/2606.29445/) (2026)
- [DecoupleMix: Decoupled Ratio Search and Convex Allocation for Scalable VLM Data Recipes](https://mlsanity.com/paper/2607.24516/) (2026)
- [Learning from Reliable Negatives: Confidence-Anchored Test-Time Adaptation for GUI Grounding](https://mlsanity.com/paper/2609.15307/) (2026)
- [EmbodiedMind: Adaptive Data Curation and Prefix-Tree Reinforcement Learning for Efficient Embodied Intelligence](https://mlsanity.com/paper/2609.19659/) (2026)
- [Unbiased Top-k Estimation for On-Policy Distillation](https://mlsanity.com/paper/2609.34447/) (2026)

## Abstract (arXiv)

Fully open multimodal large language models (MLLMs) currently lag behind proprietary counterparts, primarily due to a significant gap in data quality for supervised fine-tuning (SFT). Existing open-source datasets are often plagued by widespread noise and a critical deficit in complex reasoning data, such as Chain-of-Thought (CoT), which hinders the development of advanced model capabilities. Addressing these challenges, our work makes three primary contributions. First, we introduce Honey-Data-15M, a new SFT dataset comprising approximately 15 million QA pairs, processed through multiple cleaning techniques and enhanced with a novel dual-level (short and long) CoT enrichment strategy. Second, we introduce HoneyPipe, the data curation pipeline, and its underlying framework DataStudio, providing the community with a transparent and adaptable methodology for data curation that moves beyond static dataset releases. Finally, to validate our dataset and pipeline, we train Bee-8B, an 8B model on Honey-Data-15M. Experiments show that Bee-8B establishes a new state-of-the-art (SOTA) for fully open MLLMs, achieving performance that is competitive with, and in some cases surpasses, recent semi-open models such as InternVL3.5-8B. Our work delivers to the community a suite of foundational resources, including: the Honey-Data-15M corpus; the full-stack suite comprising HoneyPipe and DataStudio; training recipes; an evaluation harness; and the model weights. This effort demonstrates that a principled focus on data quality is a key pathway to developing fully open MLLMs that are highly competitive with their semi-open counterparts.