mlsanityData to 7 Oct 2026

Mobile-O: Unified Multimodal Understanding and Generation on Mobile Device

arXiv 2602.20161 ↗First posted 23 Feb 2026cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

Unified multimodal models can both understand and generate visual content within a single architecture. Existing models, however, remain data-hungry and too heavy for deployment on edge devices. We present Mobile-O, a compact vision-language-diffusion model that brings unified multimodal intelligence to a mobile device. Its core module, the Mobile Conditioning Projector (MCP), fuses vision-language features with a diffusion generator using depthwise-separable convolutions and layerwise alignment. This design enables efficient cross-modal conditioning with minimal computational cost. Trained on only a few million samples and post-trained in a novel quadruplet format (generation prompt, image, question, answer), Mobile-O jointly enhances both visual understanding and generation capabilities. Despite its efficiency, Mobile-O attains competitive or superior performance compared to other unified models, achieving 74% on GenEval and outperforming Show-O and JanusFlow by 5% and 11%, while running 6x and 11x faster, respectively. For visual understanding, Mobile-O surpasses them by 15.3% and 5.1% averaged across seven benchmarks. Running in only ~3s per 512x512 image on an iPhone, Mobile-O establishes the first practical framework for real-time unified multimodal understanding and generation on edge devices. We hope Mobile-O will ease future research in real-time unified multimodal intelligence running entirely on-device with no cloud dependency. Our code, models, datasets, and mobile application are publicly available at https://amshaker.github.io/Mobile-O/

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 43 of its 48 references that are in the map. First posted on arXiv 23 Feb 2026.

Builds on

43 of 48 references.

References · 43

  1. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  2. 2024GPT-4o System Cardcited by 4,467
  3. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
  4. 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,669
  5. 2024Qwen2 Technical Reportcited by 2,076
  6. 2023MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGIcited by 2,044
  7. 2019Towards VQA Models That Can Readcited by 1,696
  8. 2023Evaluating Object Hallucination in Large Vision-Language Modelscited by 1,696
  9. 2022ChartQA: A Benchmark for Question Answering about Charts with Visual and Logical Reasoningcited by 1,449
  10. 2023MM-Vet: Evaluating Large Multimodal Models for Integrated Capabilitiescited by 1,221
  11. 2023GenEval: An Object-Focused Framework for Evaluating Text-to-Image Alignmentcited by 946
  12. 2023SEED-Bench: Benchmarking Multimodal LLMs with Generative Comprehensioncited by 929
31 more
  1. 2024Chameleon: Mixed-Modal Early-Fusion Foundation Modelscited by 904
  2. 2025Emerging Properties in Unified Multimodal Pretrainingcited by 855
  3. 2023PixArt-α: Fast Training of Diffusion Transformer for Photorealistic Text-to-Image Synthesiscited by 854
  4. 2024Emu3: Next-Token Prediction is All You Needcited by 761
  5. 2024Autoregressive Model Beats Diffusion: Llama for Scalable Image Generationcited by 760
  6. 2024Show-o: One Single Transformer to Unify Multimodal Understanding and Generationcited by 734
  7. 2024Transfusion: Predict the Next Token and Diffuse Images with One Multi-Modal Modelcited by 468
  8. 2024Janus: Decoupling Visual Encoding for Unified Multimodal Understanding and Generationcited by 447
  9. 2023Generative Multimodal Models are In-Context Learnerscited by 446
  10. 2025BLIP3-o: A Family of Fully Open Unified Multimodal Models-Architecture, Training and Datasetcited by 363
  11. 2024SEED-X: Multimodal Models with Unified Multi-granularity Comprehension and Generationcited by 328
  12. 2023Unified-IO 2: Scaling Autoregressive Multimodal Models with Vision, Language, Audio, and Actioncited by 301
  13. 2025Show-o2: Improved Native Unified Multimodal Modelscited by 242
  14. 2025Transfer between Modalities with MetaQueriescited by 231
  15. 2025SmolVLM: Redefining small and efficient multimodal modelscited by 226
  16. 2025ImgEdit: A Unified Image Editing Dataset and Benchmarkcited by 225
  17. 2024MetaMorph: Multimodal Understanding and Generation via Instruction Tuningcited by 205
  18. 2023JourneyDB: A Benchmark for Generative Image Understandingcited by 203
  19. 2024World Model on Million-Length Video And Language With Blockwise RingAttentioncited by 196
  20. 2024MobileVLM V2: Faster and Stronger Baseline for Vision Language Modelcited by 172
  21. 2024JanusFlow: Harmonizing Autoregression and Rectified Flow for Unified Multimodal Understanding and Generationcited by 162
  22. 2023FastViT: A Fast Hybrid Vision Transformer using Structural Reparameterizationcited by 161
  23. 2024LLaVA-Phi: Efficient Multi-Modal Assistant with Small Language Modelcited by 128
  24. 2023MobileVLM : A Fast, Strong and Open Vision Language Assistant for Mobile Devicescited by 120
  25. 2025ShareGPT-4o-Image: Aligning Multimodal Models with GPT-4o-Level Image Generationcited by 94
  26. 2024FastVLM: Efficient Vision Encoding for Vision Language Modelscited by 76
  27. 2025OneCAT: Decoder-Only Auto-Regressive Model for Unified Understanding and Generationcited by 50
  28. 2024SnapGen: Taming High-Resolution Text-to-Image Models for Mobile Devices with Efficient Architectures and Trainingcited by 27
  29. 2023MAGVLT: Masked Generative Vision-and-Language Transformercited by 14
  30. 2025TBAC-UniImage: Unified Understanding and Generation by Ladder-Side Diffusion Tuningcited by 10
  31. 2025MM-R1: Unleashing the Power of Unified Multimodal Large Language Models for Personalized Image Generationcited by 9

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025UniModel: A Visual-Only Framework for Unified Multimodal Understanding and Generation
  2. 2025Mobile-VideoGPT: Fast and Accurate Model for Mobile Video Understanding
  3. 2026UniDDT: Unifying Multimodal Understanding and Generation with Decoupled Diffusion Transformer
  4. 2025Emu3.5: Native Multimodal Models are World Learners
  5. 2024Dual Diffusion for Unified Image Generation and Understanding
  6. 2025ARMOR: Empowering Multimodal Understanding Model with Interleaved Multimodal Generation Capability
  7. 2025Lavida-O: Elastic Large Masked Diffusion Models for Unified Multimodal Understanding and Generation
  8. 2022M-VADER: A Model for Diffusion with Multimodal Context