Mobile-O: Unified Multimodal Understanding and Generation on Mobile Device
Not on the map. Why?
Abstract (arXiv)
Unified multimodal models can both understand and generate visual content within a single architecture. Existing models, however, remain data-hungry and too heavy for deployment on edge devices. We present Mobile-O, a compact vision-language-diffusion model that brings unified multimodal intelligence to a mobile device. Its core module, the Mobile Conditioning Projector (MCP), fuses vision-language features with a diffusion generator using depthwise-separable convolutions and layerwise alignment. This design enables efficient cross-modal conditioning with minimal computational cost. Trained on only a few million samples and post-trained in a novel quadruplet format (generation prompt, image, question, answer), Mobile-O jointly enhances both visual understanding and generation capabilities. Despite its efficiency, Mobile-O attains competitive or superior performance compared to other unified models, achieving 74% on GenEval and outperforming Show-O and JanusFlow by 5% and 11%, while running 6x and 11x faster, respectively. For visual understanding, Mobile-O surpasses them by 15.3% and 5.1% averaged across seven benchmarks. Running in only ~3s per 512x512 image on an iPhone, Mobile-O establishes the first practical framework for real-time unified multimodal understanding and generation on edge devices. We hope Mobile-O will ease future research in real-time unified multimodal intelligence running entirely on-device with no cloud dependency. Our code, models, datasets, and mobile application are publicly available at https://amshaker.github.io/Mobile-O/
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 43 of its 48 references that are in the map. First posted on arXiv 23 Feb 2026.
Builds on
43 of 48 references.
References · 43
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2024GPT-4o System Cardcited by 4,467
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
- 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,669
- 2024Qwen2 Technical Reportcited by 2,076
- 2023MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGIcited by 2,044
- 2019Towards VQA Models That Can Readcited by 1,696
- 2023Evaluating Object Hallucination in Large Vision-Language Modelscited by 1,696
- 2022ChartQA: A Benchmark for Question Answering about Charts with Visual and Logical Reasoningcited by 1,449
- 2023MM-Vet: Evaluating Large Multimodal Models for Integrated Capabilitiescited by 1,221
- 2023GenEval: An Object-Focused Framework for Evaluating Text-to-Image Alignmentcited by 946
- 2023SEED-Bench: Benchmarking Multimodal LLMs with Generative Comprehensioncited by 929
31 more
- 2024Chameleon: Mixed-Modal Early-Fusion Foundation Modelscited by 904
- 2025Emerging Properties in Unified Multimodal Pretrainingcited by 855
- 2023PixArt-α: Fast Training of Diffusion Transformer for Photorealistic Text-to-Image Synthesiscited by 854
- 2024Emu3: Next-Token Prediction is All You Needcited by 761
- 2024Autoregressive Model Beats Diffusion: Llama for Scalable Image Generationcited by 760
- 2024Show-o: One Single Transformer to Unify Multimodal Understanding and Generationcited by 734
- 2024Transfusion: Predict the Next Token and Diffuse Images with One Multi-Modal Modelcited by 468
- 2024Janus: Decoupling Visual Encoding for Unified Multimodal Understanding and Generationcited by 447
- 2023Generative Multimodal Models are In-Context Learnerscited by 446
- 2025BLIP3-o: A Family of Fully Open Unified Multimodal Models-Architecture, Training and Datasetcited by 363
- 2024SEED-X: Multimodal Models with Unified Multi-granularity Comprehension and Generationcited by 328
- 2023Unified-IO 2: Scaling Autoregressive Multimodal Models with Vision, Language, Audio, and Actioncited by 301
- 2025Show-o2: Improved Native Unified Multimodal Modelscited by 242
- 2025Transfer between Modalities with MetaQueriescited by 231
- 2025SmolVLM: Redefining small and efficient multimodal modelscited by 226
- 2025ImgEdit: A Unified Image Editing Dataset and Benchmarkcited by 225
- 2024MetaMorph: Multimodal Understanding and Generation via Instruction Tuningcited by 205
- 2023JourneyDB: A Benchmark for Generative Image Understandingcited by 203
- 2024World Model on Million-Length Video And Language With Blockwise RingAttentioncited by 196
- 2024MobileVLM V2: Faster and Stronger Baseline for Vision Language Modelcited by 172
- 2024JanusFlow: Harmonizing Autoregression and Rectified Flow for Unified Multimodal Understanding and Generationcited by 162
- 2023FastViT: A Fast Hybrid Vision Transformer using Structural Reparameterizationcited by 161
- 2024LLaVA-Phi: Efficient Multi-Modal Assistant with Small Language Modelcited by 128
- 2023MobileVLM : A Fast, Strong and Open Vision Language Assistant for Mobile Devicescited by 120
- 2025ShareGPT-4o-Image: Aligning Multimodal Models with GPT-4o-Level Image Generationcited by 94
- 2024FastVLM: Efficient Vision Encoding for Vision Language Modelscited by 76
- 2025OneCAT: Decoder-Only Auto-Regressive Model for Unified Understanding and Generationcited by 50
- 2024SnapGen: Taming High-Resolution Text-to-Image Models for Mobile Devices with Efficient Architectures and Trainingcited by 27
- 2023MAGVLT: Masked Generative Vision-and-Language Transformercited by 14
- 2025TBAC-UniImage: Unified Understanding and Generation by Ladder-Side Diffusion Tuningcited by 10
- 2025MM-R1: Unleashing the Power of Unified Multimodal Large Language Models for Personalized Image Generationcited by 9
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025UniModel: A Visual-Only Framework for Unified Multimodal Understanding and Generation
- 2025Mobile-VideoGPT: Fast and Accurate Model for Mobile Video Understanding
- 2026UniDDT: Unifying Multimodal Understanding and Generation with Decoupled Diffusion Transformer
- 2025Emu3.5: Native Multimodal Models are World Learners
- 2024Dual Diffusion for Unified Image Generation and Understanding
- 2025ARMOR: Empowering Multimodal Understanding Model with Interleaved Multimodal Generation Capability
- 2025Lavida-O: Elastic Large Masked Diffusion Models for Unified Multimodal Understanding and Generation
- 2022M-VADER: A Model for Diffusion with Multimodal Context