FlowInOne:Unifying Multimodal Generation as Image-in, Image-out Flow Matching
On the map: Diffusion models → Image generation, text-to-image and editing
Abstract (arXiv)
Multimodal generation has long been dominated by text-driven pipelines where language dictates vision but cannot reason or create within it. We challenge this paradigm by asking whether all modalities, including textual descriptions, spatial layouts, and editing instructions, can be unified into a single visual representation. We present FlowInOne, a framework that reformulates multimodal generation as a purely visual flow, converting all inputs into visual prompts and enabling a clean image-in, image-out pipeline governed by a single flow matching model. This vision-centric formulation naturally eliminates cross-modal alignment bottlenecks, noise scheduling, and task-specific architectural branches, unifying text-to-image generation, layout-guided editing, and visual instruction following under one coherent paradigm. To support this, we introduce VisPrompt-5M, a large-scale dataset of 5 million visual prompt pairs spanning diverse tasks including physics-aware force dynamics and trajectory prediction, alongside VP-Bench, a rigorously curated benchmark assessing instruction faithfulness, spatial precision, visual realism, and content consistency. Extensive experiments demonstrate that FlowInOne achieves state-of-the-art performance among open-source models across all unified generation tasks while remaining competitive with leading commercial systems, thereby establishing a new foundation for fully vision-centric generative modeling, in which perception and creation coexist within a unified continuous visual space. Our code and models are released on https://csu-jpg.github.io/FlowInOne.github.io/
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 62 of its 70 references that are in the map. First posted on arXiv 8 Apr 2026.
Builds on
62 of 70 references.
Closest ancestors · 10
Same direction, newest first
- 2025MaskAttn-SDXL: Controllable Region-Level Text-To-Image Generation18 Sep
- 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Space17 Jun
- 2024Flowing from Words to Pixels: A Noise-Free Framework for Cross-Modality Evolution19 Dec
- 2024OmniEdit: Building Image Editing Generalist Models Through Specialist Supervision11 Nov
- 2023GlyphControl: Glyph Conditional Control for Visual Text Generation29 May
- 2023TextDiffuser: Diffusion Models as Text Painters18 May
- 2023Adding Conditional Control to Text-to-Image Diffusion Models10 Feb
- 2023GLIGEN: Open-Set Grounded Text-to-Image Generation17 Jan
- 2022Shifted Diffusion for Text-to-image Generation24 Nov
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructions17 Nov
Other references · 52
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2014ImageNet Large Scale Visual Recognition Challengecited by 8,441
- 2022Scalable Diffusion Models with Transformerscited by 5,931
- 2022Flow Matching for Generative Modelingcited by 5,426
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
- 2021Zero-Shot Text-to-Image Generationcited by 4,276
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
38 more
- 2022Scaling Instruction-Finetuned Language Modelscited by 2,997
- 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,409
- 2014Conditional Generative Adversarial Netscited by 2,152
- 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,903
- 2022Exploring CLIP for Assessing the Look and Feel of Imagescited by 974
- 2025Qwen-Image Technical Reportcited by 973
- 2023PixArt-α: Fast Training of Diffusion Transformer for Photorealistic Text-to-Image Synthesiscited by 854
- 2025Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scalingcited by 787
- 2024Autoregressive Model Beats Diffusion: Llama for Scalable Image Generationcited by 760
- 2025Mean Flows for One-step Generative Modelingcited by 524
- 2025Step1X-Edit: A Practical Framework for General Image Editingcited by 417
- 2023InstaFlow: One Step is Enough for High-Quality Diffusion-Based Text-to-Image Generationcited by 387
- 2024Discrete Flow Matchingcited by 301
- 2024UltraEdit: Instruction-based Fine-Grained Image Editing at Scalecited by 266
- 2023Drag Your GAN: Interactive Point-based Manipulation on the Generative Image Manifoldcited by 218
- 2023I2SB: Image-to-Image Schr"odinger Bridgecited by 214
- 2023Denoising Diffusion Bridge Modelscited by 171
- 2024Fluid: Scaling Autoregressive Text-to-image Generative Models with Continuous Tokenscited by 147
- 2024Randomized Autoregressive Visual Generationcited by 125
- 2024MaskBit: Embedding-free Image Generation via Bit Tokenscited by 96
- 2025Beyond Next-Token: Next-X Prediction for Autoregressive Visual Generationcited by 71
- 2025GPT-IMAGE-EDIT-1.5M: A Million-Scale, GPT-Generated Image Datasetcited by 68
- 2025Pico-Banana-400K: A Large-Scale Dataset for Text-Guided Image Editingcited by 58
- 2022Language Modelling with Pixelscited by 53
- 2025Force Prompting: Video Generation Models Can Learn and Generalize Physics-based Control Signalscited by 51
- 2025Democratizing Text-to-Image Masked Generative Models with Compact Text-Aware One-Dimensional Tokenscited by 48
- 2021Robust Open-Vocabulary Translation from Visual Text Representationscited by 47
- 2025AlphaFlow: Understanding and Improving MeanFlow Modelscited by 40
- 2024PixWizard: Versatile Image-to-Image Visual Assistant with Open-Language Instructionscited by 31
- 2020High Performance I/O For Large Scale Deep Learningcited by 25
- 2025Dense2MoE: Restructuring Diffusion Transformer to MoE for Efficient Text-to-Image Generationcited by 16
- 2025Residual Diffusion Bridge Model for Image Restorationcited by 14
- 2025ThermalGen: Style-Disentangled Flow-Based Generative Models for RGB-to-Thermal Image Translationcited by 13
- 2025From Principles to Applications: A Comprehensive Survey of Discrete Tokenizers in Generation, Comprehension, Recommendation, and Information Retrievalcited by 11
- 2025UnicEdit-10M: A Dataset and Benchmark Breaking the Scale-Quality Barrier via Unified Verification for Reasoning-Enriched Editscited by 9
- 2024Pixel Sentence Representation Learningcited by 7
- 2025Seeing is Not Reasoning: MVPBench for Graph-based Evaluation of Multi-path Visual Physical CoTcited by 6
- 2025Latent Harmony: Synergistic Unified UHD Image Restoration via Latent Space Regularization and Controllable Refinementcited by 3
50 most cited of 52 All 52 (JSON)
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026Multimodal Flow: Unified Flow Modeling of Language and Vision in Embedding Spaces
- 2026Best of Both Worlds: Multimodal Reasoning and Generation via Unified Discrete Flow Matching
- 2026VINO: A Unified Visual Generator with Interleaved OmniModal Context
- 2025Draw ALL Your Imagine: A Holistic Benchmark and Agent Framework for Complex Instruction-based Image Generation
- 2024Generative Visual Instruction Tuning
- 2026Large Language Models are Universal Reasoners for Visual Generation
- 2025MIGE: Mutually Enhanced Multimodal Instruction-Based Image Generation and Editing
- 2026Contextual Flow Matching: Adaptive Step Selection in Flow Models for Efficient Visual Generation