Best of Both Worlds: Multimodal Reasoning and Generation via Unified Discrete Flow Matching
On the map: LLM reasoning → Multimodal reasoning
also in 1 more
Abstract (arXiv)
We propose UniDFlow, a unified discrete flow-matching framework for multimodal understanding, generation, and editing. It decouples understanding and generation via task-specific low-rank adapters, avoiding objective interference and representation entanglement, while a novel reference-based multimodal preference alignment optimizes relative outcomes under identical conditioning, improving faithfulness and controllability without large-scale retraining. UniDFlpw achieves SOTA performance across eight benchmarks and exhibits strong zero-shot generalization to tasks including inpainting, in-context image generation, reference-based editing, and compositional generation, despite no explicit task-specific training.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 66 of its 76 references that are in the map. First posted on arXiv 12 Feb 2026.
Builds on
66 of 76 references.
Closest ancestors · 2
Same direction, newest first
- 2023MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contexts3 Oct
- 2023MMBench: Is Your Multi-modal Model an All-around Player?12 Jul
Other references · 64
- 2017Attention Is All You Needcited by 59,932
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
- 2023Visual Instruction Tuningcited by 7,792
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,069
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,337
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
38 more
- 2021Zero-Shot Text-to-Image Generationcited by 4,276
- 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,131
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
- 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,595
- 2023Qwen Technical Reportcited by 3,273
- 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,048
- 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,534
- 2025Qwen3-VL Technical Reportcited by 2,534
- 2023MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGIcited by 2,044
- 2021Structured Denoising Diffusion Models in Discrete State-Spacescited by 1,665
- 2023MME: A Comprehensive Evaluation Benchmark for Multimodal Large Language Modelscited by 1,624
- 2023MM-Vet: Evaluating Large Multimodal Models for Integrated Capabilitiescited by 1,221
- 2022MaskGIT: Masked Generative Image Transformercited by 1,082
- 2025Qwen-Image Technical Reportcited by 973
- 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 960
- 2023GenEval: An Object-Focused Framework for Evaluating Text-to-Image Alignmentcited by 946
- 2024Chameleon: Mixed-Modal Early-Fusion Foundation Modelscited by 904
- 2025Emerging Properties in Unified Multimodal Pretrainingcited by 855
- 2025Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scalingcited by 787
- 2021Vector Quantized Diffusion Model for Text-to-Image Synthesiscited by 773
- 2023Diffusion Model Alignment Using Direct Preference Optimizationcited by 767
- 2024Show-o: One Single Transformer to Unify Multimodal Understanding and Generationcited by 734
- 2024Eyes Wide Shut? Exploring the Visual Shortcomings of Multimodal LLMscited by 719
- 2023Language Model Beats Diffusion -- Tokenizer is Key to Visual Generationcited by 633
- 2024DeepSeek-VL2: Mixture-of-Experts Vision-Language Models for Advanced Multimodal Understandingcited by 559
- 2024ELLA: Equip Diffusion Models with LLM for Enhanced Semantic Alignmentcited by 455
- 2023Generative Multimodal Models are In-Context Learnerscited by 446
- 2023TokenFlow: Consistent Diffusion Features for Consistent Video Editingcited by 440
- 2025Step1X-Edit: A Practical Framework for General Image Editingcited by 417
- 2023Emu Edit: Precise Image Editing via Recognition and Generation Taskscited by 321
- 2024Discrete Flow Matchingcited by 301
- 2024VILA-U: a Unified Foundation Model Integrating Visual Understanding and Generationcited by 290
- 2023Emu: Enhancing Image Generation Models Using Photogenic Needles in a Haystackcited by 278
- 2025MMaDA: Multimodal Large Diffusion Language Modelscited by 241
- 2024AnyEdit: Mastering Unified High-Quality Image Editing for Any Ideacited by 235
- 2025ImgEdit: A Unified Image Editing Dataset and Benchmarkcited by 225
- 2023JourneyDB: A Benchmark for Generative Image Understandingcited by 203
- 2024OCRBench v2: An Improved Benchmark for Evaluating Large Multimodal Models on Visual Text Localization and Reasoningcited by 165
50 most cited of 64 All 64 (JSON)
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026FlowInOne:Unifying Multimodal Generation as Image-in, Image-out Flow Matching
- 2026UniReason 1.0: A Unified Reasoning Framework for World Knowledge Aligned Image Generation and Editing
- 2025MammothModa2: A Unified AR-Diffusion Framework for Multimodal Understanding and Generation
- 2025UniAlignment: Semantic Alignment for Unified Image Generation, Understanding, Manipulation and Perception
- 2026RewardFlow: Generate Images by Optimizing What You Reward
- 2024EVLM: Self-Reflective Multimodal Reasoning for Cross-Dimensional Visual Editing
- 2025Uni-MMMU: A Massive Multi-discipline Multimodal Unified Benchmark
- 2026Omni-R1: Towards the Unified Generative Paradigm for Multimodal Reasoning