mlsanityData to 14 Oct 2026

ViewMask-1-to-3: Multi-View Consistent Image Generation via Multimodal Discrete Diffusion Models

arXiv 2512.14099 ↗First posted 16 Dec 2025cs.CVcited by 1

On the map: Diffusion models → Image generation, text-to-image and editing

Abstract (arXiv)

Motivated by discrete diffusion's success in language-vision modeling, we explore its potential for multi-view generation, a task dominated by continuous approaches. We introduce ViewMask-1-to-3, formulating multi-view generation as a discrete sequence modeling problem where each viewpoint is represented as visual tokens from MAGVIT-v2. Through discrete diffusion via masked token prediction, our approach enables progressive multi-view generation via iterative token unmasking, unifying language and vision in a shared token space. Importantly, simple random masking combined with self-attention naturally encourages cross-view consistency without specialized architectures or 3D geometric priors. Our method outperforms the baseline on the GSO and 3D-FUTURE benchmarks, ranking first on average across standard image metrics, and achieving a 10.6% higher IoU than continuous diffusion models on 3D-FUTURE. Furthermore, the proposed framework can be naturally extended to support text-to-image generation and multimodal understanding, highlighting its potential toward a more unified paradigm for multimodal understanding and generation.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 68 of its 78 references that are in the map. First posted on arXiv 16 Dec 2025.

Builds on

68 of 78 references.

Closest ancestors · 9

Same direction, newest first

  1. 2025Lumina-DiMOO: An Omni Diffusion Large Language Model for Multi-Modal Generation and Understanding7 Oct
  2. 2025Muddit: Liberating Generation Beyond Text-to-Image with a Unified Discrete Diffusion Model29 May
  3. 2025LLaDA-V: Large Language Diffusion Models with Visual Instruction Tuning22 May
  4. 2025MMaDA: Multimodal Large Diffusion Language Models21 May
  5. 2024Emu3: Next-Token Prediction is All You Need27 Sep
  6. 2024OmniGen: Unified Image Generation17 Sep
  7. 2023GenEval: An Object-Focused Framework for Evaluating Text-to-Image Alignment17 Oct
  8. 2022Unified Discrete Diffusion for Simultaneous Vision-Language Generation27 Nov
  9. 2022Hierarchical Text-Conditional Image Generation with CLIP Latents13 Apr

Other references · 59

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  3. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  4. 2017Neural Discrete Representation Learningcited by 4,712
  5. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
  6. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
  7. 2021Structured Denoising Diffusion Models in Discrete State-Spacescited by 1,719
  8. 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,540
  9. 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,489
  10. 2021Efficient Geometry-aware 3D Generative Adversarial Networkscited by 1,205
  11. 2022MaskGIT: Masked Generative Image Transformercited by 1,099
  12. 2023MVDream: Multi-view Diffusion for 3D Generationcited by 938
38 more
  1. 2025Large Language Diffusion Modelscited by 912
  2. 2024Simple and Effective Masked Diffusion Language Modelscited by 848
  3. 2023DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creationcited by 843
  4. 2024Autoregressive Model Beats Diffusion: Llama for Scalable Image Generationcited by 777
  5. 2023Objaverse-XL: A Universe of 10M+ 3D Objectscited by 774
  6. 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 770
  7. 2024Show-o: One Single Transformer to Unify Multimodal Understanding and Generationcited by 752
  8. 2020pi-GAN: Periodic Implicit Generative Adversarial Networks for 3D-Aware Image Synthesiscited by 708
  9. 2020GRAF: Generative Radiance Fields for 3D-Aware Image Synthesiscited by 689
  10. 2023Wonder3D: Single Image to 3D using Cross-Domain Diffusioncited by 689
  11. 2023SyncDreamer: Generating Multiview-consistent Images from a Single-view Imagecited by 645
  12. 2023Language Model Beats Diffusion -- Tokenizer is Key to Visual Generationcited by 640
  13. 2023One-2-3-45: Any Single Image to 3D Mesh in 45 Seconds without Per-Shape Optimizationcited by 560
  14. 2025Dream 7B: Diffusion Large Language Modelscited by 544
  15. 2023Zero123++: a Single Image to Consistent Multi-view Diffusion Base Modelcited by 521
  16. 2024Janus: Decoupling Visual Encoding for Unified Multimodal Understanding and Generationcited by 457
  17. 2024InstantMesh: Efficient 3D Mesh Generation from a Single Image with Sparse-view Large Reconstruction Modelscited by 433
  18. 2024SEED-X: Multimodal Models with Unified Multi-granularity Comprehension and Generationcited by 331
  19. 20203D-FUTURE: 3D Furniture shape with TextUREcited by 311
  20. 2022DiffusionBERT: Improving Generative Masked Language Models with Diffusion Modelscited by 214
  21. 2023Scalable 3D Captioning with Pretrained Modelscited by 203
  22. 2023Habitat Synthetic Scenes Dataset (HSSD-200): An Analysis of 3D Scene Scale and Realism Tradeoffs for ObjectGoal Navigationcited by 167
  23. 2025SANA 1.5: Efficient Scaling of Training-Time and Inference-Time Compute in Linear Diffusion Transformercited by 165
  24. 2023SceneScape: Text-Driven Consistent Scene Generationcited by 160
  25. 2024MV-Adapter: Multi-view Consistent Image Generation Made Easycited by 112
  26. 2024MVSGaussian: Fast Generalizable Gaussian Splatting Reconstruction from Multi-View Stereocited by 87
  27. 2023EpiDiff: Enhancing Multi-View Synthesis via Localized Epipolar-Constrained Diffusioncited by 72
  28. 2024SPAD : Spatially Aware Multiview Diffuserscited by 62
  29. 2023ImageBrush: Learning Visual In-Context Instructions for Exemplar-Based Image Manipulationcited by 59
  30. 2023ViVid-1-to-3: Novel View Synthesis with Video Diffusion Modelscited by 58
  31. 2025VARGPT: Unified Understanding and Generation in a Visual Autoregressive Multimodal Large Language Modelcited by 44
  32. 2025AI Flow: Perspectives, Scenarios, and Approachescited by 44
  33. 2022Positive-incentive Noisecited by 39
  34. 2023Variational Positive-incentive Noise: How Noise Benefits Modelscited by 38
  35. 2025Lumina-mGPT 2.0: Stand-Alone AutoRegressive Image Modelingcited by 37
  36. 2024View Selection for 3D Captioning via Diffusion Rankingcited by 32
  37. 2025Objaverse++: Curated 3D Object Dataset with Quality Annotationscited by 20
  38. 2024EmoTalk3D: High-Fidelity Free-View Synthesis of Emotional 3D Talking Headcited by 16

50 most cited of 59 All 59 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

  1. 2026AHAP: Reconstructing Arbitrary Humans from Arbitrary Perspectives with Geometric Priorscited by 1

Similar, not cited

Close in wording, no citation either way

  1. 2026Intern Lumina U2: A Multi-Codebook Diffusion Large Language Model for Omni-Visual Understanding and Image Generation
  2. 2025Generative Multimodal Pretraining with Discrete Diffusion Timestep Tokens
  3. 2024Dual Diffusion for Unified Image Generation and Understanding
  4. 2024Towards Multi-Task Multi-Modal Models: A Video Generative Perspective
  5. 2026Cubic Discrete Diffusion: Discrete Visual Generation on High-Dimensional Representation Tokens
  6. 2025Lavida-O: Elastic Large Masked Diffusion Models for Unified Multimodal Understanding and Generation
  7. 2026High-Fidelity Text-to-Image Generation from Pre-Trained Vision-Language Models via Distribution-Conditioned Diffusion Decoding
  8. 2025Vision as a Dialect: Unifying Visual Understanding and Generation via Text-Aligned Representations