mlsanityData to 7 Oct 2026

Meissonic: Revitalizing Masked Generative Transformers for Efficient High-Resolution Text-to-Image Synthesis

arXiv 2410.08261 ↗First posted 10 Oct 2024cs.CVcited by 55

On the map: Diffusion models → Image generation, text-to-image and editing

Abstract (arXiv)

We present Meissonic, which elevates non-autoregressive masked image modeling (MIM) text-to-image to a level comparable with state-of-the-art diffusion models like SDXL. By incorporating a comprehensive suite of architectural innovations, advanced positional encoding strategies, and optimized sampling conditions, Meissonic substantially improves MIM's performance and efficiency. Additionally, we leverage high-quality training data, integrate micro-conditions informed by human preference scores, and employ feature compression layers to further enhance image fidelity and resolution. Our model not only matches but often exceeds the performance of existing models like SDXL in generating high-quality, high-resolution images. Extensive experiments validate Meissonic's capabilities, demonstrating its potential as a new standard in text-to-image synthesis. We release a model checkpoint capable of producing 1024 × 1024 resolution images.

Key facts. Cited by 55 papers in the map (data through 7 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 55 of its 64 references that are in the map. First posted on arXiv 10 Oct 2024.

Builds on

55 of 64 references.

Closest ancestors · 7

Same direction, newest first

  1. 2023GenEval: An Object-Focused Framework for Evaluating Text-to-Image Alignment17 Oct
  2. 2022InstructPix2Pix: Learning to Follow Image Editing Instructions17 Nov
  3. 2022Null-text Inversion for Editing Real Images using Guided Diffusion Models17 Nov
  4. 2022Versatile Diffusion: Text, Images and Variations All in One Diffusion Model15 Nov
  5. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understanding23 May
  6. 2022Hierarchical Text-Conditional Image Generation with CLIP Latents13 Apr
  7. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Models20 Dec

Other references · 48

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  3. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  4. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  5. 2023Segment Anythingcited by 8,158
  6. 2023Visual Instruction Tuningcited by 7,792
  7. 2022Scalable Diffusion Models with Transformerscited by 5,931
  8. 2022Classifier-Free Diffusion Guidancecited by 5,717
  9. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,581
  10. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
  11. 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,131
  12. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
36 more
  1. 2023Qwen Technical Reportcited by 3,273
  2. 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,229
  3. 2022Scaling Autoregressive Models for Content-Rich Text-to-Image Generationcited by 1,287
  4. 2022MaskGIT: Masked Generative Image Transformercited by 1,082
  5. 2022Plug-and-Play Diffusion Features for Text-Driven Image-to-Image Translationcited by 897
  6. 2023Human Preference Score v2: A Solid Benchmark for Evaluating Human Preferences of Text-to-Image Synthesiscited by 847
  7. 2023Latent Consistency Models: Synthesizing High-Resolution Images with Few-Step Inferencecited by 826
  8. 2021Vector Quantized Diffusion Model for Text-to-Image Synthesiscited by 773
  9. 2024Autoregressive Model Beats Diffusion: Llama for Scalable Image Generationcited by 760
  10. 2023Adversarial Diffusion Distillationcited by 741
  11. 2022Autoregressive Image Generation using Residual Quantizationcited by 706
  12. 2021Vector-quantized Image Modeling with Improved VQGANcited by 656
  13. 2024Improved Distribution Matching Distillation for Fast Image Synthesiscited by 648
  14. 2023Muse: Text-To-Image Generation via Masked Generative Transformerscited by 640
  15. 2023MagicBrush: A Manually Annotated Dataset for Instruction-Guided Image Editingcited by 615
  16. 2022All are Worth Words: A ViT Backbone for Diffusion Modelscited by 498
  17. 2023Scaling up GANs for Text-to-Image Synthesiscited by 492
  18. 2023Emu Edit: Precise Image Editing via Recognition and Generation Taskscited by 321
  19. 2022CogView2: Faster and Better Text-to-Image Generation via Hierarchical Transformerscited by 305
  20. 2024LongRoPE: Extending LLM Context Window Beyond 2 Million Tokenscited by 302
  21. 2024Fast High-Resolution Image Synthesis with Latent Adversarial Diffusion Distillationcited by 276
  22. 2023Q-Diffusion: Quantizing Diffusion Modelscited by 266
  23. 2017PixelSNAIL: An Improved Autoregressive Generative Modelcited by 137
  24. 2024Lumina-Next: Making Lumina-T2X Stronger and Faster with Next-DiTcited by 130
  25. 2021LAFITE: Towards Language-Free Training for Text-to-Image Generationcited by 126
  26. 2024Playground v3: Improving Text-to-Image Alignment with Deep-Fusion Large Language Modelscited by 113
  27. 2024Learning Multi-dimensional Human Preference for Text-to-Image Generationcited by 102
  28. 2024MotionBooth: Motion-Aware Customized Text-to-Video Generationcited by 92
  29. 2023CapsFusion: Rethinking Image-Text Data at Scalecited by 90
  30. 2024FiT: Flexible Vision Transformer for Diffusion Modelcited by 84
  31. 2024Consistent3D: Towards Consistent High-Fidelity Text-to-3D Generation with Deterministic Sampling Priorcited by 60
  32. 2024Make a Cheap Scaling: A Self-Cascade Diffusion Model for Higher-Resolution Adaptationcited by 50
  33. 2024Auto-Encoding Morph-Tokens for Multimodal LLMcited by 30
  34. 2024Stretching Each Dollar: Diffusion Training from Scratch on a Micro-Budgetcited by 30
  35. 2024Diffusion Time-step Curriculum for One Image to 3D Generationcited by 20
  36. 2024K-Sort Arena: Efficient and Reliable Benchmarking for Generative Models via K-wise Human Preferencescited by 16

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 7; 2025: 39; 2026: 9.

55 papers.

Sort:

By area:

  1. 2024AnyEdit: Mastering Unified High-Quality Image Editing for Any Ideacited by 235
  2. 2024HART: Efficient Visual Generation with Hybrid Autoregressive Transformercited by 128
  3. 2025Accelerated Sampling from Masked Diffusion Models via Entropy Bounded Unmaskingcited by 128
  4. 2025Lumina-DiMOO: An Omni Diffusion Large Language Model for Multi-Modal Generation and Understandingcited by 83
  5. 2025Unified Multimodal Understanding and Generation Models: Advances, Challenges, and Opportunitiescited by 81
  6. 2025A Survey on Diffusion Language Modelscited by 75
  7. 2025Harmonizing Visual Representations for Unified Multimodal Understanding and Generationcited by 74
  8. 2025Discrete Diffusion in Large Language and Multimodal Models: A Surveycited by 61
  9. 2025Muddit: Liberating Generation Beyond Text-to-Image with a Unified Discrete Diffusion Modelcited by 52
  10. 2025Lumos-1: On Autoregressive Video Generation with Discrete Diffusion from a Unified Model Perspectivecited by 22
  11. 2025MDNS: Masked Diffusion Neural Sampler via Stochastic Optimal Controlcited by 20
  12. 2025Nautilus: Locality-aware Autoencoder for Scalable Mesh Generationcited by 18
38 more
  1. 2024DiffSensei: Bridging Multi-Modal LLMs and Diffusion Models for Customized Manga Generationcited by 16
  2. 2024Unified Generative and Discriminative Training for Multi-modal Large Language Modelscited by 15
  3. 2025Enhancing Reasoning for Diffusion LLMs via Distribution Matching Policy Optimizationcited by 15
  4. 2024MagicTailor: Component-Controllable Personalization in Text-to-Image Diffusion Modelscited by 14
  5. 2025Decouple and Track: Benchmarking and Improving Video Diffusion Transformers for Motion Transfercited by 14
  6. 2025Lavida-O: Elastic Large Masked Diffusion Models for Unified Multimodal Understanding and Generationcited by 14
  7. 2025Turbo2K: Towards Ultra-Efficient and High-Quality 2K Video Synthesiscited by 13
  8. 2025DC-AR: Efficient Masked Autoregressive Image Generation with Deep Compression Hybrid Tokenizercited by 13
  9. 2025TR2-D2: Tree Search Guided Trajectory-Aware Fine-Tuning for Discrete Diffusioncited by 13
  10. 2025Inference-Time Scaling of Discrete Diffusion Models via Importance Weighting and Optimal Proposal Designcited by 12
  11. 2025Reinforcement Learning Meets Masked Generative Models: Mask-GRPO for Text-to-Image Generationcited by 12
  12. 2025EditMGT: Unleashing Potentials of Masked Generative Transformers in Image Editingcited by 12
  13. 2025Improving Classifier-Free Guidance in Masked Diffusion: Low-Dim Theoretical Insights with High-Dim Impactcited by 11
  14. 2025Towards Better & Faster Autoregressive Image Generation: From the Perspective of Entropycited by 11
  15. 2025Uniform Discrete Diffusion with Metric Path for Video Generationcited by 11
  16. 2024DreamRelation: Bridging Customization and Relation Generationcited by 9
  17. 2025Improving Autoregressive Visual Generation with Cluster-Oriented Token Predictioncited by 9
  18. 2025Conditional Panoramic Image Generation via Masked Autoregressive Modelingcited by 9
  19. 2025Track Any Anomalous Object: A Granular Video Anomaly Detection Pipelinecited by 8
  20. 2025MMaDA-Parallel: Multimodal Large Diffusion Language Models for Thinking-Aware Editing and Generationcited by 8
  21. 2024Bag of Design Choices for Inference of High-Resolution Masked Generative Transformercited by 7
  22. 2025Seeing World Dynamics in a Nutshellcited by 7
  23. 2025Dimathtt[M]O: Distilling Masked Diffusion Models into One-step Generatorcited by 5
  24. 2025From Masks to Worlds: A Hitchhiker's Guide to World Modelscited by 5
  25. 2026HiFi-Inpaint: Towards High-Fidelity Reference-Based Inpainting for Generating Detail-Preserving Human-Product Imagescited by 5
  26. 2025RecTok: Reconstruction Distillation along Rectified Flowcited by 4
  27. 2025PairFlow: Closed-Form Source-Target Coupling for Few-Step Generation in Discrete Flow Modelscited by 4
  28. 2026DreamLite: A Lightweight On-Device Unified Model for Image Generation and Editingcited by 4
  29. 2025ReDDiT: Rehashing Noise for Discrete Visual Generationcited by 3
  30. 2025CoRe^2: Collect, Reflect and Refine to Generate Better and Fastercited by 2
  31. 2026SceneNAT: Masked Generative Modeling for Language-Guided Indoor Scene Synthesiscited by 2
  32. 2025UniCMs: A Unified Consistency Model For Efficient Multimodal Generation and Understandingcited by 1
  33. 2025Personalized Safety Alignment for Text-to-Image Diffusion Modelscited by 1
  34. 2025Accelerating Inference of Masked Image Generators via Reinforcement Learningcited by 1
  35. 2026SNCE: Geometry-Aware Supervision for Scalable Discrete Image Generationcited by 1
  36. 2026FluxLite: Inference-Time Proposal Control for Discrete Diffusion Modelscited by 1
  37. 2025UNCAGE: Contrastive Attention Guidance for Masked Generative Transformers in Text-to-Image Generationcited by 0
  38. 2025Token Painter: Training-Free Text-Guided Image Inpainting via Mask Autoregressive Modelscited by 0

50 most cited of 55 All 55 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2024SANA: Efficient High-Resolution Image Synthesis with Linear Diffusion Transformers
  2. 2024MaskMamba: A Hybrid Mamba-Transformer Model for Masked Image Generation
  3. 2024High-Resolution Image Synthesis via Next-Token Prediction
  4. 2023MAGVLT: Masked Generative Vision-and-Language Transformer
  5. 2024Infinity: Scaling Bitwise AutoRegressive Modeling for High-Resolution Image Synthesis
  6. 2026NanoFLUX: Distillation-Driven Compression of Large Text-to-Image Generation Models for Mobile Devices
  7. 2025Resurrect Mask AutoRegressive Modeling for Efficient and Scalable Image Generation
  8. 2023KOALA: Empirical Lessons Toward Memory-Efficient and Fast Diffusion Models for Text-to-Image Synthesis