mlsanityData to 7 Oct 2026

Infinity: Scaling Bitwise AutoRegressive Modeling for High-Resolution Image Synthesis

arXiv 2412.04431 ↗First posted 5 Dec 2024cs.CVcited by 297

Not on the map. Why?

Cited by 47 in Diffusion models, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

We present Infinity, a Bitwise Visual AutoRegressive Modeling capable of generating high-resolution, photorealistic images following language instruction. Infinity redefines visual autoregressive model under a bitwise token prediction framework with an infinite-vocabulary tokenizer & classifier and bitwise self-correction mechanism, remarkably improving the generation capacity and details. By theoretically scaling the tokenizer vocabulary size to infinity and concurrently scaling the transformer size, our method significantly unleashes powerful scaling capabilities compared to vanilla VAR. Infinity sets a new record for autoregressive text-to-image models, outperforming top-tier diffusion models like SD3-Medium and SDXL. Notably, Infinity surpasses SD3-Medium by improving the GenEval benchmark score from 0.62 to 0.73 and the ImageReward benchmark score from 0.87 to 0.96, achieving a win rate of 66%. Without extra optimization, Infinity generates a high-quality 1024x1024 image in 0.8 seconds, making it 2.6x faster than SD3-Medium and establishing it as the fastest text-to-image model. Models and codes will be released to promote further exploration of Infinity for visual generation and unified tokenizer modeling.

Key facts. Cited by 297 papers in the map (data through 7 Oct 2026). Builds on 72 of its 85 references that are in the map. First posted on arXiv 5 Dec 2024.

Builds on

72 of 85 references.

References · 72

  1. 2017Attention Is All You Needcited by 59,932
  2. 2020Language Models are Few-Shot Learnerscited by 32,199
  3. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  4. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  5. 2023GPT-4 Technical Reportcited by 18,132
  6. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  7. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
  8. 2020Denoising Diffusion Implicit Modelscited by 9,655
  9. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
  10. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
  11. 2020Scaling Laws for Neural Language Modelscited by 6,411
  12. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
38 more
  1. 2022Scalable Diffusion Models with Transformerscited by 5,931
  2. 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,304
  3. 2017Neural Discrete Representation Learningcited by 4,650
  4. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,581
  5. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
  6. 2021Zero-Shot Text-to-Image Generationcited by 4,276
  7. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
  8. 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,067
  9. 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,736
  10. 2022OPT: Open Pre-trained Transformer Language Modelscited by 3,464
  11. 2023Qwen Technical Reportcited by 3,273
  12. 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,229
  13. 2022Scaling Instruction-Finetuned Language Modelscited by 2,997
  14. 2022Training Compute-Optimal Large Language Modelscited by 2,927
  15. 2022BLOOM: A 176B-Parameter Open-Access Multilingual Language Modelcited by 1,968
  16. 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Stepscited by 1,961
  17. 2021LAION-400M: Open Dataset of CLIP-Filtered 400 Million Image-Text Pairscited by 1,544
  18. 2019Generating Diverse High-Fidelity Images with VQ-VAE-2cited by 1,376
  19. 2022Scaling Autoregressive Models for Content-Rich Text-to-Image Generationcited by 1,287
  20. 2023PaLM 2 Technical Reportcited by 1,154
  21. 2022MaskGIT: Masked Generative Image Transformercited by 1,082
  22. 2023ImageReward: Learning and Evaluating Human Preferences for Text-to-Image Generationcited by 1,010
  23. 2024Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Predictioncited by 1,005
  24. 2023GenEval: An Object-Focused Framework for Evaluating Text-to-Image Alignmentcited by 946
  25. 2022DPM-Solver++: Fast Solver for Guided Sampling of Diffusion Probabilistic Modelscited by 924
  26. 2024Chameleon: Mixed-Modal Early-Fusion Foundation Modelscited by 904
  27. 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 867
  28. 2023PixArt-α: Fast Training of Diffusion Transformer for Photorealistic Text-to-Image Synthesiscited by 854
  29. 2023Human Preference Score v2: A Solid Benchmark for Evaluating Human Preferences of Text-to-Image Synthesiscited by 847
  30. 2024Emu3: Next-Token Prediction is All You Needcited by 761
  31. 2024Autoregressive Model Beats Diffusion: Llama for Scalable Image Generationcited by 760
  32. 2024Show-o: One Single Transformer to Unify Multimodal Understanding and Generationcited by 734
  33. 2022Autoregressive Image Generation using Residual Quantizationcited by 706
  34. 2021Vector-quantized Image Modeling with Improved VQGANcited by 656
  35. 2024Autoregressive Image Generation without Vector Quantizationcited by 644
  36. 2023Language Model Beats Diffusion -- Tokenizer is Key to Visual Generationcited by 633
  37. 2020Scaling Laws for Autoregressive Generative Modelingcited by 510
  38. 2022All are Worth Words: A ViT Backbone for Diffusion Modelscited by 498

50 most cited of 72 All 72 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 2; 2025: 167; 2026: 128.

297 papers.

Sort:

By area:

  1. 2025Qwen-Image Technical Reportcited by 973
  2. 2025ImgEdit: A Unified Image Editing Dataset and Benchmarkcited by 225
  3. 2025WISE: A World Knowledge-Informed Semantic Evaluation for Text-to-Image Generationcited by 196
  4. 2025HPSv3: Towards Wide-Spectrum Human Preference Scorecited by 196
  5. 2025SANA 1.5: Efficient Scaling of Training-Time and Inference-Time Compute in Linear Diffusion Transformercited by 165
  6. 2025T2I-R1: Reinforcing Image Generation with Collaborative Semantic-level and Token-level CoTcited by 162
  7. 2025Emu3.5: Native Multimodal Models are World Learnerscited by 119
  8. 2025Mogao: An Omni Foundation Model for Interleaved Multi-Modal Generationcited by 108
  9. 2025Lumina-Image 2.0: A Unified and Efficient Image Generative Frameworkcited by 93
  10. 2025SimpleAR: Pushing the Frontier of Autoregressive Visual Generation through Pretraining, SFT, and RLcited by 85
  11. 2025Unified Multimodal Understanding and Generation Models: Advances, Challenges, and Opportunitiescited by 81
  12. 2025TIIF-Bench: How Does Your T2I Model Follow Your Instructions?cited by 64
38 more
  1. 2025Dual Data Alignment Makes AI-Generated Image Detector Easier Generalizablecited by 58
  2. 2025GPT-ImgEval: A Comprehensive Benchmark for Diagnosing GPT4o in Image Generationcited by 57
  3. 2025NextStep-1: Toward Autoregressive Image Generation with Continuous Tokens at Scalecited by 55
  4. 2025GoT-R1: Unleashing Reasoning Capability of MLLM for Visual Generation with Reinforcement Learningcited by 51
  5. 2025OneCAT: Decoder-Only Auto-Regressive Model for Unified Understanding and Generationcited by 50
  6. 2025VARGPT: Unified Understanding and Generation in a Visual Autoregressive Multimodal Large Language Modelcited by 44
  7. 2025Fractal Generative Modelscited by 44
  8. 2025InfinityStar: Unified Spacetime AutoRegressive Modeling for Visual Generationcited by 43
  9. 2025Interleaving Reasoning for Better Text-to-Image Generationcited by 40
  10. 2025Lumina-mGPT 2.0: Stand-Alone AutoRegressive Image Modelingcited by 35
  11. 2025FastVAR: Linear Visual Autoregressive Modeling via Cached Token Pruningcited by 34
  12. 2025VLA-OS: Structuring and Dissecting Planning Representations and Paradigms in Vision-Language-Action Modelscited by 34
  13. 2025AIGI-Holmes: Towards Explainable and Generalizable AI-Generated Image Detection via Multimodal Large Language Modelscited by 33
  14. 2025Easier Painting Than Thinking: Can Text-to-Image Models Set the Stage, but Not Direct the Play?cited by 33
  15. 2025UniGen: Enhanced Training & Test-Time Strategies for Unified Multimodal Understanding and Generationcited by 32
  16. 2025Selftok: Discrete Visual Tokens of Autoregression, by Diffusion, and for Reasoningcited by 31
  17. 2025Draw ALL Your Imagine: A Holistic Benchmark and Agent Framework for Complex Instruction-based Image Generationcited by 30
  18. 2025Neighboring Autoregressive Modeling for Efficient Visual Generationcited by 29
  19. 2025Bridging Continuous and Discrete Tokens for Autoregressive Visual Generationcited by 29
  20. 2026Qwen-Image-2.0 Technical Reportcited by 28
  21. 2024Next Token Prediction Towards Multimodal Intelligence: A Comprehensive Surveycited by 27
  22. 2025Frequency Autoregressive Image Generation with Continuous Tokenscited by 27
  23. 2026SenseNova-U1: Unifying Multimodal Understanding and Generation with NEO-unify Architecturecited by 27
  24. 2024Next Patch Prediction for Autoregressive Visual Generationcited by 25
  25. 2025TextAtlas5M: A Large-scale Dataset for Dense Text Image Generationcited by 25
  26. 2025LMM4LMM: Benchmarking and Evaluating Large-multimodal Image Generation with LMMscited by 24
  27. 2025ICE-Bench: A Unified and Comprehensive Benchmark for Image Creating and Editingcited by 23
  28. 2025UniGenBench++: A Unified Semantic Evaluation Benchmark for Text-to-Image Generationcited by 23
  29. 2025FlexVAR: Flexible Visual Autoregressive Modeling without Residual Predictioncited by 22
  30. 2025Memory-Efficient Visual Autoregressive Modeling with Scale-Aware KV Cache Compressioncited by 22
  31. 2025Training-Free Text-Guided Image Editing with Visual Autoregressive Modelcited by 21
  32. 2025VARGPT-v1.1: Improve Visual Autoregressive Large Unified Model via Iterative Instruction Tuning and Reinforcement Learningcited by 21
  33. 2025Visual Autoregressive Modeling for Instruction-Guided Image Editingcited by 21
  34. 2025Towards Sequence Modeling Alignment between Tokenizer and Autoregressive Modelcited by 20
  35. 2025HMAR: Efficient Hierarchical Masked Auto-Regressive Image Generationcited by 19
  36. 2025GenDoP: Auto-regressive Camera Trajectory Generation as a Director of Photographycited by 18
  37. 2025SCALAR: Scale-wise Controllable Visual Autoregressive Learningcited by 18
  38. 2025DetailFlow: 1D Coarse-to-Fine Autoregressive Image Generation via Next-Detail Predictioncited by 17

50 most cited of 297 All 297 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2025Token-Shuffle: Towards High-Resolution Image Generation with Autoregressive Models
  2. 2026VibeToken: Scaling 1D Image Tokenizers and Autoregressive Models for Dynamic Resolution Generations
  3. 2024High-Resolution Image Synthesis via Next-Token Prediction
  4. 2025NSARM: Next-Scale Autoregressive Modeling for Robust Real-World Image Super-Resolution
  5. 2025Skywork UniPic: Unified Autoregressive Modeling for Visual Understanding and Generation
  6. 2025Learnings from Scaling Visual Tokenizers for Reconstruction and Generation
  7. 2025REAR: Rethinking Visual Autoregressive Models via Generator-Tokenizer Consistency Regularization
  8. 2025Learning to Expand Images for Efficient Visual Autoregressive Modeling