mlsanityData to 14 Oct 2026

InfinityStar: Unified Spacetime AutoRegressive Modeling for Visual Generation

arXiv 2511.04675 ↗First posted 6 Nov 2025cs.CVcited by 45

Not on the map. Why?

Abstract (arXiv)

We introduce InfinityStar, a unified spacetime autoregressive framework for high-resolution image and dynamic video synthesis. Building on the recent success of autoregressive modeling in both vision and language, our purely discrete approach jointly captures spatial and temporal dependencies within a single architecture. This unified design naturally supports a variety of generation tasks such as text-to-image, text-to-video, image-to-video, and long interactive video synthesis via straightforward temporal autoregression. Extensive experiments demonstrate that InfinityStar scores 83.74 on VBench, outperforming all autoregressive models by large margins, even surpassing some diffusion competitors like HunyuanVideo. Without extra optimizations, our model generates a 5s, 720p video approximately 10x faster than leading diffusion-based methods. To our knowledge, InfinityStar is the first discrete autoregressive video generator capable of producing industrial level 720p videos. We release all code and models to foster further research in efficient, high-quality video generation.

Key facts. Cited by 45 papers in the map (data through 14 Oct 2026). Builds on 45 of its 52 references that are in the map. First posted on arXiv 6 Nov 2025.

Builds on

45 of 52 references.

References · 45

  1. 2022Scalable Diffusion Models with Transformerscited by 6,054
  2. 2017Neural Discrete Representation Learningcited by 4,712
  3. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
  4. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
  5. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
  6. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
  7. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
  8. 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,565
  9. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
  10. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
  11. 2024Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Predictioncited by 1,023
  12. 2023GenEval: An Object-Focused Framework for Evaluating Text-to-Image Alignmentcited by 972
33 more
  1. 2024Chameleon: Mixed-Modal Early-Fusion Foundation Modelscited by 927
  2. 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 881
  3. 2025Cosmos World Foundation Model Platform for Physical AIcited by 864
  4. 2024Emu3: Next-Token Prediction is All You Needcited by 781
  5. 2024Autoregressive Model Beats Diffusion: Llama for Scalable Image Generationcited by 777
  6. 2024Show-o: One Single Transformer to Unify Multimodal Understanding and Generationcited by 752
  7. 2023PyTorch FSDP: Experiences on Scaling Fully Sharded Data Parallelcited by 660
  8. 2021VideoGPT: Video Generation using VQ-VAE and Transformerscited by 658
  9. 2024Open-Sora: Democratizing Efficient Video Production for Allcited by 652
  10. 2023Language Model Beats Diffusion -- Tokenizer is Key to Visual Generationcited by 640
  11. 2023VideoCrafter1: Open Diffusion Models for High-Quality Video Generationcited by 535
  12. 2023VideoPoet: A Large Language Model for Zero-Shot Video Generationcited by 492
  13. 2024Transfusion: Predict the Next Token and Diffuse Images with One Multi-Modal Modelcited by 483
  14. 2024ELLA: Equip Diffusion Models with LLM for Enhanced Semantic Alignmentcited by 475
  15. 2024Janus: Decoupling Visual Encoding for Unified Multimodal Understanding and Generationcited by 457
  16. 2024Panda-70M: Captioning 70M Videos with Multiple Cross-Modality Teacherscited by 393
  17. 2024SANA: Efficient High-Resolution Image Synthesis with Linear Diffusion Transformerscited by 340
  18. 2024Infinity: Scaling Bitwise AutoRegressive Modeling for High-Resolution Image Synthesiscited by 304
  19. 2023Show-1: Marrying Pixel and Latent Diffusion Models for Text-to-Video Generationcited by 302
  20. 2024Autoregressive Video Generation without Vector Quantizationcited by 186
  21. 2025UniTok: A Unified Tokenizer for Visual Generation and Understandingcited by 153
  22. 2024Fluid: Scaling Autoregressive Text-to-image Generative Models with Continuous Tokenscited by 147
  23. 2024MiraData: A Large-Scale Video Dataset with Long Durations and Structured Captionscited by 146
  24. 2023Make Pixels Dance: High-Dynamic Video Generationcited by 140
  25. 2024OmniTokenizer: A Joint Image-Video Tokenizer for Visual Generationcited by 118
  26. 2024Image and Video Tokenization with Binary Spherical Quantizationcited by 112
  27. 2025Tarsier2: Advancing Large Vision-Language Models from Detailed Video Description to Comprehensive Video Understandingcited by 81
  28. 2025Goku: Flow Based Video Generative Foundation Modelscited by 67
  29. 2024Liquid: Language Models are Scalable and Unified Multi-modal Generatorscited by 63
  30. 2025NextStep-1: Toward Autoregressive Image Generation with Continuous Tokens at Scalecited by 57
  31. 2025Waver: Wave Your Way to Lifelike Video Generationcited by 52
  32. 2024Evaluation Agent: Efficient and Promptable Evaluation Framework for Visual Generative Modelscited by 41
  33. 2024Switti: Designing Scale-Wise Transformers for Text-to-Image Synthesiscited by 33

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 4; 2026: 41.

45 papers.

Sort:

By area:

  1. 2026Helios: Real Real-Time Long Video Generation Modelcited by 65
  2. 2025End-to-End Training for Autoregressive Video Diffusion via Self-Resamplingcited by 52
  3. 2025Spatia: Video Generation with Updatable Spatial Memorycited by 40
  4. 2026WorldVLN: Autoregressive World Action Model for Aerial Vision-Language Navigationcited by 14
  5. 2026StableWorld: Towards Stable and Consistent Long Interactive Video Generationcited by 12
  6. 2026PISCO: Precise Video Instance Insertion with Sparse Controlcited by 10
  7. 2026Tele-Omni: a Unified Multimodal Framework for Video Generation and Editingcited by 8
  8. 2026The Pulse of Motion: Measuring Physical Frame Rate from Visual Dynamicscited by 8
  9. 2025Semantic Context Matters: Improving Conditioning for Autoregressive Modelscited by 7
  10. 2026RAVEN: Real-time Autoregressive Video Extrapolation with Consistency-model GRPOcited by 7
  11. 2026GeoWorld: Geometric World Modelscited by 6
  12. 2026EvoGuard: An Extensible Agentic RL-based Framework for Practical and Evolving AI-Generated Image Detectioncited by 6
33 more
  1. 2026Towards Holistic Modeling for Video Frame Interpolation with Auto-regressive Diffusion Transformerscited by 4
  2. 2026ProGVC: Progressive-based Generative Video Compression via Auto-Regressive Context Modelingcited by 3
  3. 2026Generative Refinement Networks for Visual Synthesiscited by 3
  4. 2026Enhancing Video Physical Consistency via Role-aware Joint Training and Modality-decoupled Denoisingcited by 3
  5. 2026VAR RL Done Right: Tackling Asynchronous Policy Conflicts in Visual Autoregressive Generationcited by 2
  6. 2026FastSTAR: Spatiotemporal Token Pruning for Efficient Autoregressive Video Synthesiscited by 2
  7. 2026HiFlow: Tokenization-Free Scale-Wise Autoregressive Policy Learning via Flow Matchingcited by 2
  8. 2026NaviCache: Test-Time Self-Calibration Caching for Video Generationcited by 2
  9. 2026Visko Orbis 1.0: A Live Model for Real-Time Interactive Long Video Generationcited by 2
  10. 2026GRNEdit: Efficient General Video Editing from a New Binary-Evidence Perspective in Generative Refinement Networkscited by 2
  11. 2026PaperFit: Vision-in-the-Loop Typesetting Optimization for Scientific Documentscited by 1
  12. 2026Benchmarking and Evolving Reason-Reflect-Rectify for Reflective Visual Generationcited by 1
  13. 2026Flow as Flow: Modeling Robot Velocity Fields as Probability Velocity Fields for Flow-Based Object Manipulationcited by 1
  14. 2026VGIF-Score: Interpretable and Diagnostic Evaluation of Spatio-Temporal Instruction Following in Video Generationcited by 1
  15. 2025DiverseVAR: Balancing Diversity and Quality of Next-Scale Visual Autoregressive Modelscited by 0
  16. 2026StepVAR: Structure-Texture Guided Pruning for Visual Autoregressive Modelscited by 0
  17. 2026Test-Time Instance-Specific Parameter Composition: A New Paradigm for Adaptive Generative Modelingcited by 0
  18. 2026HeatKV: Head-tuned KV-cache Compression for Visual Autoregressive Modelingcited by 0
  19. 2026Invaria: Learning Scale and Density Invariance in Point Clouds via Next-Resolution Predictioncited by 0
  20. 2026Channel-wise Vector Quantizationcited by 0
  21. 2026Edit the Bits, Diff the Codes: Bitwise Residual Editing for Visual Autoregressive Modelscited by 0
  22. 2026SACE: Concept Erasure at the Semantic Singularity in Visual Autoregressive Modelscited by 0
  23. 2026Training-Free Semantic Correction for Autoregressive Visual Modelscited by 0
  24. 2026HumanForge: A Human-Centric Deepfake Video Benchmark with Multi-Agent Forgery Rationalescited by 0
  25. 2026Improving Sample Diversity in Autoregressive Text-to-Image Generation via Cluster Truncationcited by 0
  26. 2026SparSTAR: Sparse Attention for SpaceTime AutoRegressive Video Synthesiscited by 0
  27. 2026Photorealistic Novel View Synthesis of Human Faces using Next-Scale Transformerscited by 0
  28. 2026WALL-SS: Scaling Long-horizon World Models via Next-Scale Autoregressioncited by 0
  29. 2026Logit Refiner: Improving Visual Autoregressive Models via Intra-Scale Dependency Modelingcited by 0
  30. 2026Edit-VAR: Taming Visual Autoregressive Model for Precise Video Editingcited by 0
  31. 2026RoboSTAR: Next-Scale Autoregressive Sign Language Translation for Humanoid Robotscited by 0
  32. 2026Exploring Attention Sinks in Text-to-Image Transformers from Diffusion and Autoregressive Modelscited by 0
  33. 2026HGA-Quant: Heterogeneity-Aware Quantization for AutoRegressive Visual Generation Modelscited by 0