mlsanityData to 14 Oct 2026

Skywork UniPic: Unified Autoregressive Modeling for Visual Understanding and Generation

arXiv 2508.03320 ↗First posted 5 Aug 2025cs.CVcited by 17

Not on the map. Why?

Abstract (arXiv)

We introduce Skywork UniPic, a 1.5 billion-parameter autoregressive model that unifies image understanding, text-to-image generation, and image editing within a single architecture-eliminating the need for task-specific adapters or inter-module connectors-and demonstrate that compact multimodal systems can achieve state-of-the-art performance on commodity hardware. Skywork UniPic achieves a GenEval score of 0.86, surpassing most existing unified models; sets a new DPG-Bench complex-generation record of 85.5; attains 5.83 on GEditBench-EN and 3.49 on ImgEdit-Bench for image editing; and generates 1024 x 1024 images with under 15 GB of GPU memory (e.g., RTX 4090). (1) a decoupled encoding strategy that leverages a masked autoregressive encoder for synthesis and a SigLIP2 encoder for understanding, all feeding a shared autoregressive decoder; (2) a progressive, resolution-aware training schedule scaling from 256 x 256 to 1024 x 1024 while dynamically unfreezing parameters to balance capacity and stability; and (3) meticulously curated, 100 million-scale datasets augmented with task-specific reward models to refine generation and editing objectives. By demonstrating that high-fidelity multimodal integration need not incur prohibitive resource demands, Skywork UniPic establishes a practical paradigm for deployable, high-fidelity multimodal AI. Code and weights are publicly available at https://huggingface.co/Skywork/Skywork-UniPic-1.5B.

Key facts. Cited by 17 papers in the map (data through 14 Oct 2026). Builds on 34 of its 48 references that are in the map. First posted on arXiv 5 Aug 2025.

Builds on

34 of 48 references.

References · 34

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  4. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
  5. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,614
  6. 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,253
  7. 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,109
  8. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
  9. 2023Pick-a-Pic: An Open Dataset of User Preferences for Text-to-Image Generationcited by 977
  10. 2023GenEval: An Object-Focused Framework for Evaluating Text-to-Image Alignmentcited by 972
  11. 2025Emerging Properties in Unified Multimodal Pretrainingcited by 897
  12. 2023Human Preference Score v2: A Solid Benchmark for Evaluating Human Preferences of Text-to-Image Synthesiscited by 890
22 more
  1. 2023PixArt-α: Fast Training of Diffusion Transformer for Photorealistic Text-to-Image Synthesiscited by 864
  2. 2024Autoregressive Model Beats Diffusion: Llama for Scalable Image Generationcited by 777
  3. 2024Show-o: One Single Transformer to Unify Multimodal Understanding and Generationcited by 752
  4. 2024Autoregressive Image Generation without Vector Quantizationcited by 651
  5. 2023MagicBrush: A Manually Annotated Dataset for Instruction-Guided Image Editingcited by 624
  6. 2024Transfusion: Predict the Next Token and Diffuse Images with One Multi-Modal Modelcited by 483
  7. 2024ELLA: Equip Diffusion Models with LLM for Enhanced Semantic Alignmentcited by 475
  8. 2023Generative Multimodal Models are In-Context Learnerscited by 446
  9. 2022DeepSpeed Inference: Enabling Efficient Inference of Transformer Models at Unprecedented Scalecited by 407
  10. 2025BLIP3-o: A Family of Fully Open Unified Multimodal Models-Architecture, Training and Datasetcited by 376
  11. 2024Hunyuan-DiT: A Powerful Multi-Resolution Diffusion Transformer with Fine-Grained Chinese Understandingcited by 298
  12. 2024Playground v2.5: Three Insights towards Enhancing Aesthetic Quality in Text-to-Image Generationcited by 256
  13. 2025In-Context Edit: Enabling Instructional Image Editing with In-Context Generation in Large Scale Diffusion Transformercited by 204
  14. 2024TokenFlow: Unified Image Tokenizer for Multimodal Understanding and Generationcited by 202
  15. 2025AnyEdit: Edit Any Knowledge Encoded in Language Modelscited by 76
  16. 2025Harmonizing Visual Representations for Unified Multimodal Understanding and Generationcited by 74
  17. 2025Unified Autoregressive Visual Generation and Understanding with Continuous Tokenscited by 51
  18. 2025OpenUni: A Simple Baseline for Unified Multimodal Understanding and Generationcited by 46
  19. 20241.58-bit FLUXcited by 31
  20. 2024HumanEdit: A High-Quality Human-Rewarded Dataset for Instruction-based Image Editingcited by 29
  21. 2025SuperEdit: Rectifying and Facilitating Supervision for Instruction-Based Image Editingcited by 18
  22. 2023Nova: Generative Language Models for Assembly Code with Hierarchical Attention and Contrastive Learningcited by 12

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 6; 2026: 11.

17 papers.

Sort:

By area:

  1. 2025Reconstruction Alignment Improves Unified Multimodal Modelscited by 49
  2. 2026InternVL-U: Democratizing Unified Multimodal Models for Understanding, Reasoning, Generation and Editingcited by 28
  3. 2025Skywork-R1V4: Toward Agentic Multimodal Intelligence through Interleaved Thinking with Images and DeepResearchcited by 27
  4. 2026Generation Enhances Understanding in Unified Multimodal Models via Multi-Representation Generationcited by 20
  5. 2025Unified Multimodal Models as Auto-Encoderscited by 13
  6. 2025VQRAE: Representation Quantization Autoencoders for Multimodal Understanding, Generation and Reconstructioncited by 10
  7. 2025LightFusion: A Light-weighted, Double Fusion Framework for Unified Multimodal Understanding and Generationcited by 9
  8. 2026Skywork UniPic 3.0: Unified Multi-Image Composition via Sequence Modelingcited by 7
  9. 2026Covo-Audio Technical Reportcited by 7
  10. 2026Wan-Weaver: Interleaved Multi-modal Generation via Decoupled Trainingcited by 5
  11. 2026Audio-Visual Intelligence in Large Foundation Modelscited by 2
  12. 2026Images in Sentences: Scaling Interleaved Instructions for Unified Visual Generationcited by 2
5 more
  1. 2025Video4Edit: Viewing Image Editing as a Degenerate Temporal Processcited by 1
  2. 2026DynEval: Holistic Evaluations of T2I Generative Models in the Wildcited by 1
  3. 2026UniCom: Unified Multimodal Modeling via Compressed Continuous Semantic Representationscited by 0
  4. 2026Semantic Generative Tuning for Unified Multimodal Modelscited by 0
  5. 2026C3-UniMM: Causal Cycle-Consistent Unified Multimodal Modeling via Super Alignment and Shared Decoding Spacecited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2026Unified Multimodal Autoregressive Modeling with Shared Context-Visual Tokenizer is Key to Unification
  2. 2026NextFlow: Unified Sequential Modeling Activates Multimodal Understanding and Generation
  3. 2025Semantic Context Matters: Improving Conditioning for Autoregressive Models
  4. 2026UniGen-AR: Unifying Visual Generation with Auto-Regressive Modeling
  5. 2026STARFlow2: Bridging Language Models and Normalizing Flows for Unified Multimodal Generation
  6. 2026Exploring the Performance Frontier of Compact Unified Image Generation Models
  7. 2025Progress by Pieces: Test-Time Scaling for Autoregressive Image Generation
  8. 2025OneCAT: Decoder-Only Auto-Regressive Model for Unified Understanding and Generation