Skywork UniPic: Unified Autoregressive Modeling for Visual Understanding and Generation
Not on the map. Why?
Abstract (arXiv)
We introduce Skywork UniPic, a 1.5 billion-parameter autoregressive model that unifies image understanding, text-to-image generation, and image editing within a single architecture-eliminating the need for task-specific adapters or inter-module connectors-and demonstrate that compact multimodal systems can achieve state-of-the-art performance on commodity hardware. Skywork UniPic achieves a GenEval score of 0.86, surpassing most existing unified models; sets a new DPG-Bench complex-generation record of 85.5; attains 5.83 on GEditBench-EN and 3.49 on ImgEdit-Bench for image editing; and generates 1024 x 1024 images with under 15 GB of GPU memory (e.g., RTX 4090). (1) a decoupled encoding strategy that leverages a masked autoregressive encoder for synthesis and a SigLIP2 encoder for understanding, all feeding a shared autoregressive decoder; (2) a progressive, resolution-aware training schedule scaling from 256 x 256 to 1024 x 1024 while dynamically unfreezing parameters to balance capacity and stability; and (3) meticulously curated, 100 million-scale datasets augmented with task-specific reward models to refine generation and editing objectives. By demonstrating that high-fidelity multimodal integration need not incur prohibitive resource demands, Skywork UniPic establishes a practical paradigm for deployable, high-fidelity multimodal AI. Code and weights are publicly available at https://huggingface.co/Skywork/Skywork-UniPic-1.5B.
Key facts. Cited by 17 papers in the map (data through 14 Oct 2026). Builds on 34 of its 48 references that are in the map. First posted on arXiv 5 Aug 2025.
Builds on
34 of 48 references.
References · 34
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
- 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,614
- 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,253
- 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,109
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
- 2023Pick-a-Pic: An Open Dataset of User Preferences for Text-to-Image Generationcited by 977
- 2023GenEval: An Object-Focused Framework for Evaluating Text-to-Image Alignmentcited by 972
- 2025Emerging Properties in Unified Multimodal Pretrainingcited by 897
- 2023Human Preference Score v2: A Solid Benchmark for Evaluating Human Preferences of Text-to-Image Synthesiscited by 890
22 more
- 2023PixArt-α: Fast Training of Diffusion Transformer for Photorealistic Text-to-Image Synthesiscited by 864
- 2024Autoregressive Model Beats Diffusion: Llama for Scalable Image Generationcited by 777
- 2024Show-o: One Single Transformer to Unify Multimodal Understanding and Generationcited by 752
- 2024Autoregressive Image Generation without Vector Quantizationcited by 651
- 2023MagicBrush: A Manually Annotated Dataset for Instruction-Guided Image Editingcited by 624
- 2024Transfusion: Predict the Next Token and Diffuse Images with One Multi-Modal Modelcited by 483
- 2024ELLA: Equip Diffusion Models with LLM for Enhanced Semantic Alignmentcited by 475
- 2023Generative Multimodal Models are In-Context Learnerscited by 446
- 2022DeepSpeed Inference: Enabling Efficient Inference of Transformer Models at Unprecedented Scalecited by 407
- 2025BLIP3-o: A Family of Fully Open Unified Multimodal Models-Architecture, Training and Datasetcited by 376
- 2024Hunyuan-DiT: A Powerful Multi-Resolution Diffusion Transformer with Fine-Grained Chinese Understandingcited by 298
- 2024Playground v2.5: Three Insights towards Enhancing Aesthetic Quality in Text-to-Image Generationcited by 256
- 2025In-Context Edit: Enabling Instructional Image Editing with In-Context Generation in Large Scale Diffusion Transformercited by 204
- 2024TokenFlow: Unified Image Tokenizer for Multimodal Understanding and Generationcited by 202
- 2025AnyEdit: Edit Any Knowledge Encoded in Language Modelscited by 76
- 2025Harmonizing Visual Representations for Unified Multimodal Understanding and Generationcited by 74
- 2025Unified Autoregressive Visual Generation and Understanding with Continuous Tokenscited by 51
- 2025OpenUni: A Simple Baseline for Unified Multimodal Understanding and Generationcited by 46
- 20241.58-bit FLUXcited by 31
- 2024HumanEdit: A High-Quality Human-Rewarded Dataset for Instruction-based Image Editingcited by 29
- 2025SuperEdit: Rectifying and Facilitating Supervision for Instruction-Based Image Editingcited by 18
- 2023Nova: Generative Language Models for Assembly Code with Hierarchical Attention and Contrastive Learningcited by 12
Built on by
Citing papers per year: 2025: 6; 2026: 11.
17 papers.
Sort:
By area:
- 2025Reconstruction Alignment Improves Unified Multimodal Modelscited by 49
- 2026InternVL-U: Democratizing Unified Multimodal Models for Understanding, Reasoning, Generation and Editingcited by 28
- 2025Skywork-R1V4: Toward Agentic Multimodal Intelligence through Interleaved Thinking with Images and DeepResearchcited by 27
- 2026Generation Enhances Understanding in Unified Multimodal Models via Multi-Representation Generationcited by 20
- 2025Unified Multimodal Models as Auto-Encoderscited by 13
- 2025VQRAE: Representation Quantization Autoencoders for Multimodal Understanding, Generation and Reconstructioncited by 10
- 2025LightFusion: A Light-weighted, Double Fusion Framework for Unified Multimodal Understanding and Generationcited by 9
- 2026Skywork UniPic 3.0: Unified Multi-Image Composition via Sequence Modelingcited by 7
- 2026Covo-Audio Technical Reportcited by 7
- 2026Wan-Weaver: Interleaved Multi-modal Generation via Decoupled Trainingcited by 5
- 2026Audio-Visual Intelligence in Large Foundation Modelscited by 2
- 2026Images in Sentences: Scaling Interleaved Instructions for Unified Visual Generationcited by 2
5 more
- 2025Video4Edit: Viewing Image Editing as a Degenerate Temporal Processcited by 1
- 2026DynEval: Holistic Evaluations of T2I Generative Models in the Wildcited by 1
- 2026UniCom: Unified Multimodal Modeling via Compressed Continuous Semantic Representationscited by 0
- 2026Semantic Generative Tuning for Unified Multimodal Modelscited by 0
- 2026C3-UniMM: Causal Cycle-Consistent Unified Multimodal Modeling via Super Alignment and Shared Decoding Spacecited by 0
- 2026DynEval: Holistic Evaluations of T2I Generative Models in the Wild13 Jul 2026
- 2026C3-UniMM: Causal Cycle-Consistent Unified Multimodal Modeling via Super Alignment and Shared Decoding Space4 Jul 2026
- 2026Semantic Generative Tuning for Unified Multimodal Models18 May 2026
- 2026Images in Sentences: Scaling Interleaved Instructions for Unified Visual Generation12 May 2026
- 2026Audio-Visual Intelligence in Large Foundation Models5 May 2026
- 2026Wan-Weaver: Interleaved Multi-modal Generation via Decoupled Training26 Mar 2026
- 2026UniCom: Unified Multimodal Modeling via Compressed Continuous Semantic Representations11 Mar 2026
- 2026InternVL-U: Democratizing Unified Multimodal Models for Understanding, Reasoning, Generation and Editing10 Mar 2026
- 2026Covo-Audio Technical Report10 Feb 2026
- 2026Generation Enhances Understanding in Unified Multimodal Models via Multi-Representation Generation29 Jan 2026
- 2026Skywork UniPic 3.0: Unified Multi-Image Composition via Sequence Modeling22 Jan 2026
- 2025Skywork-R1V4: Toward Agentic Multimodal Intelligence through Interleaved Thinking with Images and DeepResearch2 Dec 2025
5 more
- 2025VQRAE: Representation Quantization Autoencoders for Multimodal Understanding, Generation and Reconstruction28 Nov 2025
- 2025Video4Edit: Viewing Image Editing as a Degenerate Temporal Process22 Nov 2025
- 2025LightFusion: A Light-weighted, Double Fusion Framework for Unified Multimodal Understanding and Generation27 Oct 2025
- 2025Unified Multimodal Models as Auto-Encoders11 Sep 2025
- 2025Reconstruction Alignment Improves Unified Multimodal Models8 Sep 2025
- 2025Reconstruction Alignment Improves Unified Multimodal Modelscited by 49
- 2026Generation Enhances Understanding in Unified Multimodal Models via Multi-Representation Generationcited by 20
- 2025Unified Multimodal Models as Auto-Encoderscited by 13
- 2025VQRAE: Representation Quantization Autoencoders for Multimodal Understanding, Generation and Reconstructioncited by 10
- 2025LightFusion: A Light-weighted, Double Fusion Framework for Unified Multimodal Understanding and Generationcited by 9
- 2026Skywork UniPic 3.0: Unified Multi-Image Composition via Sequence Modelingcited by 7
- 2026Covo-Audio Technical Reportcited by 7
- 2026Wan-Weaver: Interleaved Multi-modal Generation via Decoupled Trainingcited by 5
- 2026Audio-Visual Intelligence in Large Foundation Modelscited by 2
- 2025Video4Edit: Viewing Image Editing as a Degenerate Temporal Processcited by 1
- 2026DynEval: Holistic Evaluations of T2I Generative Models in the Wildcited by 1
- 2026UniCom: Unified Multimodal Modeling via Compressed Continuous Semantic Representationscited by 0
12 most cited of 14 All 14 (JSON)
- 2026DynEval: Holistic Evaluations of T2I Generative Models in the Wild13 Jul 2026
- 2026C3-UniMM: Causal Cycle-Consistent Unified Multimodal Modeling via Super Alignment and Shared Decoding Space4 Jul 2026
- 2026Semantic Generative Tuning for Unified Multimodal Models18 May 2026
- 2026Audio-Visual Intelligence in Large Foundation Models5 May 2026
- 2026Wan-Weaver: Interleaved Multi-modal Generation via Decoupled Training26 Mar 2026
- 2026UniCom: Unified Multimodal Modeling via Compressed Continuous Semantic Representations11 Mar 2026
- 2026Covo-Audio Technical Report10 Feb 2026
- 2026Generation Enhances Understanding in Unified Multimodal Models via Multi-Representation Generation29 Jan 2026
- 2026Skywork UniPic 3.0: Unified Multi-Image Composition via Sequence Modeling22 Jan 2026
- 2025VQRAE: Representation Quantization Autoencoders for Multimodal Understanding, Generation and Reconstruction28 Nov 2025
- 2025Video4Edit: Viewing Image Editing as a Degenerate Temporal Process22 Nov 2025
- 2025LightFusion: A Light-weighted, Double Fusion Framework for Unified Multimodal Understanding and Generation27 Oct 2025
12 newest of 14 All 14 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2026Unified Multimodal Autoregressive Modeling with Shared Context-Visual Tokenizer is Key to Unification
- 2026NextFlow: Unified Sequential Modeling Activates Multimodal Understanding and Generation
- 2025Semantic Context Matters: Improving Conditioning for Autoregressive Models
- 2026UniGen-AR: Unifying Visual Generation with Auto-Regressive Modeling
- 2026STARFlow2: Bridging Language Models and Normalizing Flows for Unified Multimodal Generation
- 2026Exploring the Performance Frontier of Compact Unified Image Generation Models
- 2025Progress by Pieces: Test-Time Scaling for Autoregressive Image Generation
- 2025OneCAT: Decoder-Only Auto-Regressive Model for Unified Understanding and Generation