mlsanityData to 14 Oct 2026

Intern Lumina U2: A Multi-Codebook Diffusion Large Language Model for Omni-Visual Understanding and Image Generation

arXiv 2610.20818 ↗First posted 14 Oct 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Unified multimodal generation covers discrete, continuous, and hybrid paradigms. Discrete approaches with single-codebook visual tokenizers align naturally with text modeling but have limited representational capacity. Continuous and hybrid approaches retain richer visual representations, but they model text and images in heterogeneous spaces with different training objectives, potentially introducing optimization conflicts between modalities with misaligned representation spaces. These choices expose a central question: how to efficiently model high-capacity visual representations alongside textual content in a shared optimization space within a single backbone. We present Intern Lumina U2, to our knowledge the first diffusion language model to represent multi-codebook visual tokens in a fully discrete space. Each visual position is represented by a group of codes from complementary codebooks, increasing its representational capacity while preserving compatibility with discrete text modeling. At the input, the embeddings are concatenated at each position; at the output, a lightweight multi-codebook autoregressive head predicts the codes within each position sequentially, while the diffusion backbone processes all positions in parallel. Built on the unified 4D representation of AToken, Intern Lumina U2 supports image, video, and 3D inputs within a single backbone and achieves leading performance among unified models in visual understanding, image generation, and image editing. We further build a full-stack training, inference, and evaluation system on both Ascend and NVIDIA platforms to verify the cross-platform effectiveness of our model. We also improve the inference efficiency through a stability-aware sampling strategy, which combines confidence-plateau-guided unmasking approach with drift-triggered cache refreshing mechanisms, accelerating image generation by 4.45x.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). First posted on arXiv 14 Oct 2026.

Builds on

No reference list yet.

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025UniCode2: Cascaded Large-scale Codebooks for Unified Multimodal Understanding and Generation
  2. 2026UniCanvas: A Diffusion-base Unified Model for Text-in-Image Joint Generation
  3. 2025Vision as a Dialect: Unifying Visual Understanding and Generation via Text-Aligned Representations
  4. 2026LLaDA2.0-Uni: Unifying Multimodal Understanding and Generation with Diffusion Large Language Model
  5. 2025ViewMask-1-to-3: Multi-View Consistent Image Generation via Multimodal Discrete Diffusion Models
  6. 2025Growing Visual Generative Capacity for Pre-Trained MLLMs
  7. 2025MANZANO: A Simple and Scalable Unified Multimodal Model with a Hybrid Vision Tokenizer
  8. 2024UniCode: Learning a Unified Codebook for Multimodal Large Language Models