mlsanityData to 14 Oct 2026

C3-UniMM: Causal Cycle-Consistent Unified Multimodal Modeling via Super Alignment and Shared Decoding Space

arXiv 2608.28603 ↗First posted 4 Jul 2026cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Unified Multimodal Models aim to achieve any-to-any understanding and generation across arbitrary modalities. However, existing methods primarily rely on modeling implicit statistical correlations and lack cross-modal structural consistency constraints. This deficiency leads to profound issues, including semantic drift, poor compositional generalization, and instability under interventions. In this paper, we propose C3-UniMM, a unified multimodal modeling framework based on Causal Cycle Consistency and Super Alignment. Specifically, we introduce a Structured Latent Causal Graph (SLCG) as a shared cross-modal semantic space and design unified multimodal encoding blocks, enabling understanding and generation to be synergistically optimized within the identical causal semantic structure. Furthermore, we propose a Unified Decoding Space to enforce structural preservation and semantic invertibility during the cross-modal generation process. Theoretical analyses demonstrate that our approach significantly enhances both the invertibility and mechanism invariance of cross-modal mappings. Extensive experimental results across multiple understanding, generation, and compositional generalization tasks indicate that C3-UniMM substantially outperforms existing unified multimodal baselines.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 105 of its 119 references that are in the map. First posted on arXiv 4 Jul 2026.

Builds on

105 of 119 references.

References · 105

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  3. 2023GPT-4 Technical Reportcited by 18,396
  4. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  5. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
  6. 2020Denoising Diffusion Implicit Modelscited by 9,781
  7. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
  8. 2023Visual Instruction Tuningcited by 7,869
  9. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
  10. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
  11. 2022Classifier-Free Diffusion Guidancecited by 5,847
  12. 2025Qwen2.5-VL Technical Reportcited by 5,587
38 more
  1. 2024Qwen2.5 Technical Reportcited by 4,942
  2. 2017Neural Discrete Representation Learningcited by 4,712
  3. 2024GPT-4o System Cardcited by 4,588
  4. 2023Improved Baselines with Visual Instruction Tuningcited by 4,418
  5. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
  6. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
  7. 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,761
  8. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,614
  9. 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,224
  10. 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,109
  11. 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,719
  12. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
  13. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
  14. 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyondcited by 2,224
  15. 2019ViLBERT: Pretraining Task-Agnostic Visiolinguistic Representations for Vision-and-Language Taskscited by 2,222
  16. 2024Gemma 2: Improving Open Language Models at a Practical Sizecited by 1,998
  17. 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Stepscited by 1,979
  18. 2025Gemma 3 Technical Reportcited by 1,824
  19. 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scalingcited by 1,599
  20. 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,433
  21. 2019Generating Diverse High-Fidelity Images with VQ-VAE-2cited by 1,387
  22. 2019VisualBERT: A Simple and Performant Baseline for Vision and Languagecited by 1,296
  23. 2024How Far Are We to GPT-4V? Closing the Gap to Commercial Multimodal Models with Open-Source Suitescited by 1,050
  24. 2024Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Predictioncited by 1,023
  25. 2024Chameleon: Mixed-Modal Early-Fusion Foundation Modelscited by 927
  26. 2024Gemma: Open Models Based on Gemini Research and Technologycited by 916
  27. 2023A Survey on Multimodal Large Language Modelscited by 909
  28. 2025Emerging Properties in Unified Multimodal Pretrainingcited by 897
  29. 2023EVA-CLIP: Improved Training Techniques for CLIP at Scalecited by 798
  30. 2024Emu3: Next-Token Prediction is All You Needcited by 781
  31. 2024Show-o: One Single Transformer to Unify Multimodal Understanding and Generationcited by 752
  32. 2023VILA: On Pre-training for Visual Language Modelscited by 692
  33. 2021Vector-quantized Image Modeling with Improved VQGANcited by 658
  34. 2023ModelScope Text-to-Video Technical Reportcited by 658
  35. 2023NExT-GPT: Any-to-Any Multimodal LLMcited by 615
  36. 2024VideoCrafter2: Overcoming Data Limitations for High-Quality Video Diffusion Modelscited by 579
  37. 2024Long Context Transfer from Language to Visioncited by 515
  38. 2024Transfusion: Predict the Next Token and Diffuse Images with One Multi-Modal Modelcited by 483

50 most cited of 105 All 105 (JSON)

Built on by

Not cited yet.