mlsanityData to 7 Oct 2026

AEGIS: Exploring the Limit of World Knowledge Capabilities for Unified Mulitmodal Models

arXiv 2601.00561 ↗First posted 2 Jan 2026cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

The capability of Unified Multimodal Models (UMMs) to apply world knowledge across diverse tasks remains a critical, unresolved challenge. Existing benchmarks fall short, offering only siloed, single-task evaluations with limited diagnostic power. To bridge this gap, we propose AEGIS (i.e., Assessing Editing, Generation, Interpretation-Understanding for Super-intelligence), a comprehensive multi-task benchmark covering visual understanding, generation, editing, and interleaved generation. AEGIS comprises 1,050 challenging, manually-annotated questions spanning 21 topics (including STEM, humanities, daily life, etc.) and 6 reasoning types. To concretely evaluate the performance of UMMs in world knowledge scope without ambiguous metrics, we further propose Deterministic Checklist-based Evaluation (DCE), a protocol that replaces ambiguous prompt-based scoring with atomic ``Y/N'' judgments, to enhance evaluation reliability. Our extensive experiments reveal that most UMMs exhibit severe world knowledge deficits and that performance degrades significantly with complex reasoning. Additionally, simple plug-in reasoning modules can partially mitigate these vulnerabilities, highlighting a promising direction for future research. These results highlight the importance of world-knowledge-based reasoning as a critical frontier for UMMs.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 58 of its 63 references that are in the map. First posted on arXiv 2 Jan 2026.

Builds on

58 of 63 references.

References · 58

  1. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  2. 2025Qwen2.5-VL Technical Reportcited by 5,418
  3. 2024GPT-4o System Cardcited by 4,467
  4. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
  5. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
  6. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
  7. 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,769
  8. 2023MME: A Comprehensive Evaluation Benchmark for Multimodal Large Language Modelscited by 1,624
  9. 2023GAIA: a benchmark for General AI Assistantscited by 1,084
  10. 2025Qwen-Image Technical Reportcited by 973
  11. 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 960
  12. 2023GenEval: An Object-Focused Framework for Evaluating Text-to-Image Alignmentcited by 946
38 more
  1. 2023SEED-Bench: Benchmarking Multimodal LLMs with Generative Comprehensioncited by 929
  2. 2025Emerging Properties in Unified Multimodal Pretrainingcited by 855
  3. 2025Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scalingcited by 787
  4. 2024Emu3: Next-Token Prediction is All You Needcited by 761
  5. 2024ELLA: Equip Diffusion Models with LLM for Enhanced Semantic Alignmentcited by 455
  6. 2025Step1X-Edit: A Practical Framework for General Image Editingcited by 417
  7. 2025Kimi-VL Technical Reportcited by 381
  8. 2025BLIP3-o: A Family of Fully Open Unified Multimodal Models-Architecture, Training and Datasetcited by 363
  9. 2023Uni-ControlNet: All-in-One Control to Text-to-Image Diffusion Modelscited by 358
  10. 2025Show-o2: Improved Native Unified Multimodal Modelscited by 242
  11. 2025MMaDA: Multimodal Large Diffusion Language Modelscited by 241
  12. 2025OmniGen2: Towards Instruction-Aligned Multimodal Generationcited by 241
  13. 2025Seedream 4.0: Toward Next-generation Multimodal Image Generationcited by 233
  14. 2025ImgEdit: A Unified Image Editing Dataset and Benchmarkcited by 225
  15. 2025WISE: A World Knowledge-Informed Semantic Evaluation for Text-to-Image Generationcited by 196
  16. 2023SmartEdit: Exploring Complex Instruction-based Image Editing with Multimodal Large Language Modelscited by 174
  17. 2025DeepSeek-OCR: Contexts Optical Compressioncited by 174
  18. 2025HunyuanImage 3.0 Technical Reportcited by 138
  19. 2025MME-CoT: Benchmarking Chain-of-Thought in Large Multimodal Models for Reasoning Quality, Robustness, and Efficiencycited by 123
  20. 2024LMFusion: Adapting Pretrained Language Models for Multimodal Generationcited by 120
  21. 2025Mogao: An Omni Foundation Model for Interleaved Multi-Modal Generationcited by 108
  22. 2025X-Omni: Reinforcement Learning Makes Discrete Autoregressive Image Generative Models Great Againcited by 105
  23. 2025Envisioning Beyond the Pixels: Benchmarking Reasoning-Informed Visual Editingcited by 97
  24. 2024Dual Diffusion for Unified Image Generation and Understandingcited by 76
  25. 2024MME-Survey: A Comprehensive Survey on Evaluation of Multimodal LLMscited by 72
  26. 2025KRIS-Bench: Benchmarking Next-Level Intelligent Image Editing Modelscited by 69
  27. 2025Ovis-U1 Technical Reportcited by 65
  28. 2024PuzzleVQA: Diagnosing Multimodal Reasoning Challenges of Language Models with Abstract Visual Patternscited by 54
  29. 2024Commonsense-T2I Challenge: Can Text-to-Image Generation Models Understand Commonsense?cited by 52
  30. 2025Muddit: Liberating Generation Beyond Text-to-Image with a Unified Discrete Diffusion Modelcited by 52
  31. 2025UniToken: Harmonizing Multimodal Understanding and Generation through Unified Visual Encodingcited by 49
  32. 2025FUDOKI: Discrete Flow-based Unified Understanding and Generation via Kinetic-Optimal Velocitiescited by 46
  33. 2025T2I-ReasonBench: Benchmarking Reasoning-Informed Text-to-Image Generationcited by 38
  34. 2025R-Bench: Graduate-level Multi-disciplinary Benchmarks for LLM & MLLM Complex Reasoning Evaluationcited by 32
  35. 2025R2I-Bench: Benchmarking Reasoning-Driven Text-to-Image Generationcited by 31
  36. 2024OpenING: A Comprehensive Benchmark for Judging Open-ended Interleaved Image-Text Generationcited by 30
  37. 2025ECom-Bench: Can LLM Agent Resolve Real-World E-commerce Customer Support Issues?cited by 27
  38. 2025WorldGenBench: A World-Knowledge-Integrated Benchmark for Reasoning-Driven Text-to-Image Generationcited by 20

50 most cited of 58 All 58 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.