AEGIS: Exploring the Limit of World Knowledge Capabilities for Unified Mulitmodal Models
Not on the map. Why?
Abstract (arXiv)
The capability of Unified Multimodal Models (UMMs) to apply world knowledge across diverse tasks remains a critical, unresolved challenge. Existing benchmarks fall short, offering only siloed, single-task evaluations with limited diagnostic power. To bridge this gap, we propose AEGIS (i.e., Assessing Editing, Generation, Interpretation-Understanding for Super-intelligence), a comprehensive multi-task benchmark covering visual understanding, generation, editing, and interleaved generation. AEGIS comprises 1,050 challenging, manually-annotated questions spanning 21 topics (including STEM, humanities, daily life, etc.) and 6 reasoning types. To concretely evaluate the performance of UMMs in world knowledge scope without ambiguous metrics, we further propose Deterministic Checklist-based Evaluation (DCE), a protocol that replaces ambiguous prompt-based scoring with atomic ``Y/N'' judgments, to enhance evaluation reliability. Our extensive experiments reveal that most UMMs exhibit severe world knowledge deficits and that performance degrades significantly with complex reasoning. Additionally, simple plug-in reasoning modules can partially mitigate these vulnerabilities, highlighting a promising direction for future research. These results highlight the importance of world-knowledge-based reasoning as a critical frontier for UMMs.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 58 of its 63 references that are in the map. First posted on arXiv 2 Jan 2026.
Builds on
58 of 63 references.
References · 58
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2024GPT-4o System Cardcited by 4,467
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
- 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,769
- 2023MME: A Comprehensive Evaluation Benchmark for Multimodal Large Language Modelscited by 1,624
- 2023GAIA: a benchmark for General AI Assistantscited by 1,084
- 2025Qwen-Image Technical Reportcited by 973
- 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 960
- 2023GenEval: An Object-Focused Framework for Evaluating Text-to-Image Alignmentcited by 946
38 more
- 2023SEED-Bench: Benchmarking Multimodal LLMs with Generative Comprehensioncited by 929
- 2025Emerging Properties in Unified Multimodal Pretrainingcited by 855
- 2025Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scalingcited by 787
- 2024Emu3: Next-Token Prediction is All You Needcited by 761
- 2024ELLA: Equip Diffusion Models with LLM for Enhanced Semantic Alignmentcited by 455
- 2025Step1X-Edit: A Practical Framework for General Image Editingcited by 417
- 2025Kimi-VL Technical Reportcited by 381
- 2025BLIP3-o: A Family of Fully Open Unified Multimodal Models-Architecture, Training and Datasetcited by 363
- 2023Uni-ControlNet: All-in-One Control to Text-to-Image Diffusion Modelscited by 358
- 2025Show-o2: Improved Native Unified Multimodal Modelscited by 242
- 2025MMaDA: Multimodal Large Diffusion Language Modelscited by 241
- 2025OmniGen2: Towards Instruction-Aligned Multimodal Generationcited by 241
- 2025Seedream 4.0: Toward Next-generation Multimodal Image Generationcited by 233
- 2025ImgEdit: A Unified Image Editing Dataset and Benchmarkcited by 225
- 2025WISE: A World Knowledge-Informed Semantic Evaluation for Text-to-Image Generationcited by 196
- 2023SmartEdit: Exploring Complex Instruction-based Image Editing with Multimodal Large Language Modelscited by 174
- 2025DeepSeek-OCR: Contexts Optical Compressioncited by 174
- 2025HunyuanImage 3.0 Technical Reportcited by 138
- 2025MME-CoT: Benchmarking Chain-of-Thought in Large Multimodal Models for Reasoning Quality, Robustness, and Efficiencycited by 123
- 2024LMFusion: Adapting Pretrained Language Models for Multimodal Generationcited by 120
- 2025Mogao: An Omni Foundation Model for Interleaved Multi-Modal Generationcited by 108
- 2025X-Omni: Reinforcement Learning Makes Discrete Autoregressive Image Generative Models Great Againcited by 105
- 2025Envisioning Beyond the Pixels: Benchmarking Reasoning-Informed Visual Editingcited by 97
- 2024Dual Diffusion for Unified Image Generation and Understandingcited by 76
- 2024MME-Survey: A Comprehensive Survey on Evaluation of Multimodal LLMscited by 72
- 2025KRIS-Bench: Benchmarking Next-Level Intelligent Image Editing Modelscited by 69
- 2025Ovis-U1 Technical Reportcited by 65
- 2024PuzzleVQA: Diagnosing Multimodal Reasoning Challenges of Language Models with Abstract Visual Patternscited by 54
- 2024Commonsense-T2I Challenge: Can Text-to-Image Generation Models Understand Commonsense?cited by 52
- 2025Muddit: Liberating Generation Beyond Text-to-Image with a Unified Discrete Diffusion Modelcited by 52
- 2025UniToken: Harmonizing Multimodal Understanding and Generation through Unified Visual Encodingcited by 49
- 2025FUDOKI: Discrete Flow-based Unified Understanding and Generation via Kinetic-Optimal Velocitiescited by 46
- 2025T2I-ReasonBench: Benchmarking Reasoning-Informed Text-to-Image Generationcited by 38
- 2025R-Bench: Graduate-level Multi-disciplinary Benchmarks for LLM & MLLM Complex Reasoning Evaluationcited by 32
- 2025R2I-Bench: Benchmarking Reasoning-Driven Text-to-Image Generationcited by 31
- 2024OpenING: A Comprehensive Benchmark for Judging Open-ended Interleaved Image-Text Generationcited by 30
- 2025ECom-Bench: Can LLM Agent Resolve Real-World E-commerce Customer Support Issues?cited by 27
- 2025WorldGenBench: A World-Knowledge-Integrated Benchmark for Reasoning-Driven Text-to-Image Generationcited by 20
50 most cited of 58 All 58 (JSON)
Built on by
Citing papers per year: 2026: 1.
1 paper.