mlsanityData to 7 Oct 2026

GENIUS: Generative Fluid Intelligence Evaluation Suite

arXiv 2602.11144 ↗First posted 11 Feb 2026cs.LG cs.AI cs.CVcited by 11

Not on the map. Why?

Abstract (arXiv)

Unified Multimodal Models (UMMs) have shown remarkable progress in visual generation. Yet, existing benchmarks predominantly assess textitCrystallized Intelligence, which relies on recalling accumulated knowledge and learned schemas. This focus overlooks textitGenerative Fluid Intelligence (GFI): the capacity to induce patterns, reason through constraints, and adapt to novel scenarios on the fly. To rigorously assess this capability, we introduce GENIUS (GEN Fluid Intelligence EvalUation Suite). We formalize textitGFI as a synthesis of three primitives. These include textitInducing Implicit Patterns (e.g., inferring personalized visual preferences), textitExecuting Ad-hoc Constraints (e.g., visualizing abstract metaphors), and textitAdapting to Contextual Knowledge (e.g., simulating counter-intuitive physics). Collectively, these primitives challenge models to solve problems grounded entirely in the immediate context. Our systematic evaluation of 12 representative models reveals significant performance deficits in these tasks. Crucially, our diagnostic analysis disentangles these failure modes. It demonstrates that deficits stem from limited context comprehension rather than insufficient intrinsic generative capability. To bridge this gap, we propose a training-free attention intervention strategy. Ultimately, GENIUS establishes a rigorous standard for textitGFI, guiding the field beyond knowledge utilization toward dynamic, general-purpose reasoning. Our dataset and code will be released at: hrefhttps://github.com/arctanxarc/GENIUShttps://github.com/arctanxarc/GENIUS.

Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Builds on 37 of its 54 references that are in the map. First posted on arXiv 11 Feb 2026.

Builds on

37 of 54 references.

References · 37

  1. 2025Qwen2.5-VL Technical Reportcited by 5,418
  2. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
  3. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,286
  4. 2024A Survey on LLM-as-a-Judgecited by 1,384
  5. 2023GenEval: An Object-Focused Framework for Evaluating Text-to-Image Alignmentcited by 946
  6. 2024Chameleon: Mixed-Modal Early-Fusion Foundation Modelscited by 904
  7. 2025Emerging Properties in Unified Multimodal Pretrainingcited by 855
  8. 2025Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scalingcited by 787
  9. 2024Emu3: Next-Token Prediction is All You Needcited by 761
  10. 2024Show-o: One Single Transformer to Unify Multimodal Understanding and Generationcited by 734
  11. 2022Transformers learn in-context by gradient descentcited by 714
  12. 2024ELLA: Equip Diffusion Models with LLM for Enhanced Semantic Alignmentcited by 455
25 more
  1. 2024Janus: Decoupling Visual Encoding for Unified Multimodal Understanding and Generationcited by 447
  2. 2023Generative Multimodal Models are In-Context Learnerscited by 446
  3. 2023Transformers learn to implement preconditioned gradient descent for in-context learningcited by 274
  4. 2023Generating Images with Multimodal Language Modelscited by 259
  5. 2025Seedream 4.0: Toward Next-generation Multimodal Image Generationcited by 233
  6. 2025Imagine while Reasoning in Space: Multimodal Visualization-of-Thoughtcited by 204
  7. 2025WISE: A World Knowledge-Informed Semantic Evaluation for Text-to-Image Generationcited by 196
  8. 2025T2I-R1: Reinforcing Image Generation with Collaborative Semantic-level and Token-level CoTcited by 162
  9. 2025Can We Generate Images with CoT? Let's Verify and Reinforce Image Generation Step by Stepcited by 130
  10. 2025Envisioning Beyond the Pixels: Benchmarking Reasoning-Informed Visual Editingcited by 97
  11. 2024ChemVLM: Exploring the Power of Multimodal Large Language Models in Chemistry Areacited by 68
  12. 2025TIIF-Bench: How Does Your T2I Model Follow Your Instructions?cited by 64
  13. 2025UniCTokens: Boosting Personalized Understanding and Generation via Unified Concept Tokenscited by 55
  14. 2025NextStep-1: Toward Autoregressive Image Generation with Continuous Tokens at Scalecited by 55
  15. 2024Critic-V: VLM Critics Help Catch VLM Errors in Multimodal Reasoningcited by 50
  16. 2025Reconstruction Alignment Improves Unified Multimodal Modelscited by 48
  17. 2025Learning without training: The implicit dynamics of in-context learningcited by 41
  18. 2025RealUnify: Do Unified Models Truly Benefit from Unification? A Comprehensive Benchmarkcited by 33
  19. 2024OpenING: A Comprehensive Benchmark for Judging Open-ended Interleaved Image-Text Generationcited by 30
  20. 2025MME-Unify: A Comprehensive Benchmark for Unified Multimodal Understanding and Generation Modelscited by 24
  21. 2024Bridging Different Language Models and Generative Vision Models for Text-to-Image Generationcited by 17
  22. 2025Thinking-while-Generating: Interleaving Textual Reasoning throughout Visual Generationcited by 17
  23. 2025UniEval: Unified Holistic Evaluation for Unified Multimodal Understanding and Generationcited by 14
  24. 2025ROVER: Benchmarking Reciprocal Cross-Modal Reasoning for Omnimodal Generationcited by 13
  25. 2025WEAVE: Unleashing and Benchmarking the In-context Interleaved Comprehension and Generationcited by 7

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 11.

11 papers.