mlsanityData to 7 Oct 2026

UniT: Unified Multimodal Chain-of-Thought Test-time Scaling

arXiv 2602.12279 ↗First posted 12 Feb 2026cs.CV cs.AI cs.LGcited by 8

On the map: LLM reasoning → Multimodal reasoning

Abstract (arXiv)

Unified models can handle both multimodal understanding and generation within a single architecture, yet they typically operate in a single pass without iteratively refining their outputs. Many multimodal tasks, especially those involving complex spatial compositions, multiple interacting objects, or evolving instructions, require decomposing instructions, verifying intermediate results, and making iterative corrections. While test-time scaling (TTS) has demonstrated that allocating additional inference compute for iterative reasoning substantially improves language model performance, extending this paradigm to unified multimodal models remains an open challenge. We introduce UniT, a framework for multimodal chain-of-thought test-time scaling that enables a single unified model to reason, verify, and refine across multiple rounds. UniT combines agentic data synthesis, unified model training, and flexible test-time inference to elicit cognitive behaviors including verification, subgoal decomposition, and content memory. Our key findings are: (1) unified models trained on short reasoning trajectories generalize to longer inference chains at test time; (2) sequential chain-of-thought reasoning provides a more scalable and compute-efficient TTS strategy than parallel sampling; (3) training on generation and editing trajectories improves out-of-distribution visual reasoning. These results establish multimodal test-time scaling as an effective paradigm for advancing both generation and understanding in unified models.

Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 61 of its 82 references that are in the map. First posted on arXiv 12 Feb 2026.

Builds on

61 of 82 references.

Closest ancestors · 10

Same direction, newest first

  1. 2025When Visualizing is the First Step to Reasoning: MIRA, a Benchmark for Visual Chain-of-Thought4 Nov
  2. 2025ThinkMorph: Emergent Properties in Multimodal Interleaved Chain-of-Thought Reasoning30 Oct
  3. 2025Improving Chain-of-Thought Efficiency for Autoregressive Image Generation7 Oct
  4. 2025Uni-cot: Towards Unified Chain-of-Thought Reasoning Across Text and Vision7 Aug
  5. 2025Thinking with Generated Images28 May
  6. 2025MindOmni: Unleashing Reasoning Generation in Vision Language Models with RGPO19 May
  7. 2025T2I-R1: Reinforcing Image Generation with Collaborative Semantic-level and Token-level CoT1 May
  8. 2025GoT: Unleashing Reasoning Capability of Multimodal Large Language Model for Visual Generation and Editing13 Mar
  9. 2024Visual Sketchpad: Sketching as a Visual Chain of Thought for Multimodal Language Models13 Jun
  10. 2024Visual CoT: Advancing Multi-Modal Language Models with a Comprehensive Dataset and Benchmark for Chain-of-Thought Reasoning25 Mar

Other references · 51

  1. 2021Training Verifiers to Solve Math Word Problemscited by 9,743
  2. 2021Evaluating Large Language Models Trained on Codecited by 8,053
  3. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
  4. 2025Qwen2.5-VL Technical Reportcited by 5,418
  5. 2023Let's Verify Step by Stepcited by 3,598
  6. 2022Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language modelscited by 1,970
  7. 2024Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameterscited by 1,928
  8. 2025s1: Simple test-time scalingcited by 1,311
  9. 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 960
  10. 2024Large Language Monkeys: Scaling Inference Compute with Repeated Samplingcited by 946
  11. 2024Chameleon: Mixed-Modal Early-Fusion Foundation Modelscited by 904
  12. 2023Math-Shepherd: Verify and Reinforce LLMs Step-by-step without Human Annotationscited by 895
38 more
  1. 2025Emerging Properties in Unified Multimodal Pretrainingcited by 855
  2. 2025Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scalingcited by 787
  3. 2024Emu3: Next-Token Prediction is All You Needcited by 761
  4. 2023Language Agent Tree Search Unifies Reasoning Acting and Planning in Language Modelscited by 551
  5. 2024Transfusion: Predict the Next Token and Diffuse Images with One Multi-Modal Modelcited by 468
  6. 2024Janus: Decoupling Visual Encoding for Unified Multimodal Understanding and Generationcited by 447
  7. 2025Step1X-Edit: A Practical Framework for General Image Editingcited by 417
  8. 2025Cognitive Behaviors that Enable Self-Improving Reasoners, or, Four Habits of Highly Effective STaRscited by 373
  9. 2025BLIP3-o: A Family of Fully Open Unified Multimodal Models-Architecture, Training and Datasetcited by 363
  10. 2024SEED-X: Multimodal Models with Unified Multi-granularity Comprehension and Generationcited by 328
  11. 2024Inference Scaling Laws: An Empirical Analysis of Compute-Optimal Inference for Problem-Solving with Language Modelscited by 282
  12. 2025OmniGen2: Towards Instruction-Aligned Multimodal Generationcited by 241
  13. 2024AnyEdit: Mastering Unified High-Quality Image Editing for Any Ideacited by 235
  14. 2024HelpSteer2: Open-source dataset for training top-performing reward modelscited by 232
  15. 2025Transfer between Modalities with MetaQueriescited by 231
  16. 2024DeepSeek-Prover: Advancing Theorem Proving in LLMs through Large-Scale Synthetic Datacited by 225
  17. 2025ImgEdit: A Unified Image Editing Dataset and Benchmarkcited by 225
  18. 2024MetaMorph: Multimodal Understanding and Generation via Instruction Tuningcited by 205
  19. 2024TokenFlow: Unified Image Tokenizer for Multimodal Understanding and Generationcited by 200
  20. 2024HQ-Edit: A High-Quality Dataset for Instruction-based Image Editingcited by 191
  21. 2023Planning with Large Language Models for Code Generationcited by 179
  22. 2024LMFusion: Adapting Pretrained Language Models for Multimodal Generationcited by 120
  23. 2024Critique-out-Loud Reward Modelscited by 105
  24. 2025OneIG-Bench: Omni-dimensional Nuanced Evaluation for Image Generationcited by 81
  25. 2025T1: Advancing Language Model Reasoning through Reinforcement Learning and Inference Scalingcited by 77
  26. 2024Mind's Eye of LLMs: Visualization-of-Thought Elicits Spatial Reasoning in Large Language Modelscited by 65
  27. 2023Don't throw away your value model! Generating more preferable text with Value-Guided Monte-Carlo Tree Search decodingcited by 59
  28. 2023Rewarding Chatbots for Real-World Engagement with Millions of Userscited by 58
  29. 2025Evolving Deeper LLM Thinkingcited by 58
  30. 2025From Reflection to Perfection: Scaling Inference-Time Optimization for Text-to-Image Diffusion Models via Reflection Tuningcited by 53
  31. 2023KCTS: Knowledge-Constrained Tree Search Decoding with Token-Level Hallucination Detectioncited by 43
  32. 2025Interleaving Reasoning for Better Text-to-Image Generationcited by 40
  33. 2025Video-T1: Test-Time Scaling for Video Generationcited by 39
  34. 2025Scaling Image and Video Generation via Test-Time Evolutionary Searchcited by 38
  35. 2024A Simple Model of Inference Scaling Lawscited by 36
  36. 2025VChain: Chain-of-Visual-Thought for Reasoning in Video Generationcited by 31
  37. 2024VisionTrap: Vision-Augmented Trajectory Prediction Guided by Textual Descriptionscited by 18
  38. 2025CompBench: Benchmarking Complex Instruction-guided Image Editingcited by 14

50 most cited of 51 All 51 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 8.

8 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Limits and Gains of Test-Time Scaling in Vision-Language Reasoning
  2. 2026Test-Time Scaling in Multimodal Foundation Models: A Comprehensive Survey of Generation and Reasoning
  3. 2023Multimodal Chain-of-Thought Reasoning in Language Models
  4. 2024AtomThink: Multimodal Slow Thinking with Atomic Step Reasoning
  5. 2025From Perception to Reasoning: Deep Thinking Empowers Multimodal Large Language Models
  6. 2025Reasoning Within the Mind: Dynamic Multimodal Interleaving in Latent Space
  7. 2025Investigating Inference-time Scaling for Chain of Multi-modal Thought: A Preliminary Study
  8. 2026DLWM: Diverse Latent World Models for Efficient Multimodal Reasoning