mlsanityData to 7 Oct 2026

Multi-Agent Debate and Visual Information Extraction for SeePhys Pro: A 1st-Place Technical Report from ICML 2026 AI4Math Track 3 Challenge

arXiv 2607.21946 ↗First posted 24 Jul 2026cs.LGcited by 0

On the map: LLM agents and tool use → Multimodal and embodied agents

Abstract (arXiv)

This technical report presents our approach to Challenge Track~3: SeePhys Pro at the 3rd AI for Math Workshop, where the task is to answer college-level physics questions whose statement and figure may be given partly or entirely as an image. Visual physics problems become substantially harder for large language models when the decisive information resides in a figure rather than in the text, and this modality gap widens as more of the problem migrates into the image. We address the task with a two-stage framework: a visual information extraction stage that re-expresses figure content as solver-readable text to close the modality gap, and a reasoning stage that orchestrates three heterogeneous solvers through multi-agent debate. Our analysis yields two findings: the gain from orchestration comes from reliable answer selection rather than from additional debate, and the value of a figure aid scales with how much of the problem is locked inside the image. The resulting pipeline improves overall accuracy over a single-agent baseline from 0.643 to 0.802 on the public split, and won 1st place on both the public and the private leaderboard (private overall 0.743).

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 7 of its 12 references that are in the map. First posted on arXiv 24 Jul 2026.

Builds on

7 of 12 references.

References · 7

  1. 2023Improving Factuality and Reasoning in Language Models through Multiagent Debatecited by 1,739
  2. 2021Inter-GPS: Interpretable Geometry Problem Solving with Formal Language and Symbolic Reasoningcited by 376
  3. 2023StarVector: Generating Scalable Vector Graphics Code from Images and Textcited by 96
  4. 2022Plane Geometry Diagram Parsingcited by 20
  5. 2026Multi-Agent Debate with Memory Maskingcited by 8
  6. 2025Multimodal Reasoning for Science: Technical Report and 1st Place Solution to the ICML 2025 SeePhys Challengecited by 6
  7. 2026Sakana Fugu Technical Reportcited by 4

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026M3-ACE: Rectifying Visual Perception in Multimodal Math Reasoning via Multi-Agentic Context Engineering
  2. 2025Do Multi-Agents Solve Better Than Single? Evaluating Agentic Frameworks for Diagram-Grounded Geometry Problem Solving and Reasoning
  3. 2025SeePhys: Does Seeing Help Thinking? -- Benchmarking Vision-Based Physics Reasoning
  4. 2024MathVerse: Does Your Multi-modal LLM Truly See the Diagrams in Visual Math Problems?
  5. 2026VisTIRA: Closing the Image-Text Modality Gap in Visual Math Reasoning via Structured Tool Integration
  6. 2025ChartAgent: A Multimodal Agent for Visually Grounded Reasoning in Complex Chart Question Answering
  7. 2025Visual Graph Arena: Evaluating Visual Conceptualization of Vision and Multimodal Large Language Models
  8. 2024Polymath: A Challenging Multi-modal Mathematical Reasoning Benchmark