Proof-of-Perception: Certified Tool-Using Multimodal Reasoning with Compositional Conformal Guarantees
On the map: LLM reasoning → Multimodal reasoning
Abstract (arXiv)
We present Proof-of-Perception (PoP), a tool-using framework that casts multimodal reasoning as an executable graph with explicit reliability guarantees. Each perception or logic node outputs a conformal set, yielding calibrated, stepwise uncertainty; a lightweight controller uses these certificates to allocate compute under a budget, expanding with extra tool calls only when needed and stopping early otherwise. This grounds answers in verifiable evidence, reduces error compounding and hallucinations, and enables principled accuracy-compute trade-offs. Across document, chart, and multi-image QA benchmarks, PoP improves performance and reliability over strong chain-of-thought, ReAct-style, and program-of-thought baselines while using computation more efficiently.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 1 of its 31 references that are in the map. First posted on arXiv 27 Feb 2026.
Builds on
1 of 31 references.
References · 1
Built on by
Citing papers per year: 2026: 3.
3 papers.
- 2026COFT: Counterfactual-Conformal Decoding for Fair Chain-of-Thought Reasoning in Large Language Modelscited by 1
- 2026G-CARB: Graph-Localized Conformal Agent Risk Budget for Compositional Harmcited by 0
- 2026The Agent Knew: Internal States Forecast Unauthorized Actions and Stop Them, and the Lies That Followcited by 0
- 2026The Agent Knew: Internal States Forecast Unauthorized Actions and Stop Them, and the Lies That Follow12 Oct 2026
- 2026G-CARB: Graph-Localized Conformal Agent Risk Budget for Compositional Harm4 Oct 2026
- 2026COFT: Counterfactual-Conformal Decoding for Fair Chain-of-Thought Reasoning in Large Language Models28 May 2026
Similar, not cited
Close in wording, no citation either way
- 2025CoRGI: Verified Chain-of-Thought Reasoning with Post-hoc Visual Grounding
- 2025TIM-PRM: Verifying multimodal reasoning with Tool-Integrated PRM
- 2025VERIFY: A Benchmark of Visual Explanation and Reasoning for Investigating Multimodal Reasoning Fidelity
- 2026Beyond Final Answers: CRYSTAL Benchmark for Transparent Multimodal Reasoning Evaluation
- 2025Perceptual-Evidence Anchored Reinforced Learning for Multimodal Reasoning
- 2026LEDGERMIND: Provenance-Constrained Multimodal Agentic Reasoning with a Structured Evidence Ledger
- 2025MM-CoT:A Benchmark for Probing Visual Chain-of-Thought Reasoning in Multimodal Models
- 2025What MLLMs Learn about When they Learn about Multimodal Reasoning