mlsanityData to 14 Oct 2026

ACED: Reference-Anchored Aggregation of Natural-Language and Executable Evidence for Mathematical Reasoning

arXiv 2610.16635 ↗First posted 12 Oct 2026cs.LGcited by 0

On the map: LLM reasoning → Mathematical reasoning

Abstract (arXiv)

Natural-language self-consistency and executable programs provide complementary test-time evidence for mathematical reasoning, yet either channel may support the same semantic error. Thus we propose ACED, a reference-anchored framework that treats the self-consistency answer as the default and executable outputs as supporting evidence rather than interchangeable votes. ACED converts source-specific answer counts into smoothed supports, combines them through a weighted logarithmic pool, and overrides the reference only when a calibrated relative-evidence margin is exceeded. The same rule supports both candidate selection and admission of executable-only answers. Across five math word-problem benchmarks, ACED matches or outperforms the corresponding baselines. On GSM8K, ACED-CANDIDATE recovers 89.7% of the attainable candidate-set gain with only three damaging overrides, while ACED-ALL reaches 86.9% accuracy versus 82.6% for direct Program-of-Thought aggregation. These results show that preserving evidence provenance enables more reliable integration of natural-language and executable reasoning.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Mathematical reasoning, one of 17 directions in LLM reasoning. Builds on 12 of its 25 references that are in the map. First posted on arXiv 12 Oct 2026.

Builds on

12 of 25 references.

Closest ancestors · 3

Same direction, newest first

  1. 2024Not All Votes Count! Programs as Verifiers Improve Self-Consistency of Language Models for Math Reasoning16 Oct
  2. 2024GSM-Symbolic: Understanding the Limitations of Mathematical Reasoning in Large Language Models7 Oct
  3. 2024Self-Consistency Boosts Calibration for Math Reasoning14 Mar

Other references · 9

  1. 2021Training Verifiers to Solve Math Word Problemscited by 10,109
  2. 2023Let's Verify Step by Stepcited by 3,789
  3. 2022Program of Thoughts Prompting: Disentangling Computation from Reasoning for Numerical Reasoning Taskscited by 1,076
  4. 2024Large Language Monkeys: Scaling Inference Compute with Repeated Samplingcited by 991
  5. 2021Are NLP Models really able to Solve Simple Math Word Problems?cited by 878
  6. 2016Solving General Arithmetic Word Problemscited by 360
  7. 2021A Diverse Corpus for Evaluating and Developing English Math Word Problem Solverscited by 318
  8. 2023Let's Sample Step by Step: Adaptive-Consistency for Efficient Reasoning and Coding with LLMscited by 115
  9. 2026Self-Consistency from Only Two Samples: CoT-PoT Ensembling for Efficient LLM Reasoningcited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Putnam-AXIOM: A Functional and Static Benchmark for Measuring Higher Level Mathematical Reasoning in LLMs
  2. 2026LiveMathematicianBench: A Live Benchmark for Research-Level Mathematical Reasoning with Proof Sketches
  3. 2026A Reference-Free Score for Detecting Silent Reasoning Failures in Large Language Models
  4. 2025ReliableMath: Benchmark of Reliable Mathematical Reasoning on Large Language Models
  5. 2026EternalMath: A Living Benchmark of Frontier Mathematics that Evolves with Human Discovery
  6. 2025DRIFT: Decompose, Retrieve, Illustrate, then Formalize Theorems
  7. 2026MIRA-Math: A Benchmark for Minimal Information Requesting and Mathematical Reasoning
  8. 2026AdvancedMathBench: A Benchmark Suite for Advanced Mathematical Proof Generation and Verification