Objects Without Morphisms: What LLMs for Mathematics Do Not Represent
Not on the map. Why?
Abstract (arXiv)
Large language models (LLMs) have reached expert-level performance on competition mathematics largely through the volume of search placed around them: candidate solutions are sampled in quantity and retained only when an external criterion accepts them. Such a procedure improves the outcome that survives it while leaving untouched what the model represents. We examine that question where no external criterion exists: translating statements between the dialects of neighbouring subfields, where fidelity turns on the level of generality at which content is asserted. The source leaves that level implicit in its vocabulary, so a faithful translation must recover it from the relation between the theories. We introduce an instrument that codes truth, content and scope in separate blind queues, with a judge-free measure of whether a rewrite states the hypothesis implicit in its source, and establish its sensitivity with a planted-positive control. Across seven models from four families, translating towards the general framing widens the domain of quantification in 60.6% of rewrites and narrows it in none; translating towards the concrete framing narrows it in 28.3% and widens it in 0.3%. The hypothesis that would prevent it is stated in 21.6% of model rewrites and 4.2% of human statements. Capability does not govern the asymmetry: it appears in every model tested, and the most capable widens least. It replicates on the half of the benchmark held out by a pre-registered rule, and on statements written by mathematicians. Instructing a model to state every hypothesis it requires raises that rate but not its sensitivity to direction. We argue that these systems have acquired an object-level correspondence between subfield vocabularies without the constraint under which a translation between theories carries hypotheses to hypotheses.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 18 of its 25 references that are in the map. First posted on arXiv 2 Oct 2026.
Builds on
18 of 25 references.
References · 18
- 2021Training Verifiers to Solve Math Word Problemscited by 10,109
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
- 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,371
- 2024Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameterscited by 1,986
- 2022Solving Quantitative Reasoning Problems with Language Modelscited by 1,392
- 2024Large Language Monkeys: Scaling Inference Compute with Repeated Samplingcited by 991
- 2024LLM Evaluators Recognize and Favor Their Own Generationscited by 686
- 2024GSM-Symbolic: Understanding the Limitations of Mathematical Reasoning in Large Language Modelscited by 550
- 2021Experts, Errors, and Context: A Large-Scale Study of Human Evaluation for Machine Translationcited by 338
- 2022Draft, Sketch, and Prove: Guiding Formal Theorem Provers with Informal Proofscited by 291
- 2024CheckEval: A reliable LLM-as-a-Judge framework for evaluating text generation using checklistscited by 94
6 more
- 2021NaturalProofs: Mathematical Theorem Proving in Natural Languagecited by 81
- 2024Reliable Evaluation and Benchmarks for Statement Autoformalizationcited by 32
- 2025Putnam-AXIOM: A Functional and Static Benchmark for Measuring Higher Level Mathematical Reasoning in LLMscited by 11
- 2026The Faithfulness Gap: Certifying Semantic Equivalence Between Natural-Language and Formal Mathematical Statementscited by 6
- 2021Operads for complex system design specification, analysis and synthesiscited by 3
- 2026Does My Embedding Reflect That A = B? Evaluating Mathematical Equivalence in Embedding Modelscited by 3
Built on by
Not cited yet.