mlsanityData to 7 Oct 2026

Formula-One Prompting: A Composable Equation-First Prefix for Applied Mathematics

arXiv 2601.19302 ↗First posted 27 Jan 2026cs.CLcited by 0

On the map: LLM reasoning → Mathematical reasoning

Abstract (arXiv)

This paper introduces Formula Prompting (FP) and Formula-One Prompting (F-1), two single-call methods that elicit governing equations before solving applied-math problems. Chain-of-Thought (CoT) and Program-of-Thought (PoT) prompting improve mathematical reasoning by eliciting reasoning traces or code-like structures learned during pretraining. This suggests a diagnostic question: which useful pretraining patterns remain under-elicited? Using infini-gram-mini, we scan 81.7 trillion pretraining tokens and find that, in curated corpora such as DataComp-LM, equation-centered language appears 121x more often than code and 3.79x more often than step-by-step narration, yet standard prompting methods do not explicitly elicit equation formulation. FP asks the model to formalize a problem's governing equations before solving; F-1 extends FP with a composable Phase 2 that selects Direct, CoT, or PoT-style solving in the same call. Across five reasoning models and four applied-math benchmarks (finance, physics, cryptography, competition math), F-1 outperforms CoT by 5.76 pp and PoT by 8.42 pp on average, with the largest gain of 13.30 pp on FinanceMath, while topping the accuracy-token efficiency frontier at only 68 prompt tokens of overhead. Variant ablations identify the equation-formalization prefix, not the strategy menu, as the primary driver: adding CoT or PoT on top of the prefix yields no further gain, and 73.3% of remaining failures occur downstream of a correct Phase-1 equation.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Mathematical reasoning, one of 17 directions in LLM reasoning. Builds on 19 of its 29 references that are in the map. First posted on arXiv 27 Jan 2026.

Builds on

19 of 29 references.

Closest ancestors · 5

Same direction, newest first

  1. 2024Formal Mathematical Reasoning: A New Frontier in AI20 Dec
  2. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models5 Feb
  3. 2023Plan, Verify and Switch: Integrated Reasoning with Diverse X-of-Thoughts23 Oct
  4. 2023OpenWebMath: An Open Dataset of High-Quality Mathematical Web Text10 Oct
  5. 2022Solving Quantitative Reasoning Problems with Language Models29 Jun

Other references · 14

  1. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
  2. 2022Large Language Models are Zero-Shot Reasonerscited by 4,323
  3. 2022Challenging BIG-Bench Tasks and Whether Chain-of-Thought Can Solve Themcited by 1,767
  4. 2024OlympiadBench: A Challenging Benchmark for Promoting AGI with Olympiad-Level Bilingual Multimodal Scientific Problemscited by 1,099
  5. 2022Program of Thoughts Prompting: Disentangling Computation from Reasoning for Numerical Reasoning Taskscited by 1,057
  6. 2023FrugalGPT: How to Use Large Language Models While Reducing Cost and Improving Performancecited by 791
  7. 2024DataComp-LM: In search of the next generation of training sets for language modelscited by 381
  8. 2024To CoT or not to CoT? Chain-of-thought helps mainly on math and symbolic reasoningcited by 257
  9. 2023Solving Math Word Problems by Combining Language Models With Symbolic Solverscited by 124
  10. 2023Why think step by step? Reasoning emerges from the locality of experiencecited by 103
  11. 2025How Well do LLMs Compress Their Own Chain-of-Thought? A Token Complexity Approachcited by 95
  12. 2023FinanceMath: Knowledge-Intensive Math Reasoning in Finance Domainscited by 39
2 more
  1. 2025Infini-gram mini: Exact n-gram Search at the Internet Scale with FM-Indexcited by 13
  2. 2024Solving for X and Beyond: Can Large Language Models Solve Complex Math Problems with More-Than-Two Unknowns?cited by 7

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Less Is More: Cognitive Load and the Single-Prompt Ceiling in LLM Mathematical Reasoning
  2. 2024Gap-Filling Prompting Enhances Code-Assisted Mathematical Reasoning
  3. 2024Teaching-Inspired Integrated Prompting Framework: A Novel Approach for Enhancing Reasoning in Large Language Models
  4. 2023Leveraging Training Data in Few-Shot Prompting for Numerical Reasoning
  5. 2024Expanding Search Space with Diverse Prompting Agents: An Efficient Sampling Approach for LLM Mathematical Reasoning
  6. 2024Look Before You Leap: Problem Elaboration Prompting Improves Mathematical Reasoning in Large Language Models
  7. 2024BloomWise: Enhancing Problem-Solving capabilities of Large Language Models using Bloom's-Taxonomy-Inspired Prompts
  8. 2023Towards Revealing the Mystery behind Chain of Thought: A Theoretical Perspective