mlsanityData to 14 Oct 2026

A Small Math Model: Recasting Strategy Choice Theory in an LLM-Inspired Architecture

arXiv 2509.24068 ↗First posted 28 Sep 2025cs.LG cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Strategy Choice Theory (SCT; Siegler and Shrager, 1984; Siegler, 2000) explains important aspects of children's arithmetic learning based upon principles including learning from developmentally naturalistic data, probabilistic representation, confidence-based retrieval, and the phase-like importance of scaffolding strategies, such as finger-counting. Here we recast SCT as a ``Small Math Model'' (SMM), employing a neural-network-based architecture analogous to LLMs. The SMM extends SCT to include counting practice, symbol (number) embedding, and gated attention. Similar to earlier work, the SMM demonstrates constructive and destructive interference between counting and addition, and the ``wave-like'' use of finger-counting as sum recall improves. We plan to extend the SMM to later aspects of the decades-long SCT program, including adaptive strategy choice and eventually strategy discovery, providing a unified platform to investigate the understanding of numerical characteristics and relationships essential for mathematical reasoning -- as it can emerge in LLM-based agents.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 7 of its 18 references that are in the map. First posted on arXiv 28 Sep 2025.

Builds on

7 of 18 references.

References · 7

  1. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  2. 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,211
  3. 2022Interpretability in the Wild: a Circuit for Indirect Object Identification in GPT-2 smallcited by 1,165
  4. 2023Progress measures for grokking via mechanistic interpretabilitycited by 839
  5. 2024Mechanistic Interpretability for AI Safety -- A Reviewcited by 422
  6. 2019On The Power of Curriculum Learning in Training Deep Networkscited by 286
  7. 2025A Fragile Number Sense: Probing the Elemental Limits of Numerical Reasoning in LLMscited by 4

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024Exploring Natural Language-Based Strategies for Efficient Number Learning in Children through Reinforcement Learning
  2. 2024From Next-Token to Mathematics: The Learning Dynamics of Mathematical Reasoning in Language Models
  3. 2026Disentangling Mathematical Reasoning in LLMs: A Methodological Investigation of Internal Mechanisms
  4. 2024BloomWise: Enhancing Problem-Solving capabilities of Large Language Models using Bloom's-Taxonomy-Inspired Prompts
  5. 2024LLM The Genius Paradox: A Linguistic and Math Expert's Struggle with Simple Word-based Counting Problems
  6. 2026INSPIRE: An Internalize-Then-Improve Approach for Example-Driven Mathematical Reasoning
  7. 2026Shared circuits predict whether LLMs generalize across formats in arithmetic reasoning
  8. 2025Teaching LLMs to Think Mathematically: A Critical Study of Decision-Making via Optimization