TRACE: An Operational Reasoning Schema for Auditable Agentic Commitments
On the map: LLM reasoning → Prompting and chain-of-thought reasoning
also in 1 more
Abstract (arXiv)
This paper defines TRACE (Typed Reasoning And Commitment Evidence): a typed, versioned schema for recording reasoning traces, a reference procedure for writing records against it, and one operating discipline, no durable state change without a record. The paper argues in three layers that reasoning is not in the language model: the autoregressive mechanism natively computes association; chain-of-thought and reinforcement learning inherit its limits; and the formal constructs of reasoning theory, from Socratic procedure to Pearl's ladder, are absent as machinery. The schema answers the absence with fields and tests: the TraceRecord and its causal specialization, an eight-stage reference writer, a gate-first measurement regime, the TRACE-Bench protocol, and the consumers, memory admission, plan gating, temporal regret, and verdict reuse, whose more auditable decisions are the measure of the record. A record-consumer contract states what a record guarantees and what a consumer must honor in return, making the schema an operational interface rather than a passive document. Two worked examples run in the main text: a music-lessons argument traced from sentence to typed verdict, separating association, intervention, and prescription; and a flood search-and-rescue vignette in which a predictive world model reports confident plan success that its own support and out-of-distribution scores contradict, so the record defers the commitment, requests a bounded observation, revises append-only, and clears a different branch. The vignette is illustrative, not empirical; closed-loop evaluation is left to future work, so the contribution is the schema and its contract, not a performance claim. Appendices carry the full schema, writer algorithms and cost model, clinical and policy illustrations, the benchmark protocol, convergence metrics, and usage scenarios.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Prompting and chain-of-thought reasoning, one of 17 directions in LLM reasoning. Builds on 58 of its 124 references that are in the map. First posted on arXiv 14 Jul 2026.
Builds on
58 of 124 references.
Closest ancestors · 9
Same direction, newest first
- 2025Reasoning Models Don't Always Say What They Think8 May
- 2025Towards Reasoning Era: A Survey of Long Chain-of-Thought for Reasoning Large Language Models12 Mar
- 2023Measuring Faithfulness in Chain-of-Thought Reasoning17 Jul
- 2023Language Models Don't Always Say What They Think: Unfaithful Explanations in Chain-of-Thought Prompting7 May
- 2022Reasoning with Language Model Prompting: A Survey19 Dec
- 2022Large Language Models are Zero-Shot Reasoners24 May
- 2022Least-to-Most Prompting Enables Complex Reasoning in Large Language Models21 May
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Models21 Mar
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Models28 Jan
Other references · 49
- 2021Training Verifiers to Solve Math Word Problemscited by 9,743
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
- 2023Let's Verify Step by Stepcited by 3,598
- 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,155
- 2024Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameterscited by 1,928
- 2023Improving Factuality and Reasoning in Language Models through Multiagent Debatecited by 1,739
- 2024OpenAI o1 System Cardcited by 1,220
- 2023Encouraging Divergent Thinking in Large Language Models through Multi-Agent Debatecited by 995
- 2023Towards Understanding Sycophancy in Language Modelscited by 988
- 2023Large Language Models Cannot Self-Correct Reasoning Yetcited by 965
- 2025Does Reinforcement Learning Really Incentivize Reasoning Capacity in LLMs Beyond the Base Model?cited by 948
37 more
- 2021Show Your Work: Scratchpads for Intermediate Computation with Language Modelscited by 871
- 2022Discovering Language Model Behaviors with Model-Written Evaluationscited by 805
- 2022Towards Reasoning in Large Language Models: A Surveycited by 593
- 2024Do NOT Think That Much for 2+3=? On the Overthinking of o1-Like LLMscited by 564
- 2024GSM-Symbolic: Understanding the Limitations of Mathematical Reasoning in Large Language Modelscited by 533
- 2025Stop Overthinking: A Survey on Efficient Reasoning for Large Language Modelscited by 456
- 2018AI safety via debatecited by 384
- 2021MiniF2F: a cross-system benchmark for formal Olympiad-level mathematicscited by 380
- 2023Causal Reasoning and Large Language Models: Opening a New Frontier for Causalitycited by 348
- 2025The Illusion of Thinking: Understanding the Strengths and Limitations of Reasoning Models via the Lens of Problem Complexitycited by 298
- 2022Draft, Sketch, and Prove: Guiding Formal Theorem Provers with Informal Proofscited by 278
- 2023Reasoning or Reciting? Exploring the Capabilities and Limitations of Language Models Through Counterfactual Taskscited by 243
- 2025Spurious Rewards: Rethinking Training Signals in RLVRcited by 199
- 2025ProRL: Prolonged Reinforcement Learning Expands Reasoning Boundaries in Large Language Modelscited by 187
- 2023Causal Parrots: Large Language Models May Talk Causality But Are Not Causalcited by 146
- 2023Can Large Language Models Infer Causation from Correlation?cited by 142
- 2023CLadder: Assessing Causal Reasoning in Language Modelscited by 102
- 2021NaturalProofs: Mathematical Theorem Proving in Natural Languagecited by 80
- 2025Debate or Vote: Which Yields Better Decisions in Multi-Agent Large Language Models?cited by 74
- 2023A Survey of Reasoning with Foundation Modelscited by 70
- 2025Talk Isn't Always Cheap: Understanding Failure Modes in Multi-Agent Debatecited by 63
- 2023Scalable AI Safety via Doubly-Efficient Debatecited by 54
- 2025Logical Reasoning in Large Language Models: A Surveycited by 52
- 2025Do as We Do, Not as You Think: the Conformity of Large Language Modelscited by 48
- 2023Prompting Large Language Models With the Socratic Methodcited by 43
- 2025Stop Overvaluing Multi-Agent Debate -- We Must Rethink Evaluation and Embrace Model Heterogeneitycited by 43
- 2025Peacemaker or Troublemaker: How Sycophancy Shapes Multi-Agent Debatecited by 29
- 2024A Survey on Context-Aware Multi-Agent Systems: Techniques, Challenges and Future Directionscited by 27
- 2025Comment on The Illusion of Thinking: Understanding the Strengths and Limitations of Reasoning Models via the Lens of Problem Complexitycited by 22
- 2025Large Language Models in Argument Mining: A Surveycited by 14
- 2024SocraSynth: Multi-LLM Reasoning with Conditional Statisticscited by 13
- 2025Avoiding Obfuscation with Prover-Estimator Debatecited by 11
- 2024EVINCE: Optimizing Multi-LLM Dialogues Using Conditional Statistics and Information Theorycited by 6
- 2024Argument Quality Assessment in the Age of Instruction-Following Large Language Modelscited by 4
- 2026Trivium: Temporal Regret as a First-Class Objective for Causal-Memory Controllerscited by 4
- 2026Epistemic Regret Minimization: Label-Free Causal Critique Beyond Outcome Rewardcited by 2
- 2026CausalT5k: Diagnosing Refusal and Failure Modes in Trustworthy Causal Reasoning Across Causal Rungscited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026When AI Agents Commit: Cognitive Serializability Across Data, Evidence, Policy, and Authority
- 2026Auditing Action Settlement in LLM Agent Environments: Order, Progress, and Replay
- 2026The LLM Proposes, the Executive Disposes: A Self-Verifying Agent Instrument that Dissociates Commitment Drift from Binding Drift in Long-Horizon Agents
- 2026Plan Pointers and Record-Directive Form in Budgeted Verification of Inherited Agent Memory
- 2026When Reasoning Traces Become Performative: Step-Level Evidence that Chain-of-Thought Is an Imperfect Oversight Channel
- 2026Organising Trajectory Evidence for Language-Model Agent Assurance: Fragments, Methods, and the Residual
- 2026From Agent Traces to Trust: A Survey of Evidence Tracing and Execution Provenance in LLM Agents
- 2026MemTX: Transactional Belief Commit for Stateful Agent Memory