Beyond the Trace: Coupling an Interpretable Reasoning-State Readout to Native MoE Routing
On the map: LLM reasoning → Test-time compute and efficient thinking
also in 1 more
Abstract (arXiv)
What a reasoning model writes is only a partial record of the process that produces it. We introduce a two-level internal readout for mixture-of-experts reasoning. We first distill vocabulary-scale J-space into J64, a 64-axis semantic frame learned from the model's own reasoning states. J64 reveals readable process state that the emitted trace does not show: it separates inference effort from problem-induced strain. It also adds 0.096 to 0.135 held-out AUC over a baseline that reads the same rollout as token occupancy and aggregates it in exactly the same way. We then reconstruct J64 from native expert-routing statistics. The result is R64, a low-overhead proxy: its median per-axis correlation with J64 is 0.69 to 0.86 across three models and two families, and on gpt-oss-20b it preserves 95 to 100% of J64's predictive gain. The readout supports test-time decisions at two temporal resolutions. Over completed candidate sets, J64 and R64 improve single-branch selection, and R64-weighted voting improves plain majority voting in seven of eight settings. During generation, rolling readout windows drive a cumulative stop-and-resample policy whose operating point is fixed on training questions alone. J64 improves accuracy by 1.1 to 5.9 points over a sibling-permuted control, and the routing-only R64 proxy retains 0.9 to 3.2 of those points. Finally, router edits aimed at the mechanism J64 names induce the predicted reasoning behaviors and shift a diagnosed stall from numerical guessing toward exact symbolic execution. Together, J64 makes latent process state readable, while routing makes it deployable and actionable.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. Builds on 0 of its 22 references that are in the map. First posted on arXiv 18 Aug 2026.
Builds on
0 of 22 references.
No references here yet.
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026When Are Experts Misrouted? Counterfactual Routing Analysis in Mixture-of-Experts Language Models
- 2026From Concentration to Differentiation and Back: Routing Effective Rank in MoE Reasoning Cohorts
- 2025Route to Reason: Adaptive Routing for LLM and Reasoning Strategy Selection
- 2026Beyond Magnitude: Contrastive Routing for Modular Mixture-of-Experts
- 2026RouteGoT: Node-Adaptive Routing for Cost-Efficient Graph of Thoughts Reasoning
- 2025Beyond Semantics: The Unreasonable Effectiveness of Reasonless Intermediate Tokens
- 2026EchoCoT: Extracting Hidden Chain-of-Thought from Large Reasoning Models
- 2026Does the Same Token Mean the Same State? MoE Routing as Signal for Reasoning Control