mlsanityData to 14 Oct 2026

Reasoning as Energy Minimization over Structured Latent Trajectories

arXiv 2603.28248 ↗First posted 30 Mar 2026cs.AIcited by 0

On the map: LLM reasoning → Test-time compute and efficient thinking

Abstract (arXiv)

Single-shot neural decoders commit to answers without iterative refinement, while chain-of-thought methods introduce discrete intermediate steps but lack a scalar measure of reasoning progress. We propose Energy-Based Reasoning via Structured Latent Planning (EBRM), which models reasoning as gradient-based optimization of a multi-step latent trajectory z1:T under a learned energy function E(hx, z). The energy decomposes into per-step compatibility, transition consistency, and trajectory smoothness terms. Training combines supervised encoder-decoder learning with contrastive energy shaping using hard negatives, while inference performs gradient descent or Langevin dynamics over z and decodes from zT. We identify a critical failure mode: on CNF logic satisfaction, latent planning reduces accuracy from ≈ 95% to ≈ 56%. This degradation arises from a distribution mismatch, where the decoder is trained on encoder outputs hx but evaluated on planner outputs zT that drift into unseen latent regions. We analyze this behavior through per-step decoding, latent drift tracking, and gradient decomposition. To address it, we propose dual-path decoder training and latent anchoring. We further introduce a six-part ablation protocol covering component contributions, trajectory length, planner dynamics, initialization, decoder training distribution, and anchor weight. Experiments on three synthetic tasks show that energy decreases monotonically and induces structured latent trajectories on graph and logic tasks, while remaining flat on arithmetic (r = 0.073), indicating a negative result. Code is available at https://github.com/dkjo8/ebr-via-structured-latent-planning.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. Builds on 12 of its 17 references that are in the map. First posted on arXiv 30 Mar 2026.

Builds on

12 of 17 references.

Closest ancestors · 2

Same direction, newest first

  1. 2026nabla-Reasoner: LLM Reasoning via Test-Time Gradient Descent in Latent Space5 Mar
  2. 2025Latent Thought Models with Variational Bayes Inference-Time Computation3 Feb

Other references · 10

  1. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  2. 2022Planning with Diffusion for Flexible Behavior Synthesiscited by 1,061
  3. 2018Learning a SAT Solver from Single-Bit Supervisioncited by 200
  4. 2022The CLRS Algorithmic Reasoning Benchmarkcited by 106
  5. 2020Learning Latent Space Energy-Based Prior Modelcited by 104
  6. 2018Neural Arithmetic Logic Unitscited by 70
  7. 2023Efficient Planning with Latent Diffusioncited by 12
  8. 2024Learning Latent Space Hierarchical EBM Diffusion Modelscited by 6
  9. 2024Hitchhiker's guide on the relation of Energy-Based Models with other generative models, sampling and statistical physics: a comprehensive reviewcited by 5
  10. 2025Kolmogorov-Arnold Energy Models: Fast, Interpretable Generative Modelingcited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Planning as Descent: Goal-Conditioned Latent Trajectory Synthesis in Learned Energy Landscapes
  2. 2026Boosting Inference with Guided Reasoning: Stochastic Exploration for Recursive Models
  3. 2026Retrieval-Warmed Energy-Based Reasoning: A Five-Arm Ablation Methodology for Diffusion-as-Inference on Structured Reasoning Tasks
  4. 2026Latent Energy Action Planning with World Models
  5. 2026Xiaomi OneVL: One-Step Latent Reasoning and Planning with Vision-Language Explanation
  6. 2026Selective Regenerative Decoding: Trajectory-Level Intervention for Inference-Time Reasoning
  7. 2025Energy-Based Transformers are Scalable Learners and Thinkers
  8. 2026What Makes Effective Supervision in Latent Chain-of-Thought: An Information-Theoretic Analysis