mlsanityData to 7 Oct 2026

What Survives When You Compress a Recursive Reasoner for the Edge?

arXiv 2606.26488 ↗First posted 25 Jun 2026cs.LGcited by 3

On the map: LLM reasoning → Test-time compute and efficient thinking

Abstract (arXiv)

Recursive reasoning models solve hard structured tasks with a few million parameters by iterating a latent state, but deploying them on edge hardware means compressing them -- and quantization noise compounds across recursive cycles rather than accumulating over output tokens, so single-pass intuitions fail. Here, we ask what survives. Across a full precision sweep and three tasks, aggressive compression preserves local prediction but destroys global reasoning: pruning, distillation, and linear attention drive puzzle-exact accuracy to zero while cell accuracy holds. Naive INT4 is different: its damage is architectural, striking MLP-mixing recursion but not attention on the same task, and per-channel calibration reverses it without retraining, where quantization-aware training does not. We also introduce carry-trajectory fidelity, the cosine similarity to the full-precision reasoning path, as a label-free signal that predicts both the damage and the recovery before any task evaluation, with a threshold that transfers across tasks. The result is a deployment recipe: flash-streamed embeddings remove a 99.4 MB bottleneck, one recursive cycle matches full-depth accuracy at 6x fewer FLOPs, and calibrated INT4 brings the backbone to 3.3 MB, inside a 4 MB budget.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. Builds on 20 of its 28 references that are in the map. First posted on arXiv 25 Jun 2026.

Builds on

20 of 28 references.

Closest ancestors · 5

Same direction, newest first

  1. 2026What Makes Low-Bit Quantization-Aware Training Work for Reasoning LLMs? A Systematic Study21 Jan
  2. 2025Latent Thinking Optimization: Your Latent Reasoning Language Model Secretly Encodes Reward Signals in Its Latent Thoughts30 Sep
  3. 2025Quantization Hurts Reasoning? An Empirical Study on Quantized Reasoning Models7 Apr
  4. 2025Scaling up Test-Time Compute with Latent Reasoning: A Recurrent Depth Approach7 Feb
  5. 2022End-to-end Algorithm Synthesis with Recurrent Networks: Logical Extrapolation Without Overthinking11 Feb

Other references · 15

  1. 2015Deep Compression: Compressing Deep Neural Networks with Pruning, Trained Quantization and Huffman Codingcited by 2,291
  2. 2022LLM.int8(): 8-bit Matrix Multiplication for Transformers at Scalecited by 881
  3. 2024Training Large Language Models to Reason in a Continuous Latent Spacecited by 763
  4. 2018Universal Transformerscited by 613
  5. 2021A White Paper on Neural Network Quantizationcited by 453
  6. 2020MCUNet: Tiny Deep Learning on IoT Devicescited by 269
  7. 2021I-BERT: Integer-only BERT Quantizationcited by 250
  8. 2023Do Emergent Abilities Exist in Quantized Large Language Models: An Empirical Studycited by 43
  9. 2024Tracing Representation Progression: Analyzing and Enhancing Layer-Wise Similaritycited by 36
  10. 2026Loop, Think, & Generalize: Implicit Reasoning in Recurrent-Depth Transformerscited by 34
  11. 2024QT-DoG: Quantization-aware Training for Domain Generalizationcited by 13
  12. 2022QReg: On Regularization Effects of Quantizationcited by 9
3 more
  1. 2024QGen: On the Ability to Generalize in Quantization Aware Trainingcited by 7
  2. 2025Neural Network Quantization for Microcontrollers: A Comprehensive Survey of Methods, Platforms, and Applicationscited by 6
  3. 2023Fighting over-fitting with quantization for learning deep neural networks on noisy labelscited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026What to Preserve in Recursive Computation: A Local Predictive Sufficiency Principle
  2. 2026Memory Augmentation Unlocks Efficient Chain-of-Thought Reasoning
  3. 2025Reasoning Path Compression: Compressing Generation Trajectories for Efficient LLM Reasoning
  4. 2026Fewer Tokens, Smaller Cache: Reward-Coordinated Efficient Reasoning
  5. 2025ConCISE: Confidence-guided Compression in Step-by-step Efficient Reasoning
  6. 2026Quantizing Recursive Reasoning Models
  7. 2025Breadcrumbs Reasoning: Memory-Efficient Reasoning with Compression Beacons
  8. 2025When Reasoning Meets Compression: Understanding the Effects of LLMs Compression on Large Reasoning Models