mlsanityData to 7 Oct 2026

When Quantization Breaks Memory: Recurrent-State Write-Back in Low-Precision Temporal Inference

arXiv 2609.04490 ↗First posted 3 Sep 2026cs.AI cs.LG physics.opticscited by 0

Not on the map. Why?

Abstract (arXiv)

Quantization is widely used to reduce the computational and memory demands of neural-network inference. In recurrent networks, however, the quantized state is stored and returned at the next time step, so the rule used to store that state can alter subsequent computations. Here, we introduce recurrent-state write-back to denote this rule and isolate its effect in a compact GRU encoder--decoder for fluorescence lifetime imaging, a molecular imaging modality used in quantitative biological imaging. A central task is estimating two lifetime parameters, the short-lived component τ1 and the long-lived component τ2, from high-noise time-resolved fluorescence signals. Holding the trained model fixed, replacing continuous state propagation with deterministic 4-bit state storage increases estimation errors for τ1 and τ2 by approximately 70x and 300x, respectively. Failure occurs when repeated small updates remain below the write threshold, leaving the stored state nearly fixed while the network continues to propose change. Error feedback, residual memory, and direction memory carry information from these suppressed updates across time and recover accuracy without retraining. Precision sweeps show that increasing state precision can worsen a fixed recurrent solution, while matched training shows that compatibility with the state interface can be learned. To test whether this behavior extends beyond the GRU, we repeat the post-training intervention in an independently trained LSTM, where coarse write-back reproduces the failure, error feedback restores accuracy, and state-specific interventions reveal greater sensitivity of the cell state than the hidden state. Our results establish recurrent-state write-back as a key determinant of low-precision recurrent dynamics and identify the state-storage interface as a central design consideration for quantized recurrent inference.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 9 of its 19 references that are in the map. First posted on arXiv 3 Sep 2026.

Builds on

9 of 19 references.

References · 9

  1. 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,016
  2. 2015Deep Compression: Compressing Deep Neural Networks with Pruning, Trained Quantization and Huffman Codingcited by 2,291
  3. 2017Quantization and Training of Neural Networks for Efficient Integer-Arithmetic-Only Inferencecited by 1,548
  4. 2016Quantized Neural Networks: Training Neural Networks with Low Precision Weights and Activationscited by 413
  5. 2020Automatic heterogeneous quantization of deep neural networks for low-latency inference on the edge for particle detectorscited by 78
  6. 2016ESE: Efficient Speech Recognition Engine with Sparse LSTM on FPGAcited by 50
  7. 2018Alternating Multi-bit Quantization for Recurrent Neural Networkscited by 30
  8. 2024Compressing Recurrent Neural Networks for FPGA-accelerated Implementation in Fluorescence Lifetime Imagingcited by 2
  9. 2024Unlocking Real-Time Fluorescence Lifetime Imaging: Multi-Pixel Parallelism for FPGA-Accelerated Processingcited by 2

Built on by

Not cited yet.