mlsanityData to 14 Oct 2026

Q-DEQ: Discrete Solving and Quantization for Deep Equilibrium Models in Time Series Forecasting under Edge Deployment Coding Constraints

arXiv 2609.24042 ↗First posted 21 Sep 2026cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Edge deployment motivates forecasting models with compact parameter storage and low-bit representations. Deep equilibrium models (DEQs) obtain implicit depth by repeatedly applying a shared layer, reducing the parameter cost of explicit layer stacking. Their usual Anderson solver, however, searches for update coefficients in the continuous real domain. We propose Q-DEQ, which formulates local updates in DEQ forward solving as discrete optimization problems. Candidate directions are constructed from the current state and iteration history, and a local quadratic residual model is used to evaluate their combinations. Binary encoding of the direction coefficients yields a quadratic unconstrained binary optimization (QUBO) problem that can be solved by simulated annealing (SA) or a coherent Ising machine (CIM). After fixed-point solving, a re-forward pass applies W8A8 fake quantization to the shared layer's weights and activations. We evaluate Q-DEQ with an iTransformer backbone on five multivariate time series forecasting datasets. Relative MSE differences from the explicit multi-layer baseline range from -1.16% to +2.90%, with lower MSE on two datasets. DEQ parameter sharing reduces parameter counts by factors of 1.80×--3.82×; combined with W8A8, static weight storage is reduced by factors of 4.3×--12.8×. Local QUBO problems solved using CPU-based SA and the Kaiwu CIM physical backend produce closely matching downstream forecasts. These results establish local discrete solving as a viable component of DEQ time series forecasting and provide a route for executing fixed-point updates through different combinatorial optimization backends.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 13 of its 15 references that are in the map. First posted on arXiv 21 Sep 2026.

Builds on

13 of 15 references.

References · 13

  1. 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,169
  2. 2013Estimating or Propagating Gradients Through Stochastic Neurons for Conditional Computationcited by 2,079
  3. 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,676
  4. 2017Quantization and Training of Neural Networks for Efficient Integer-Arithmetic-Only Inferencecited by 1,593
  5. 2023iTransformer: Inverted Transformers Are Effective for Time Series Forecastingcited by 931
  6. 2019Deep Equilibrium Modelscited by 615
  7. 2020Multiscale Deep Equilibrium Modelscited by 151
  8. 2020Deep Graph Matching via Blackbox Differentiation of Combinatorial Solverscited by 81
  9. 2022Deep Equilibrium Optical Flow Estimationcited by 64
  10. 2026LoopQ: Quantization for Looped Language Modelscited by 6
  11. 2025Automating Versatile Time-Series Analysis with Tiny Transformers on Embedded FPGAscited by 4
  12. 2026What Survives When You Compress a Recursive Reasoner for the Edge?cited by 3
1 more
  1. 2026Quantizing Recursive Reasoning Modelscited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2021Learning from Multiple Time Series: A Deep Disentangled Approach to Diversified Time Series Forecasting
  2. 2026QUALS: Corpus Equilibrium for Universal Forecasting via Pattern Quantization and Learnability Synchronization
  3. 2022VQ-AR: Vector Quantized Autoregressive Probabilistic Time Series Forecasting
  4. 2026SACQ: Structured Decoding with Memory-Conditioned Refinement for Long-Horizon Forecasting
  5. 2024SDE: A Simplified and Disentangled Dependency Encoding Framework for State Space Models in Time Series Forecasting
  6. 2023Generative Time Series Forecasting with Diffusion, Denoise, and Disentanglement
  7. 2026Aurora-X: Built for Extreme Time Series Forecasting
  8. 2024Sparse-VQ Transformer: An FFN-Free Framework with Vector Quantization for Enhanced Time Series Forecasting