cs.LGSep 21, 2026

Q-DEQ: Discrete Solving and Quantization for Deep Equilibrium Models in Time Series Forecasting under Edge Deployment Coding Constraints

Authors: Ruotong YangHongdong ZhuQi GaoYin MaHai WeiKai Wen

Abstract

Edge deployment motivates forecasting models with compact parameter storage and low-bit representations. Deep equilibrium models (DEQs) obtain implicit depth by repeatedly applying a shared layer, reducing the parameter cost of explicit layer stacking. Their usual Anderson solver, however, searches for update coefficients in the continuous real domain. We propose Q-DEQ, which formulates local updates in DEQ forward solving as discrete optimization problems. Candidate directions are constructed from the current state and iteration history, and a local quadratic residual model is used to evaluate their combinations. Binary encoding of the direction coefficients yields a quadratic unconstrained binary optimization (QUBO) problem that can be solved by simulated annealing (SA) or a coherent Ising machine (CIM). After fixed-point solving, a re-forward pass applies W8A8 fake quantization to the shared layer's weights and activations. We evaluate Q-DEQ with an iTransformer backbone on five multivariate time series forecasting datasets. Relative MSE differences from the explicit multi-layer baseline range from 1.16%-1.16\% to +2.90%+2.90\%, with lower MSE on two datasets. DEQ parameter sharing reduces parameter counts by factors of 1.80×1.80\times--3.82×3.82\times; combined with W8A8, static weight storage is reduced by factors of 4.3×4.3\times--12.8×12.8\times. Local QUBO problems solved using CPU-based SA and the Kaiwu CIM physical backend produce closely matching downstream forecasts. These results establish local discrete solving as a viable component of DEQ time series forecasting and provide a route for executing fixed-point updates through different combinatorial optimization backends.

Explore similar work

CardsList
  1. Gated QKAN-FWP: Scalable Quantum-inspired Sequence Learning

    May 7, 2026Kuo-Chung Peng, Samuel Yen-Chi Chen, Jiun-Cheng Jiang +16Quantum Machine LearningQuantum Computing