cs.LGAug 22, 2026

Binary Quantized Neural Network Training Is W[1]-Hard Parameterized by Input and Output Dimensions

Authors: Tao Jiang, Minbo Gao, Shaowei Cai

Organizations: Key Laboratory of System Software (Chinese Academy of Sciences) · State Key Laboratory of Computer Science · Institute of Software, Chinese Academy of Sciences · School of Computer Science and Technology, University of Chinese Academy of Sciences

Abstract

Ganian et al. (ICLR 2026) proved that quantized neural network training is fixed-parameter tractable when parameterized jointly by architecture treewidth, input dimension αα, and output dimension ωω, and left open whether α+ωα+ω alone yields fixed-parameter tractability. We prove that 2-QNNT is W[1]-hard parameterized by α+ωα+ω. The hardness already holds with zero error on Dk={(ξ(r),ξ(r)):0≤r≤k}D_k=\{(ξ^{(r)},ξ^{(r)}):0\le r\le k\}, where every input equals its target, ∣Dk∣=α=ω=k+1|D_k|=α=ω=k+1, and the examples form a coordinatewise prefix chain. It also holds when every non-source bias is fixed to zero. Under the Exponential Time Hypothesis, no algorithm runs in f(α+ω)∣I∣o(α+ω)f(α+ω)|I|^{o(α+ω)} for any computable ff. The reduction starts from DAG edge-disjoint paths, converts edge capacity to vertex capacity with a directed line graph, and normalizes the result into a valid layered architecture. The key structural step is a one-flip routing equivalence: on the prefix-chain inputs, nonnegative binary weights make every activation monotone, and each required output transition has a weight-one predecessor making the same transition. Iterating this relation backward extracts a path from the unique changing input, while different transitions yield vertex-disjoint paths. In particular, every neuron on these inputs has only k+1k+1 possible activation profiles.

Figures & tables

Appendix figures & tables1 asset

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. Characterizing Learning in Deep Neural Networks using Tractable Algorithmic Complexity Analysis

    May 15, 2026Pedram Bakhtiarifard, Sophia N. Wilson, Mahmoud Afifi +2Neural Network GeneralizationNeural Network Training Dynamics