Binary Quantized Neural Network Training Is W[1]-Hard Parameterized by Input and Output Dimensions
Not on the map. Why?
Abstract (arXiv)
Ganian et al. (ICLR 2026) proved that quantized neural network training is fixed-parameter tractable when parameterized jointly by architecture treewidth, input dimension α, and output dimension ω, and left open whether α+ω alone yields fixed-parameter tractability. We prove that 2-QNNT is W[1]-hard parameterized by α+ω. The hardness already holds with zero error on Dk=(xi(r),xi(r)):0≤ r≤ k, where every input equals its target, |Dk|=α=ω=k+1, and the examples form a coordinatewise prefix chain. It also holds when every non-source bias is fixed to zero. Under the Exponential Time Hypothesis, no algorithm runs in f(α+ω)|I|o(α+ω) for any computable f. The reduction starts from DAG edge-disjoint paths, converts edge capacity to vertex capacity with a directed line graph, and normalizes the result into a valid layered architecture. The key structural step is a one-flip routing equivalence: on the prefix-chain inputs, nonnegative binary weights make every activation monotone, and each required output transition has a weight-one predecessor making the same transition. Iterating this relation backward extracts a path from the unique changing input, while different transitions yield vertex-disjoint paths. In particular, every neuron on these inputs has only k+1 possible activation profiles.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 13 of its 23 references that are in the map. First posted on arXiv 22 Aug 2026.
Builds on
13 of 23 references.
References · 13
- 2017Quantization and Training of Neural Networks for Efficient Integer-Arithmetic-Only Inferencecited by 1,593
- 2015BinaryConnect: Training Deep Neural Networks with binary weights during propagationscited by 592
- 2016DoReFa-Net: Training Low Bitwidth Convolutional Neural Networks with Low Bitwidth Gradientscited by 569
- 2016Understanding Deep Neural Networks with Rectified Linear Unitscited by 257
- 2016Trained Ternary Quantizationcited by 208
- 2020Tight Hardness Results for Training Depth-2 ReLU Networkscited by 35
- 2018Complexity of Training ReLU Neural Networkcited by 23
- 2023Training Neural Networks is NP-Hard in Fixed Dimensioncited by 23
- 2021The Computational Complexity of ReLU Network Training Parameterized by Data Dimensionalitycited by 22
- 2022Training Fully Connected Neural Networks is existsℝ-Completecited by 15
- 2024On the Hardness of Training Deep Neural Networks Discretelycited by 2
- 2026New Complexity-Theoretic Frontiers of Tractability for Neural Network Trainingcited by 2
1 more
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Towards Provable and Scalable Training of Quantized Neural Networks with Ising Optimization
- 2024Gradient-Free Training of Quantized Neural Networks
- 2024On Expressive Power of Quantized Neural Networks under Fixed-Point Arithmetic
- 2021Training Quantized Neural Networks to Global Optimality via Semidefinite Programming
- 2023RepQ: Generalizing Quantization-Aware Training for Re-Parametrized Architectures
- 2023Towards Efficient Verification of Quantized Neural Networks
- 2022QFT: Post-training quantization via fast joint finetuning of all degrees of freedom
- 2022Why Quantization Improves Generalization: NTK of Binary Weight Neural Networks