mlsanityData to 14 Oct 2026

Robust Neural Tucker Factorization with Bias Correction and Adaptive Initialization

arXiv 2606.16388 ↗First posted 15 Jun 2026cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

High-dimensional incomplete (HDI) tensors are widely used in traffic and climate applications, but sparse observations make accurate completion difficult. The intrinsic non-linear dynamics and non-stationary variations across distinct multi-modal fields severely hinder the efficacy of conventional linear reconstruction frameworks. Neural Tucker factorization provides an effective framework for modeling high-order interactions among tensor modes. By parameterizing underlying structural characteristics into continuous latent spaces, neural representations circumvent the rigid low-rank constraints of classical algebra. However, its performance can still be affected by implementation-level choices, especially parameter initialization and the bias configuration of the final output mapping. Suboptimal initializations frequently lead to variance explosion across the cubically expanded interaction spaces, driving the subsequent non-linear activation boundaries into severe gradient saturation zones, while the omission of a dedicated translation parameter forces interaction weights to implicitly absorb global statistical deviations. This paper proposes a simple yet effective neural Tucker factorization model with Kaiming initialization and bias correction (KaBiN) for HDI tensor completion. The proposed model utilizes Kaiming uniform initialization for the embedding and Tucker linear parameters, and adopts a simple bias correction in output mapping. By elegantly decoupling global mean shifts from local structural representations, the framework provides a highly stable and well-conditioned optimization landscape. Experiments on three real-world HDI tensor datasets show that KaBiN achieves better performance than the original NeuTucF, while introducing minimal computational overhead.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 12 of its 104 references that are in the map. First posted on arXiv 15 Jun 2026.

Builds on

12 of 104 references.

References · 12

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 7,005
  3. 2016Layer Normalizationcited by 5,669
  4. 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,509
  5. 2017Spatio-Temporal Graph Convolutional Networks: A Deep Learning Framework for Traffic Forecastingcited by 1,136
  6. 2017Neural Collaborative Filteringcited by 1,111
  7. 2013Exact solutions to the nonlinear dynamics of learning in deep linear neural networkscited by 763
  8. 2014Identifying and attacking the saddle point problem in high-dimensional non-convex optimizationcited by 289
  9. 2015All you need is a good initcited by 124
  10. 2017Tensor Completion Algorithms in Big Data Analyticscited by 48
  11. 2019Bayesian Temporal Factorization for Multidimensional Time Series Predictioncited by 47
  12. 2021Low-Rank Autoregressive Tensor Completion for Spatiotemporal Traffic Data Imputationcited by 35

Built on by

Not cited yet.