mlsanityData to 14 Oct 2026

Efficient Tensor Completion Algorithms for Highly Oscillatory Operators

arXiv 2510.17734 ↗First posted 20 Oct 2025math.NA cs.LG cs.NAcited by 0

Not on the map. Why?

Abstract (arXiv)

This paper presents low-complexity tensor completion algorithms and their efficient implementation to reconstruct highly oscillatory operators discretized as n× n matrices. The underlying tensor decomposition is based on the reshaping of the input matrix and its butterfly decomposition into an order O (log n) tensor. The reshaping of the input matrix into a tensor allows for representation of the butterfly decomposition as a tensor decomposition with dense tensors. This leads to efficient utilization of the existing software infrastructure for dense and sparse tensor computations. We propose two tensor completion algorithms in the butterfly format, using alternating least squares and gradient-based optimization, as well as a novel strategy that uses low-rank matrix completion to efficiently generate an initial guess for the proposed algorithms. To demonstrate the efficiency and applicability of our proposed algorithms, we perform three numerical experiments using simulated oscillatory operators in seismic applications. In these experiments, we use O (n log n) observed entries in the input matrix and demonstrate an O(nlog3 n) computational cost of the proposed algorithms, leading to a speedup of orders of magnitudes per iteration for large matrices compared to the low-rank matrix and quantized tensor-train completion. Moreover, the proposed butterfly completion algorithms, equipped with the novel initial guess generation strategy, achieve reconstruction errors that are smaller by an order of magnitude, enabling accurate recovery of the underlying structure compared to the state-of-the-art completion algorithms.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 27 of its 102 references that are in the map. First posted on arXiv 20 Oct 2025.

Builds on

27 of 102 references.

References · 27

  1. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  2. 2016Tensor Ring Decompositioncited by 127
  3. 2023Parameter-Efficient Orthogonal Finetuning via Butterfly Factorizationcited by 114
  4. 2022Monarch: Expressive Structured Matrices for Efficient and Accurate Trainingcited by 106
  5. 2014Matrix Completion and Low-Rank SVD via Fast Alternating Least Squarescited by 104
  6. 2016TensorLy: Tensor Learning in Pythoncited by 104
  7. 2019Learning Fast Algorithms for Linear Transforms Using Butterfly Factorizationscited by 76
  8. 2021Pixelated Butterfly: Simple and Efficient Sparse training for Neural Network Modelscited by 76
  9. 2017Efficient Low Rank Tensor Ring Completioncited by 45
  10. 2013Square Deal: Lower Bounds and Improved Relaxations for Tensor Recoverycited by 37
  11. 2020Kaleidoscope: An Efficient, Learnable Representation For All Structured Linear Mapscited by 36
  12. 2018SwitchNet: a neural network model for forward and inverse scattering problemscited by 35
15 more
  1. 2022Adaptable Butterfly Accelerator for Attention-based NNs via Hardware and Algorithm Co-designcited by 31
  2. 2021Provable Tensor-Train Format Tensor Completion by Riemannian Optimizationcited by 17
  3. 2014Fast Exact Matrix Completion with Finite Samplescited by 15
  4. 2022Deformable Butterfly: A Highly Structured and Sparse Linear Transformcited by 8
  5. 2020Wide-band butterfly network: stable and efficient inversion via multi-frequency neural networkscited by 7
  6. 2021Tensor train completion: local recovery guarantees via Riemannian optimizationcited by 6
  7. 2020Efficient parallel CP decomposition with pairwise perturbation and multi-sweep dimension treecited by 4
  8. 2023Matrix Completion in Almost-Verification Timecited by 4
  9. 2019Distributed-Memory Tensor Completion for Generalized Loss Functions in Python using New Sparse Tensor Kernelscited by 3
  10. 2022Application Performance Modeling via Tensor Completioncited by 3
  11. 2023Minimum Cost Loop Nests for Contraction of a Sparse Tensor with a Tensor Networkcited by 2
  12. 2020Sparse Approximate Multifrontal Factorization with Butterfly Compression for High Frequency Wave Equationscited by 1
  13. 2021A Butterfly-Accelerated Volume Integral Equation Solver for Broad Permittivity and Large-Scale Electromagnetic Analysiscited by 1
  14. 2023A generalizable framework for low-rank tensor completion with numerical priorscited by 1
  15. 2024Butterfly factorization with error guaranteescited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Accelerating Large-Scale Regularized High-Order Tensor Recovery
  2. 2021Multi-Tensor Network Representation for High-Order Tensor Completion
  3. 2025SparseMap: A Sparse Tensor Accelerator Framework Based on Evolution Strategy
  4. 2026High-Resolution Tensor-Network Fourier Methods for Exponentially Compressed Non-Gaussian Aggregate Distributions
  5. 2025Score-Based Model for Low-Rank Tensor Recovery
  6. 2024Searching for Efficient Linear Layers over a Continuous Space of Structured Matrices
  7. 2023A Majorization-Minimization Gauss-Newton Method for 1-Bit Matrix Completion
  8. 2026DiffATS: Diffusion in Aligned Tensor Space