mlsanityData to 14 Oct 2026

Training-Free Bottleneck Width Planning for Convolutional Autoencoders

arXiv 2609.30755 ↗First posted 25 Sep 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Multiscale Spectral Rate-Distortion (MS-SRD) estimates the bottleneck channels required at user-supplied spatial cuts from training images and a normalized mean-squared error (NMSE) bound, without fitting a neural network. Its covariance-tail rule is exact for shared linear block-convolutional autoencoders under squared error. A nested-scale dominance result motivates reporting the activation-parameter Pareto frontier alongside the minimum-latent candidate. At NMSE <= 0.01 on thirteen grayscale datasets, its latent-size prediction has 0.84% mean absolute percentage error against nonlinear patch-autoencoder boundaries; ten predictions are exact and the remaining three differ by one channel. In a four-dataset deployable comparison, MS-SRD matches all retrospective external widths and all four selected models pass, without training a selector; a 46-fit validation grid and four Least-Volume fits each pass on two datasets. In a skip-closed U-shaped autoencoder at the same bound, five predictions are exact, nine are within one channel, and every failing prediction is one channel short. Experiments at looser bounds show progressively larger nonlinear savings.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 19 of its 41 references that are in the map. First posted on arXiv 25 Sep 2026.

Builds on

19 of 41 references.

References · 19

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
  3. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  4. 2017Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithmscited by 4,349
  5. 2016Gaussian Error Linear Units (GELUs)cited by 3,502
  6. 2018Group Normalizationcited by 1,524
  7. 2017EuroSAT: A Novel Dataset and Deep Learning Benchmark for Land Use and Land Cover Classificationcited by 1,496
  8. 2021MedMNIST v2 -- A large-scale lightweight benchmark for 2D and 3D biomedical image classificationcited by 690
  9. 2018Deep Learning for Classical Japanese Literaturecited by 422
  10. 2021The Intrinsic Dimension of Images and Its Impact on Learningcited by 315
  11. 2018Estimating the intrinsic dimension of datasets by a minimal neighborhood informationcited by 250
  12. 2020Neural Architecture Search without Trainingcited by 244
7 more
  1. 2021Zero-Cost Proxies for Lightweight NAScited by 199
  2. 2014Learning Ordered Representations with Nested Dropoutcited by 84
  3. 2022NAS-Bench-Suite-Zero: Accelerating Research on Zero Cost Proxiescited by 36
  4. 2021Does the Data Induce Capacity Control in Deep Learning?cited by 14
  5. 2020Stochastic Bottleneck: Rateless Auto-Encoder for Flexible Dimensionality Reductioncited by 13
  6. 2019Dimension Estimation Using Autoencoderscited by 3
  7. 2013Rate-Distortion Auto-Encoderscited by 1

Built on by

Not cited yet.