mlsanityData to 7 Oct 2026

Puppet-CNN: Continuous Parameter Dynamics for Input-Adaptive Convolutional Networks

arXiv 2411.12876 ↗First posted 19 Nov 2024cs.LG cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Modern convolutional neural networks (CNNs) organize computation as a discrete stack of layers whose parameters are independently stored and learned, with the number of layers fixed as an architectural hyperparameter. In this work, we explore an alternative perspective: can network parameterization itself be modeled as a continuous dynamical system? We introduce Puppet-CNN, a framework that represents convolutional layer parameters as states evolving along a learned parameter flow governed by a neural ordinary differential equation (ODE). Under this formulation, layer parameters are generated through continuous evolution in parameter space, and the effective number of generated layers is determined by the integration horizon of the learned dynamics, which can be modulated by input complexity to enable input-adaptive computation. We validate this formulation on standard image classification benchmarks and demonstrate that continuous parameter dynamics can achieve competitive predictive performance while substantially reducing stored trainable parameters. These results suggest that viewing neural network parameterization through the lens of dynamical systems provides a structured and flexible design space for adaptive convolutional models.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 27 of its 38 references that are in the map. First posted on arXiv 19 Nov 2024.

Builds on

27 of 38 references.

References · 27

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
  3. 2015Rethinking the Inception Architecture for Computer Visioncited by 5,451
  4. 2016Matching Networks for One Shot Learningcited by 2,246
  5. 2016HyperNetworkscited by 1,003
  6. 2017BranchyNet: Fast Inference via Early Exiting from Deep Neural Networkscited by 591
  7. 2019Dynamic Convolution: Attention over Convolution Kernelscited by 355
  8. 2017SkipNet: Learning Dynamic Routing in Convolutional Networkscited by 328
  9. 2016Dynamic Filter Networkscited by 318
  10. 2017Dynamic Edge-Conditioned Filters in Convolutional Neural Networks on Graphscited by 307
  11. 2019CondConv: Conditionally Parameterized Convolutions for Efficient Inferencecited by 273
  12. 2017Meta Networkscited by 268
15 more
  1. 2013Predicting Parameters in Deep Learningcited by 223
  2. 2017Adaptive Neural Networks for Efficient Inferencecited by 161
  3. 2017Convolutional Networks with Adaptive Inference Graphscited by 147
  4. 2020Resolution Adaptive Networks for Efficient Inferencecited by 146
  5. 2019Pixel-Adaptive Convolutional Neural Networkscited by 126
  6. 2016Spatially Adaptive Computation Time for Residual Networkscited by 118
  7. 2021Decoupled Dynamic Filter Networkscited by 52
  8. 2020WeightNet: Revisiting the Design Space of Weight Networkscited by 50
  9. 2017IDK Cascades: Fast Deep Learning by Learning not to Overthinkcited by 47
  10. 2024Neural Network Diffusioncited by 39
  11. 2024Diffusion-Based Neural Network Weights Generationcited by 38
  12. 2017Segmentation-Aware Convolutional Networks Using Local Attention Maskscited by 31
  13. 2017Energy-efficient Amortized Inference with Cascaded Deep Classifierscited by 15
  14. 2016Reflections on Shannon Information: In search of a natural information-entropy for imagescited by 12
  15. 2018IamNN: Iterative and Adaptive Mobile Neural Network for Efficient Image Classificationcited by 12

Built on by

Not cited yet.