Puppet-CNN: Continuous Parameter Dynamics for Input-Adaptive Convolutional Networks
Not on the map. Why?
Abstract (arXiv)
Modern convolutional neural networks (CNNs) organize computation as a discrete stack of layers whose parameters are independently stored and learned, with the number of layers fixed as an architectural hyperparameter. In this work, we explore an alternative perspective: can network parameterization itself be modeled as a continuous dynamical system? We introduce Puppet-CNN, a framework that represents convolutional layer parameters as states evolving along a learned parameter flow governed by a neural ordinary differential equation (ODE). Under this formulation, layer parameters are generated through continuous evolution in parameter space, and the effective number of generated layers is determined by the integration horizon of the learned dynamics, which can be modulated by input complexity to enable input-adaptive computation. We validate this formulation on standard image classification benchmarks and demonstrate that continuous parameter dynamics can achieve competitive predictive performance while substantially reducing stored trainable parameters. These results suggest that viewing neural network parameterization through the lens of dynamical systems provides a structured and flexible design space for adaptive convolutional models.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 27 of its 38 references that are in the map. First posted on arXiv 19 Nov 2024.
Builds on
27 of 38 references.
References · 27
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
- 2015Rethinking the Inception Architecture for Computer Visioncited by 5,475
- 2016Matching Networks for One Shot Learningcited by 2,255
- 2016HyperNetworkscited by 1,027
- 2017BranchyNet: Fast Inference via Early Exiting from Deep Neural Networkscited by 596
- 2019Dynamic Convolution: Attention over Convolution Kernelscited by 356
- 2017SkipNet: Learning Dynamic Routing in Convolutional Networkscited by 332
- 2016Dynamic Filter Networkscited by 319
- 2017Dynamic Edge-Conditioned Filters in Convolutional Neural Networks on Graphscited by 310
- 2019CondConv: Conditionally Parameterized Convolutions for Efficient Inferencecited by 273
- 2017Meta Networkscited by 269
15 more
- 2013Predicting Parameters in Deep Learningcited by 224
- 2017Adaptive Neural Networks for Efficient Inferencecited by 163
- 2017Convolutional Networks with Adaptive Inference Graphscited by 148
- 2020Resolution Adaptive Networks for Efficient Inferencecited by 146
- 2019Pixel-Adaptive Convolutional Neural Networkscited by 126
- 2016Spatially Adaptive Computation Time for Residual Networkscited by 118
- 2021Decoupled Dynamic Filter Networkscited by 53
- 2020WeightNet: Revisiting the Design Space of Weight Networkscited by 50
- 2017IDK Cascades: Fast Deep Learning by Learning not to Overthinkcited by 48
- 2024Neural Network Diffusioncited by 42
- 2024Diffusion-Based Neural Network Weights Generationcited by 39
- 2017Segmentation-Aware Convolutional Networks Using Local Attention Maskscited by 31
- 2017Energy-efficient Amortized Inference with Cascaded Deep Classifierscited by 15
- 2016Reflections on Shannon Information: In search of a natural information-entropy for imagescited by 12
- 2018IamNN: Iterative and Adaptive Mobile Neural Network for Efficient Image Classificationcited by 12
Built on by
Not cited yet.