Deciding How to Decide: Dynamic Routing in Artificial Neural Networks
Not on the map. Why?
Abstract (arXiv)
We propose and systematically evaluate three strategies for training dynamically-routed artificial neural networks: graphs of learned transformations through which different input signals may take different paths. Though some approaches have advantages over others, the resulting networks are often qualitatively similar. We find that, in dynamically-routed networks trained to classify images, layers and branches become specialized to process distinct categories of images. Additionally, given a fixed computational budget, dynamically-routed networks tend to perform better than comparable statically-routed networks.
Key facts. Cited by 33 papers in the map (data through 7 Oct 2026). First posted on arXiv 17 Mar 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 10; 2022: 7; 2023: 6; 2024: 4; 2025: 3; 2026: 3.
33 papers.
Sort:
By area:
- 2021Dynamic Neural Networks: A Surveycited by 405
- 2021AdaFuse: Adaptive Temporal Fusion Network for Efficient Action Recognitioncited by 48
- 2021Zero Time Waste: Recycling Predictions in Early Exit Neural Networkscited by 39
- 2021AdaMML: Adaptive Multi-Modal Learning for Efficient Video Recognitioncited by 36
- 2021Dynamic Network Quantization for Efficient Video Inferencecited by 36
- 2025VORTA: Efficient Video Diffusion via Routing Sparse Attentioncited by 23
- 2021Anytime Dense Prediction with Confidence Adaptivitycited by 18
- 2024TESTAM: A Time-Enhanced Spatio-Temporal Attention Model with Mixture of Expertscited by 18
- 2022Neural Networks are Decision Treescited by 16
- 2021VA-RED2: Video Adaptive Redundancy Reductioncited by 15
- 2023DynamicDet: A Unified Dynamic Architecture for Object Detectioncited by 15
- 2022Spatial Mixture-of-Expertscited by 14
21 more
- 2023Revisiting Single-gated Mixtures of Expertscited by 10
- 2021E2CM: Early Exit via Class Means for Efficient Supervised and Unsupervised Learningcited by 8
- 2022Boosted Dynamic Neural Networkscited by 8
- 2023AsConvSR: Fast and Lightweight Super-Resolution Network with Assembled Convolutionscited by 8
- 2022A Survey of Neural Treescited by 7
- 2022Understanding the Robustness of Multi-Exit Models under Common Corruptionscited by 4
- 2025EgoAdapt: Adaptive Multisensory Distillation and Policy Learning for Efficient Egocentric Perceptioncited by 4
- 2026ODAR: Principled Adaptive Routing for LLM Reasoning via Active Inferencecited by 4
- 2021Sparsely ensembled convolutional neural network classifiers via reinforcement learningcited by 2
- 2021Complexity-aware Adaptive Training and Inference for Edge-Cloud Distributed AI Systemscited by 2
- 2023ATESA-BAERT: A Heterogeneous Ensemble Learning Model for Aspect-Based Sentiment Analysiscited by 2
- 2025Divide, Specialize, and Route: A New Approach to Efficient Ensemble Learningcited by 2
- 2022Transition Matrix Representation of Trees with Transposed Convolutionscited by 1
- 2022Neural Routing in Meta Learningcited by 0
- 2023Unifying Synergies between Self-supervised Learning and Dynamic Computationcited by 0
- 2023LEURN: Learning Explainable Univariate Rules with Neural Networkscited by 0
- 2024Conditional Information Gain Trelliscited by 0
- 2024Rule Based Learning with Dynamic (Graph) Neural Networkscited by 0
- 2024Block-Operations: Using Modular Routing to Improve Compositional Generalizationcited by 0
- 2026cMoLLM at Scale: Horizontal Scaling Laws for Mixture-of-LLMscited by 0
- 2026Harnessing Domain Specialists in Multimodal Mixture-of-Experts for Efficient Adaptationcited by 0
- 2026Harnessing Domain Specialists in Multimodal Mixture-of-Experts for Efficient Adaptation1 Oct 2026
- 2026cMoLLM at Scale: Horizontal Scaling Laws for Mixture-of-LLMs6 Jun 2026
- 2026ODAR: Principled Adaptive Routing for LLM Reasoning via Active Inference27 Feb 2026
- 2025EgoAdapt: Adaptive Multisensory Distillation and Policy Learning for Efficient Egocentric Perception26 Jun 2025
- 2025Divide, Specialize, and Route: A New Approach to Efficient Ensemble Learning25 Jun 2025
- 2025VORTA: Efficient Video Diffusion via Routing Sparse Attention24 May 2025
- 2024Block-Operations: Using Modular Routing to Improve Compositional Generalization1 Aug 2024
- 2024Rule Based Learning with Dynamic (Graph) Neural Networks14 Jun 2024
- 2024TESTAM: A Time-Enhanced Spatio-Temporal Attention Model with Mixture of Experts5 Mar 2024
- 2024Conditional Information Gain Trellis13 Feb 2024
- 2023ATESA-BAERT: A Heterogeneous Ensemble Learning Model for Aspect-Based Sentiment Analysis29 Jul 2023
- 2023AsConvSR: Fast and Lightweight Super-Resolution Network with Assembled Convolutions5 May 2023
21 more
- 2023DynamicDet: A Unified Dynamic Architecture for Object Detection12 Apr 2023
- 2023Revisiting Single-gated Mixtures of Experts11 Apr 2023
- 2023LEURN: Learning Explainable Univariate Rules with Neural Networks27 Mar 2023
- 2023Unifying Synergies between Self-supervised Learning and Dynamic Computation22 Jan 2023
- 2022Understanding the Robustness of Multi-Exit Models under Common Corruptions3 Dec 2022
- 2022Boosted Dynamic Neural Networks30 Nov 2022
- 2022Spatial Mixture-of-Experts24 Nov 2022
- 2022Neural Routing in Meta Learning14 Oct 2022
- 2022Neural Networks are Decision Trees11 Oct 2022
- 2022A Survey of Neural Trees7 Sep 2022
- 2022Transition Matrix Representation of Trees with Transposed Convolutions22 Feb 2022
- 2021Complexity-aware Adaptive Training and Inference for Edge-Cloud Distributed AI Systems14 Sep 2021
- 2021Dynamic Network Quantization for Efficient Video Inference23 Aug 2021
- 2021Zero Time Waste: Recycling Predictions in Early Exit Neural Networks9 Jun 2021
- 2021AdaMML: Adaptive Multi-Modal Learning for Efficient Video Recognition11 May 2021
- 2021Anytime Dense Prediction with Confidence Adaptivity1 Apr 2021
- 2021E2CM: Early Exit via Class Means for Efficient Supervised and Unsupervised Learning1 Mar 2021
- 2021VA-RED2: Video Adaptive Redundancy Reduction15 Feb 2021
- 2021AdaFuse: Adaptive Temporal Fusion Network for Efficient Action Recognition10 Feb 2021
- 2021Dynamic Neural Networks: A Survey9 Feb 2021
- 2021Sparsely ensembled convolutional neural network classifiers via reinforcement learning7 Feb 2021
- 2024TESTAM: A Time-Enhanced Spatio-Temporal Attention Model with Mixture of Expertscited by 18
- 2022Spatial Mixture-of-Expertscited by 14
- 2023Revisiting Single-gated Mixtures of Expertscited by 10
- 2026cMoLLM at Scale: Horizontal Scaling Laws for Mixture-of-LLMscited by 0
- 2026Harnessing Domain Specialists in Multimodal Mixture-of-Experts for Efficient Adaptationcited by 0
- 2026Harnessing Domain Specialists in Multimodal Mixture-of-Experts for Efficient Adaptation1 Oct 2026
- 2026cMoLLM at Scale: Horizontal Scaling Laws for Mixture-of-LLMs6 Jun 2026
- 2024TESTAM: A Time-Enhanced Spatio-Temporal Attention Model with Mixture of Experts5 Mar 2024
- 2023Revisiting Single-gated Mixtures of Experts11 Apr 2023
- 2022Spatial Mixture-of-Experts24 Nov 2022
- 2021Dynamic Neural Networks: A Surveycited by 405
- 2021AdaFuse: Adaptive Temporal Fusion Network for Efficient Action Recognitioncited by 48
- 2021AdaMML: Adaptive Multi-Modal Learning for Efficient Video Recognitioncited by 36
- 2021Dynamic Network Quantization for Efficient Video Inferencecited by 36
- 2021Anytime Dense Prediction with Confidence Adaptivitycited by 18
- 2022Neural Networks are Decision Treescited by 16
- 2021VA-RED2: Video Adaptive Redundancy Reductioncited by 15
- 2023DynamicDet: A Unified Dynamic Architecture for Object Detectioncited by 15
- 2021E2CM: Early Exit via Class Means for Efficient Supervised and Unsupervised Learningcited by 8
- 2022Boosted Dynamic Neural Networkscited by 8
- 2023AsConvSR: Fast and Lightweight Super-Resolution Network with Assembled Convolutionscited by 8
- 2022A Survey of Neural Treescited by 7
12 most cited of 24 All 24 (JSON)
- 2025EgoAdapt: Adaptive Multisensory Distillation and Policy Learning for Efficient Egocentric Perception26 Jun 2025
- 2025Divide, Specialize, and Route: A New Approach to Efficient Ensemble Learning25 Jun 2025
- 2024Block-Operations: Using Modular Routing to Improve Compositional Generalization1 Aug 2024
- 2024Rule Based Learning with Dynamic (Graph) Neural Networks14 Jun 2024
- 2024Conditional Information Gain Trellis13 Feb 2024
- 2023ATESA-BAERT: A Heterogeneous Ensemble Learning Model for Aspect-Based Sentiment Analysis29 Jul 2023
- 2023AsConvSR: Fast and Lightweight Super-Resolution Network with Assembled Convolutions5 May 2023
- 2023DynamicDet: A Unified Dynamic Architecture for Object Detection12 Apr 2023
- 2023LEURN: Learning Explainable Univariate Rules with Neural Networks27 Mar 2023
- 2023Unifying Synergies between Self-supervised Learning and Dynamic Computation22 Jan 2023
- 2022Boosted Dynamic Neural Networks30 Nov 2022
- 2022Neural Routing in Meta Learning14 Oct 2022
12 newest of 24 All 24 (JSON)