AdaNet: Adaptive Structural Learning of Artificial Neural Networks
Not on the map. Why?
Abstract (arXiv)
We present new algorithms for adaptively learning artificial neural networks. Our algorithms (AdaNet) adaptively learn both the structure of the network and its weights. They are based on a solid theoretical analysis, including data-dependent generalization guarantees that we prove and discuss in detail. We report the results of large-scale experiments with one of our algorithms on several binary classification tasks extracted from the CIFAR-10 dataset. The results demonstrate that our algorithm can automatically learn network structures with very competitive performance accuracies when compared with those achieved for neural networks found by standard approaches.
Key facts. Cited by 54 papers in the map (data through 7 Oct 2026). First posted on arXiv 5 Jul 2016.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 20; 2022: 18; 2023: 2; 2024: 3; 2025: 9; 2026: 2.
54 papers.
Sort:
By area:
- 2021Ensemble deep learning: A reviewcited by 283
- 2022GAPartNet: Cross-Category Domain-Generalizable Object Perception and Manipulation via Generalizable and Actionable Partscited by 135
- 2022GradMax: Growing Neural Networks using Gradient Informationcited by 64
- 2024Neeko: Leveraging Dynamic LoRA for Efficient Multi-Character Role-Playing Agentcited by 52
- 2025FastCache: Fast Caching for Diffusion Transformer Through Learnable Linear Approximationcited by 23
- 2021Whither AutoML? Understanding the Role of Automation in Machine Learning Workflowscited by 22
- 2021Designing the Topology of Graph Neural Networks: A Novel Feature Fusion Perspectivecited by 19
- 2021Lifelong Teacher-Student Network Learningcited by 18
- 2021Lifelong Unsupervised Domain Adaptive Person Re-identification with Coordinated Anti-forgetting and Adaptationcited by 18
- 2022Winning solutions and post-challenge analyses of the ChaLearn AutoDL challenge 2019cited by 16
- 2025Balancing the Scales: A Theoretical and Algorithmic Framework for Learning from Imbalanced Datacited by 15
- 2021Lifelong Mixture of Variational Autoencoderscited by 10
38 more
- 2022AutoGPart: Intermediate Supervision Search for Generalizable 3D Part Segmentationcited by 10
- 2021Machine Learning for the Detection and Identification of Internet of Things (IoT) Devices: A Surveycited by 9
- 2021Continual Learning on the Edge with TensorFlow Litecited by 9
- 2021Does your graph need a confidence boost? Convergent boosted smoothing on graphs with tabular node featurescited by 9
- 2022Numerical Computation of Partial Differential Equations by Hidden-Layer Concatenated Extreme Learning Machinecited by 9
- 2025Improved Balanced Classification with Theoretically Grounded Loss Functionscited by 9
- 2022A Recursively Recurrent Neural Network (R2N2) Architecture for Learning Iterative Algorithmscited by 8
- 2022Boosted Dynamic Neural Networkscited by 8
- 2021Lifelong Infinite Mixture Model Based on Knowledge-Driven Dirichlet Processcited by 7
- 2021Neural Ensemble Search via Bayesian Samplingcited by 7
- 2021Towards continual task learning in artificial neural networks: current approaches and insights from neurosciencecited by 6
- 2022Task Selection for AutoML System Evaluationcited by 6
- 2024MobilityDL: A Review of Deep Learning From Trajectory Datacited by 6
- 2021Local Critic Training for Model-Parallel Learning of Deep Neural Networkscited by 5
- 2022Self-Activating Neural Ensembles for Continual Reinforcement Learningcited by 5
- 2021DOC3-Deep One Class Classification using Contradictionscited by 4
- 2024Continual Domain Adversarial Adaptation via Double-Head Discriminatorscited by 4
- 2025Random Feature Representation Boostingcited by 4
- 2022An Optimal Time Variable Learning Framework for Deep Neural Networkscited by 3
- 2022Learning an evolved mixture model for task-free continual learningcited by 3
- 2025Global Convergence of Continual Learning on Non-IID Datacited by 3
- 2021CUAB: Convolutional Uncertainty Attention Block Enhanced the Chest X-ray Image Analysiscited by 2
- 2022Towards Theoretical Analysis of Transformation Complexity of ReLU DNNscited by 2
- 2025Documenting Deployment with Fabric: A Repository of Real-World AI Governancecited by 2
- 2026Optimized Deferral for Imbalanced Settingscited by 2
- 2021Itsy Bitsy SpiderNet: Fully Connected Residual Network for Fraud Detectioncited by 1
- 2021Greedy UnMixing for Q-Learning in Multi-Agent Reinforcement Learningcited by 1
- 2021Reviewing continual learning from the perspective of human-level intelligencecited by 1
- 2022Meta-Learning of NAS for Few-shot Learning in Medical Image Applicationscited by 1
- 2022MDE for Machine Learning-Enabled Software Systems: A Case Study and Comparison of MontiAnna & ML-Quadratcited by 1
- 2022Review learning: Real world validation of privacy preserving continual learning across medical institutionscited by 1
- 2023SensLI: Sensitivity-Based Layer Insertion for Neural Networkscited by 1
- 2025Self-Controlled Dynamic Expansion Model for Continual Learningcited by 1
- 2021Targeted Deep Learning: Framework, Methods, and Applicationscited by 0
- 2021Proceedings of the First Workshop on Weakly Supervised Learning (WeaSuL)cited by 0
- 2022Look Closer to Your Enemy: Learning to Attack via Teacher-Student Mimickingcited by 0
- 2022A Survey of Open Source Automation Tools for Data Science Predictionscited by 0
- 2022CPMLHO:Hyperparameter Tuning via Cutting Plane and Mixed-Level Optimizationcited by 0
50 most cited of 54 All 54 (JSON)
- 2026Surrogate assisted diversity estimation in neural ensemble search29 Jul 2026
- 2026Optimized Deferral for Imbalanced Settings30 Apr 2026
- 2025Improved Balanced Classification with Theoretically Grounded Loss Functions30 Dec 2025
- 2025Documenting Deployment with Fabric: A Repository of Real-World AI Governance18 Aug 2025
- 2025FastCache: Fast Caching for Diffusion Transformer Through Learnable Linear Approximation26 May 2025
- 2025Out-of-Distribution Detection via Channelwise Feature Aggregation in Neural Network-Based Receivers21 May 2025
- 2025Self-Controlled Dynamic Expansion Model for Continual Learning14 Apr 2025
- 2025Global Convergence of Continual Learning on Non-IID Data24 Mar 2025
- 2025Balancing the Scales: A Theoretical and Algorithmic Framework for Learning from Imbalanced Data14 Feb 2025
- 2025Random Feature Representation Boosting30 Jan 2025
- 2025Incrementally Learning Multiple Diverse Data Domains via Multi-Source Dynamic Expansion Model15 Jan 2025
- 2024Neeko: Leveraging Dynamic LoRA for Efficient Multi-Character Role-Playing Agent21 Feb 2024
38 more
- 2024Continual Domain Adversarial Adaptation via Double-Head Discriminators5 Feb 2024
- 2024MobilityDL: A Review of Deep Learning From Trajectory Data1 Feb 2024
- 2023SensLI: Sensitivity-Based Layer Insertion for Neural Networks27 Nov 2023
- 2023Adaptive Neural Networks Using Residual Fitting13 Jan 2023
- 2022Self-Activating Neural Ensembles for Continual Reinforcement Learning31 Dec 2022
- 2022CPMLHO:Hyperparameter Tuning via Cutting Plane and Mixed-Level Optimization11 Dec 2022
- 2022Boosted Dynamic Neural Networks30 Nov 2022
- 2022A Recursively Recurrent Neural Network (R2N2) Architecture for Learning Iterative Algorithms22 Nov 2022
- 2022GAPartNet: Cross-Category Domain-Generalizable Object Perception and Manipulation via Generalizable and Actionable Parts10 Nov 2022
- 2022Review learning: Real world validation of privacy preserving continual learning across medical institutions17 Oct 2022
- 2022MDE for Machine Learning-Enabled Software Systems: A Case Study and Comparison of MontiAnna & ML-Quadrat15 Sep 2022
- 2022Task Selection for AutoML System Evaluation26 Aug 2022
- 2022A Survey of Open Source Automation Tools for Data Science Predictions24 Aug 2022
- 2022Look Closer to Your Enemy: Learning to Attack via Teacher-Student Mimicking27 Jul 2022
- 2022Learning an evolved mixture model for task-free continual learning11 Jul 2022
- 2022Towards Theoretical Analysis of Transformation Complexity of ReLU DNNs4 May 2022
- 2022Numerical Computation of Partial Differential Equations by Hidden-Layer Concatenated Extreme Learning Machine24 Apr 2022
- 2022An Optimal Time Variable Learning Framework for Deep Neural Networks18 Apr 2022
- 2022Meta-Learning of NAS for Few-shot Learning in Medical Image Applications16 Mar 2022
- 2022AutoGPart: Intermediate Supervision Search for Generalizable 3D Part Segmentation13 Mar 2022
- 2022GradMax: Growing Neural Networks using Gradient Information13 Jan 2022
- 2022Winning solutions and post-challenge analyses of the ChaLearn AutoDL challenge 201911 Jan 2022
- 2021Designing the Topology of Graph Neural Networks: A Novel Feature Fusion Perspective29 Dec 2021
- 2021Towards continual task learning in artificial neural networks: current approaches and insights from neuroscience28 Dec 2021
- 2021Lifelong Unsupervised Domain Adaptive Person Re-identification with Coordinated Anti-forgetting and Adaptation13 Dec 2021
- 2021Reviewing continual learning from the perspective of human-level intelligence23 Nov 2021
- 2021Does your graph need a confidence boost? Convergent boosted smoothing on graphs with tabular node features26 Oct 2021
- 2021Greedy UnMixing for Q-Learning in Multi-Agent Reinforcement Learning19 Sep 2021
- 2021Neural Ensemble Search via Bayesian Sampling6 Sep 2021
- 2021Lifelong Infinite Mixture Model Based on Knowledge-Driven Dirichlet Process25 Aug 2021
- 2021Lifelong Mixture of Variational Autoencoders9 Jul 2021
- 2021Lifelong Teacher-Student Network Learning9 Jul 2021
- 2021Proceedings of the First Workshop on Weakly Supervised Learning (WeaSuL)8 Jul 2021
- 2021Targeted Deep Learning: Framework, Methods, and Applications28 May 2021
- 2021Itsy Bitsy SpiderNet: Fully Connected Residual Network for Fraud Detection17 May 2021
- 2021DOC3-Deep One Class Classification using Contradictions17 May 2021
- 2021Continual Learning on the Edge with TensorFlow Lite5 May 2021
- 2021CUAB: Convolutional Uncertainty Attention Block Enhanced the Chest X-ray Image Analysis5 May 2021
50 newest of 54 All 54 (JSON)
- 2021Lifelong Mixture of Variational Autoencoderscited by 10
- 2021Lifelong Mixture of Variational Autoencoders9 Jul 2021
- 2021Ensemble deep learning: A reviewcited by 283
- 2022GAPartNet: Cross-Category Domain-Generalizable Object Perception and Manipulation via Generalizable and Actionable Partscited by 135
- 2022GradMax: Growing Neural Networks using Gradient Informationcited by 64
- 2021Whither AutoML? Understanding the Role of Automation in Machine Learning Workflowscited by 22
- 2021Designing the Topology of Graph Neural Networks: A Novel Feature Fusion Perspectivecited by 19
- 2021Lifelong Teacher-Student Network Learningcited by 18
- 2021Lifelong Unsupervised Domain Adaptive Person Re-identification with Coordinated Anti-forgetting and Adaptationcited by 18
- 2022Winning solutions and post-challenge analyses of the ChaLearn AutoDL challenge 2019cited by 16
- 2025Balancing the Scales: A Theoretical and Algorithmic Framework for Learning from Imbalanced Datacited by 15
- 2022AutoGPart: Intermediate Supervision Search for Generalizable 3D Part Segmentationcited by 10
- 2021Machine Learning for the Detection and Identification of Internet of Things (IoT) Devices: A Surveycited by 9
- 2021Continual Learning on the Edge with TensorFlow Litecited by 9
12 most cited of 51 All 51 (JSON)
- 2026Surrogate assisted diversity estimation in neural ensemble search29 Jul 2026
- 2026Optimized Deferral for Imbalanced Settings30 Apr 2026
- 2025Improved Balanced Classification with Theoretically Grounded Loss Functions30 Dec 2025
- 2025Documenting Deployment with Fabric: A Repository of Real-World AI Governance18 Aug 2025
- 2025Out-of-Distribution Detection via Channelwise Feature Aggregation in Neural Network-Based Receivers21 May 2025
- 2025Self-Controlled Dynamic Expansion Model for Continual Learning14 Apr 2025
- 2025Global Convergence of Continual Learning on Non-IID Data24 Mar 2025
- 2025Balancing the Scales: A Theoretical and Algorithmic Framework for Learning from Imbalanced Data14 Feb 2025
- 2025Random Feature Representation Boosting30 Jan 2025
- 2025Incrementally Learning Multiple Diverse Data Domains via Multi-Source Dynamic Expansion Model15 Jan 2025
- 2024Continual Domain Adversarial Adaptation via Double-Head Discriminators5 Feb 2024
- 2024MobilityDL: A Review of Deep Learning From Trajectory Data1 Feb 2024
12 newest of 51 All 51 (JSON)