Analyzing the Performance of Multilayer Neural Networks for Object Recognition
Not on the map. Why?
Abstract (arXiv)
In the last two years, convolutional neural networks (CNNs) have achieved an impressive suite of results on standard recognition datasets and tasks. CNN-based features seem poised to quickly replace engineered representations, such as SIFT and HOG. However, compared to SIFT and HOG, we understand much less about the nature of the features learned by large CNNs. In this paper, we experimentally probe several aspects of CNN feature learning in an attempt to help practitioners gain useful, evidence-backed intuitions about how to apply CNNs to computer vision problems.
Key facts. Cited by 29 papers in the map (data through 7 Oct 2026). First posted on arXiv 7 Jul 2014.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 7; 2022: 10; 2023: 6; 2024: 3; 2025: 2; 2026: 1.
29 papers.
Sort:
- 2022Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference timecited by 1,366
- 2023Concept-based Explainable Artificial Intelligence: A Surveycited by 97
- 2023CLIPood: Generalizing CLIP to Out-of-Distributionscited by 96
- 2022Finding Skill Neurons in Pre-trained Transformer-based Language Modelscited by 65
- 2021OTCE: A Transferability Metric for Cross-Domain Cross-Task Representationscited by 62
- 2022Pro-tuning: Unified Prompt Tuning for Vision Taskscited by 53
- 2021Scalable Diverse Model Selection for Accessible Transfer Learningcited by 40
- 2021Self-Tuning for Data-Efficient Deep Learningcited by 39
- 2022Is a Caption Worth a Thousand Images? A Controlled Study for Representation Learningcited by 39
- 2021Zoo-Tuning: Adaptive Transfer from a Zoo of Modelscited by 35
- 2022Prompt-Matched Semantic Segmentationcited by 22
- 2022Knowledge Distillation as Efficient Pre-training: Faster Convergence, Higher Data-efficiency, and Better Transferabilitycited by 21
17 more
- 2021Hebbian Semi-Supervised Learning in a Sample Efficiency Settingcited by 19
- 2022Fine-Tuning Graph Neural Networks via Graph Topology induced Optimal Transportcited by 19
- 2022Deep transfer learning for image classification: a surveycited by 13
- 2025General Intelligence Requires Reward-based Pretrainingcited by 12
- 2023A Holistic Assessment of the Reliability of Machine Learning Systemscited by 9
- 2021DAP: Detection-Aware Pre-training with Weak Supervisioncited by 7
- 2023Synaptic Plasticity Models and Bio-Inspired Unsupervised Deep Learning: A Surveycited by 7
- 2022Hub-Pathway: Transfer Learning from A Hub of Pre-trained Modelscited by 5
- 2023Simple Transferability Estimation for Regression Taskscited by 5
- 2022Transfer Learning with Pre-trained Conditional Generative Modelscited by 4
- 2021Non-binary deep transfer learning for image classificationcited by 2
- 2024Semantically-correlated memories in a dense associative modelcited by 2
- 2024Adaptive Random Feature Regularization on Fine-tuning Deep Neural Networkscited by 1
- 2026Guiding Sparse Neural Networks with Neurobiological Principles to Elicit Biologically Plausible Representationscited by 1
- 2023EscherNet 101cited by 0
- 2024GTA: Guided Transfer of Spatial Attention from Object-Centric Representationscited by 0
- 2025Automatic Assessment of Students' Classroom Engagement with Bias Mitigated Multi-task Modelcited by 0
- 2026Guiding Sparse Neural Networks with Neurobiological Principles to Elicit Biologically Plausible Representations3 Mar 2026
- 2025Automatic Assessment of Students' Classroom Engagement with Bias Mitigated Multi-task Model24 Oct 2025
- 2025General Intelligence Requires Reward-based Pretraining26 Feb 2025
- 2024Semantically-correlated memories in a dense associative model10 Apr 2024
- 2024Adaptive Random Feature Regularization on Fine-tuning Deep Neural Networks15 Mar 2024
- 2024GTA: Guided Transfer of Spatial Attention from Object-Centric Representations5 Jan 2024
- 2023Concept-based Explainable Artificial Intelligence: A Survey20 Dec 2023
- 2023Simple Transferability Estimation for Regression Tasks1 Dec 2023
- 2023Synaptic Plasticity Models and Bio-Inspired Unsupervised Deep Learning: A Survey30 Jul 2023
- 2023A Holistic Assessment of the Reliability of Machine Learning Systems20 Jul 2023
- 2023EscherNet 1017 Mar 2023
- 2023CLIPood: Generalizing CLIP to Out-of-Distributions2 Feb 2023
17 more
- 2022Finding Skill Neurons in Pre-trained Transformer-based Language Models14 Nov 2022
- 2022Prompt-Matched Semantic Segmentation22 Aug 2022
- 2022Pro-tuning: Unified Prompt Tuning for Vision Tasks28 Jul 2022
- 2022Is a Caption Worth a Thousand Images? A Controlled Study for Representation Learning15 Jul 2022
- 2022Hub-Pathway: Transfer Learning from A Hub of Pre-trained Models8 Jun 2022
- 2022Deep transfer learning for image classification: a survey20 May 2022
- 2022Transfer Learning with Pre-trained Conditional Generative Models27 Apr 2022
- 2022Fine-Tuning Graph Neural Networks via Graph Topology induced Optimal Transport20 Mar 2022
- 2022Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference time10 Mar 2022
- 2022Knowledge Distillation as Efficient Pre-training: Faster Convergence, Higher Data-efficiency, and Better Transferability10 Mar 2022
- 2021Scalable Diverse Model Selection for Accessible Transfer Learning12 Nov 2021
- 2021Non-binary deep transfer learning for image classification19 Jul 2021
- 2021Zoo-Tuning: Adaptive Transfer from a Zoo of Models29 Jun 2021
- 2021DAP: Detection-Aware Pre-training with Weak Supervision30 Mar 2021
- 2021OTCE: A Transferability Metric for Cross-Domain Cross-Task Representations25 Mar 2021
- 2021Hebbian Semi-Supervised Learning in a Sample Efficiency Setting16 Mar 2021
- 2021Self-Tuning for Data-Efficient Deep Learning25 Feb 2021
- 2022Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference timecited by 1,366
- 2023Concept-based Explainable Artificial Intelligence: A Surveycited by 97
- 2023CLIPood: Generalizing CLIP to Out-of-Distributionscited by 96
- 2022Finding Skill Neurons in Pre-trained Transformer-based Language Modelscited by 65
- 2021OTCE: A Transferability Metric for Cross-Domain Cross-Task Representationscited by 62
- 2022Pro-tuning: Unified Prompt Tuning for Vision Taskscited by 53
- 2021Scalable Diverse Model Selection for Accessible Transfer Learningcited by 40
- 2021Self-Tuning for Data-Efficient Deep Learningcited by 39
- 2022Is a Caption Worth a Thousand Images? A Controlled Study for Representation Learningcited by 39
- 2021Zoo-Tuning: Adaptive Transfer from a Zoo of Modelscited by 35
- 2022Prompt-Matched Semantic Segmentationcited by 22
- 2022Knowledge Distillation as Efficient Pre-training: Faster Convergence, Higher Data-efficiency, and Better Transferabilitycited by 21
12 most cited of 29 All 29 (JSON)
- 2026Guiding Sparse Neural Networks with Neurobiological Principles to Elicit Biologically Plausible Representations3 Mar 2026
- 2025Automatic Assessment of Students' Classroom Engagement with Bias Mitigated Multi-task Model24 Oct 2025
- 2025General Intelligence Requires Reward-based Pretraining26 Feb 2025
- 2024Semantically-correlated memories in a dense associative model10 Apr 2024
- 2024Adaptive Random Feature Regularization on Fine-tuning Deep Neural Networks15 Mar 2024
- 2024GTA: Guided Transfer of Spatial Attention from Object-Centric Representations5 Jan 2024
- 2023Concept-based Explainable Artificial Intelligence: A Survey20 Dec 2023
- 2023Simple Transferability Estimation for Regression Tasks1 Dec 2023
- 2023Synaptic Plasticity Models and Bio-Inspired Unsupervised Deep Learning: A Survey30 Jul 2023
- 2023A Holistic Assessment of the Reliability of Machine Learning Systems20 Jul 2023
- 2023EscherNet 1017 Mar 2023
- 2023CLIPood: Generalizing CLIP to Out-of-Distributions2 Feb 2023
12 newest of 29 All 29 (JSON)