mlsanityData to 7 Oct 2026

Deep Learning: A Critical Appraisal

arXiv 1801.00631 ↗First posted 2 Jan 2018cs.AI cs.LG stat.MLcited by 214

Not on the map. Why?

Abstract (arXiv)

Although deep learning has historical roots going back decades, neither the term "deep learning" nor the approach was popular just over five years ago, when the field was reignited by papers such as Krizhevsky, Sutskever and Hinton's now classic (2012) deep network model of Imagenet. What has the field discovered in the five subsequent years? Against a background of considerable progress in areas such as speech recognition, image recognition, and game playing, and considerable enthusiasm in the popular press, I present ten concerns for deep learning, and suggest that deep learning must be supplemented by other techniques if we are to reach artificial general intelligence.

Key facts. Cited by 214 papers in the map (data through 7 Oct 2026). First posted on arXiv 2 Jan 2018.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2018: 1; 2019: 0; 2020: 0; 2021: 49; 2022: 50; 2023: 34; 2024: 20; 2025: 39; 2026: 21.

214 papers.

Sort:

By area:

  1. 2022PAL: Program-aided Language Modelscited by 635
  2. 2018Scalable agent alignment via reward modeling: a research directioncited by 438
  3. 2022GreaseLM: Graph REASoning Enhanced Language Models for Question Answeringcited by 170
  4. 2021Deep Stable Learning for Out-Of-Distribution Generalizationcited by 153
  5. 2022State-of-the-art generalisation research in NLP: A taxonomy and reviewcited by 97
  6. 2022Federated Learning Enables Big Data for Rare Cancer Boundary Detectioncited by 83
  7. 2022From Concept Drift to Model Degradation: An Overview on Performance-Aware Drift Detectorscited by 82
  8. 2021Encoding physics to learn reaction-diffusion processescited by 61
  9. 2021Visual Representation Learning Does Not Generalize Strongly Within the Same Domaincited by 60
  10. 2023Coupling Large Language Models with Logic Programming for Robust and General Reasoning from Textcited by 59
  11. 2021Inductive logic programming at 30cited by 46
  12. 2024Explainable Artificial Intelligence: A Survey of Needs, Techniques, Applications, and Future Directioncited by 46
38 more
  1. 2022Compositional Generalization in Unsupervised Compositional Representation Learning: A Study on Disentanglement and Emergent Languagecited by 42
  2. 2023Visual cognition in multimodal large language modelscited by 38
  3. 2021How I failed machine learning in medical imaging -- shortcomings and recommendationscited by 37
  4. 2022Is Neuro-Symbolic AI Meeting its Promise in Natural Language Processing? A Structured Reviewcited by 37
  5. 2022Towards Data-and Knowledge-Driven Artificial Intelligence: A Survey on Neuro-Symbolic Computingcited by 34
  6. 2023Brain-inspired Computational Intelligence via Predictive Codingcited by 30
  7. 2023Survey on Unsupervised Domain Adaptation for Semantic Segmentation for Visual Perception in Automated Drivingcited by 29
  8. 2023Logic-induced Diagnostic Reasoning for Semi-supervised Semantic Segmentationcited by 29
  9. 2021Lexicon Learning for Few-Shot Neural Sequence Modelingcited by 28
  10. 2022Symmetry-Based Representations for Artificial and Biological General Intelligencecited by 26
  11. 2022Landslide4Sense: Reference Benchmark Data and Deep Learning Models for Landslide Detectioncited by 26
  12. 2021GaNDLF: A Generally Nuanced Deep Learning Framework for Scalable End-to-End Clinical Workflows in Medical Imagingcited by 25
  13. 2021Hybrid FEM-NN models: Combining artificial neural networks with the finite element methodcited by 24
  14. 2021Symbolic Behaviour in Artificial Intelligencecited by 24
  15. 2021Learning First-Order Representations for Planning from Black-Box States: New Resultscited by 23
  16. 2021Neuro-Symbolic Hierarchical Rule Inductioncited by 23
  17. 2025VERIFY: A Benchmark of Visual Explanation and Reasoning for Investigating Multimodal Reasoning Fidelitycited by 23
  18. 2025Continuous Thought Machinescited by 21
  19. 2021Convolutional Neural Networks Are Not Invariant to Translation, but They Can Learn to Becited by 19
  20. 2021Differentiable Logic Machinescited by 18
  21. 2021Known Operator Learning and Hybrid Machine Learning in Medical Imaging -- A Review of the Past, the Present, and the Futurecited by 18
  22. 2023Can neural networks do arithmetic? A survey on the elementary numerical skills of state-of-the-art deep learning modelscited by 18
  23. 2023LOGICSEG: Parsing Visual Semantics with Neural Logic Learning and Reasoningcited by 17
  24. 2022Towards Domain Generalization in Object Detectioncited by 16
  25. 2021Applications of Generative Adversarial Networks in Anomaly Detection: A Systematic Literature Reviewcited by 15
  26. 2022Pan-tumor CAnine cuTaneous Cancer Histology (CATCH) datasetcited by 15
  27. 2022On the link between conscious function and general intelligence in humans and machinescited by 15
  28. 2023A Framework for Demonstrating Practical Quantum Advantage: Racing Quantum against Classical Generative Modelscited by 15
  29. 2024A Survey on Compositional Learning of AI Models: Theoretical and Experimental Practicescited by 15
  30. 2023Conformal inference is (almost) free for neural networks trained with early stoppingcited by 14
  31. 2021Distinguishing rule- and exemplar-based generalization in learning systemscited by 12
  32. 2022Neural-Symbolic Recursive Machine for Systematic Generalizationcited by 12
  33. 2025Strassen Attention, Split VC Dimension and Compositionality in Transformerscited by 12
  34. 2025The Serial Scaling Hypothesiscited by 11
  35. 2021Phy-Q as a measure for physical reasoning intelligencecited by 10
  36. 2021Learning Online Visual Invariances for Novel Objects via Supervised and Self-Supervised Trainingcited by 10
  37. 2022Induced Natural Language Rationales and Interleaved Markup Tokens Enable Extrapolation in Large Language Modelscited by 10
  38. 2022CDConv: A Benchmark for Contradiction Detection in Chinese Conversationscited by 10

50 most cited of 214 All 214 (JSON)