mlsanityData to 7 Oct 2026

Dive into Deep Learning

arXiv 2106.11342 ↗First posted 21 Jun 2021cs.LG cs.AI cs.CLcited by 111

Not on the map. Why?

Abstract (arXiv)

This open-source book represents our attempt to make deep learning approachable, teaching readers the concepts, the context, and the code. The entire book is drafted in Jupyter notebooks, seamlessly integrating exposition figures, math, and interactive examples with self-contained code. Our goal is to offer a resource that could (i) be freely available for everyone; (ii) offer sufficient technical depth to provide a starting point on the path to actually becoming an applied machine learning scientist; (iii) include runnable code, showing readers how to solve problems in practice; (iv) allow for rapid updates, both by us and also by the community at large; (v) be complemented by a forum for interactive discussion of technical details and to answer questions.

Key facts. Cited by 111 papers in the map (data through 7 Oct 2026). Builds on 60 of its 187 references that are in the map. First posted on arXiv 21 Jun 2021.

Builds on

60 of 187 references.

References · 60

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  4. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  5. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
  6. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  7. 2017Mask R-CNNcited by 7,259
  8. 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 6,979
  9. 2016Densely Connected Convolutional Networkscited by 6,691
  10. 2015Rethinking the Inception Architecture for Computer Visioncited by 5,451
  11. 2014Fully Convolutional Networks for Semantic Segmentationcited by 4,845
  12. 2017Squeeze-and-Excitation Networkscited by 4,763
38 more
  1. 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,530
  2. 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,346
  3. 2017Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithmscited by 4,283
  4. 2014Going Deeper with Convolutionscited by 4,231
  5. 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,016
  6. 2015Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classificationcited by 3,590
  7. 2013Distributed Representations of Words and Phrases and their Compositionalitycited by 3,462
  8. 2016Gaussian Error Linear Units (GELUs)cited by 3,431
  9. 2015SSD: Single Shot MultiBox Detectorcited by 3,125
  10. 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,967
  11. 2015Fast R-CNNcited by 2,930
  12. 2015Neural Machine Translation of Rare Words with Subword Unitscited by 2,898
  13. 2021Convex optimizationcited by 2,479
  14. 2014Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modelingcited by 2,341
  15. 2013Rich feature hierarchies for accurate object detection and semantic segmentationcited by 2,160
  16. 2015Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networkscited by 2,048
  17. 2016Identity Mappings in Deep Residual Networkscited by 1,960
  18. 2016Enriching Word Vectors with Subword Informationcited by 1,578
  19. 2016Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learningcited by 1,509
  20. 2016Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translationcited by 1,471
  21. 2014On the Properties of Neural Machine Translation: Encoder-Decoder Approachescited by 1,303
  22. 2018Averaging Weights Leads to Wider Optima and Better Generalizationcited by 1,194
  23. 2014Convolutional Neural Networks for Sentence Classificationcited by 1,124
  24. 2017Neural Collaborative Filteringcited by 1,108
  25. 2017SemEval-2017 Task 1: Semantic Textual Similarity - Multilingual and Cross-lingual Focused Evaluationcited by 998
  26. 2018Neural Network Acceptability Judgmentscited by 952
  27. 2019On the Convergence of Adam and Beyondcited by 834
  28. 2017Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networkscited by 707
  29. 2017DeepFM: A Factorization-Machine based Neural Network for CTR Predictioncited by 673
  30. 2017In-Datacenter Performance Analysis of a Tensor Processing Unitcited by 610
  31. 2013Generating Sequences With Recurrent Neural Networkscited by 549
  32. 2018Object Detection with Deep Learning: A Reviewcited by 524
  33. 2018Personalized Top-N Sequential Recommendation via Convolutional Sequence Embeddingcited by 473
  34. 2018How Does Batch Normalization Help Optimization?cited by 355
  35. 2017A Structured Self-attentive Sentence Embeddingcited by 318
  36. 2016A guide to convolution arithmetic for deep learningcited by 182
  37. 2018Dynamical Isometry and a Mean Field Theory of CNNs: How to Train 10,000-Layer Vanilla Convolutional Neural Networkscited by 176
  38. 2018A Closer Look at Deep Learning Heuristics: Learning rate restarts, Warmup and Distillationcited by 110

50 most cited of 60 All 60 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 14; 2022: 29; 2023: 28; 2024: 23; 2025: 11; 2026: 6.

111 papers.

Sort:

By area:

  1. 2022Transformers learn in-context by gradient descentcited by 714
  2. 2023Is ChatGPT a General-Purpose Natural Language Processing Task Solver?cited by 486
  3. 2023Revisiting Out-of-distribution Robustness in NLP: Benchmark, Analysis, and LLMs Evaluationscited by 96
  4. 2023When Deep Learning Meets Polyhedral Theory: A Surveycited by 39
  5. 2021How to avoid machine learning pitfalls: a guide for academic researcherscited by 34
  6. 2021Generalized Huber Loss for Robust Learning and its Efficient Minimization for a Robust Statisticscited by 32
  7. 2024Applied Causal Inference Powered by ML and AIcited by 30
  8. 2024Dynamic Tuning Towards Parameter and Inference Efficiency for ViT Adaptationcited by 25
  9. 2024HashAttention: Semantic Sparsity for Faster Inferencecited by 23
  10. 2021DeepSTL -- From English Requirements to Signal Temporal Logiccited by 22
  11. 2022Theoretical Perspectives on Deep Learning Methods in Inverse Problemscited by 22
  12. 2023Evaluating ChatGPT as a Recommender System: A Rigorous Approachcited by 20
38 more
  1. 2024LOLA: LLM-Assisted Online Learning Algorithm for Content Experimentscited by 18
  2. 2022Attention-based Random Forest and Contamination Modelcited by 10
  3. 2025Hidden Dynamics of Massive Activations in Transformer Trainingcited by 10
  4. 2024Token Statistics Transformer: Linear-Time Attention via Variational Rate Reductioncited by 9
  5. 2026UEval: A Benchmark for Unified Multimodal Generationcited by 9
  6. 2022PatchGT: Transformer over Non-trainable Clusters for Learning Graph Representationscited by 8
  7. 2023Towards Single Camera Human 3D-Kinematicscited by 8
  8. 2023HalluciDet: Hallucinating RGB Modality for Person Detection Through Privileged Informationcited by 8
  9. 2022Phenomenological Causalitycited by 7
  10. 2023DeepSI: Interactive Deep Learning for Semantic Interactioncited by 7
  11. 2021Multi-Attention Multiple Instance Learningcited by 6
  12. 2021Emergency Vehicles Audio Detection and Localization in Autonomous Drivingcited by 5
  13. 2022AGBoost: Attention-based Modification of Gradient Boosting Machinecited by 5
  14. 2022textitFastSVD-ML-ROM: A Reduced-Order Modeling Framework based on Machine Learning for Real-Time Applicationscited by 5
  15. 2022A Continuous Convolutional Trainable Filter for Modelling Unstructured Datacited by 5
  16. 2023The Deep Promotion Time Cure Modelcited by 5
  17. 2022The 1st Data Science for Pavements Challengecited by 4
  18. 2022Attention and Self-Attention in Random Forestscited by 4
  19. 2022Heterogeneous Treatment Effect with Trained Kernels of the Nadaraya-Watson Regressioncited by 4
  20. 2023Temporal Conditioning Spiking Latent Variable Models of the Neural Response to Natural Visual Scenescited by 4
  21. 2023How to Handle Different Types of Out-of-Distribution Scenarios in Computational Argumentation? A Comprehensive and Fine-Grained Field Studycited by 4
  22. 2024Modality Translation for Object Detection Adaptation Without Forgetting Prior Knowledgecited by 4
  23. 2025RAMS: Residual-based adversarial-gradient moving sample method for scientific machine learning in solving partial differential equationscited by 4
  24. 2021Attention-like feature explanation for tabular datacited by 3
  25. 2021A fast asynchronous MCMC sampler for sparse Bayesian inferencecited by 3
  26. 2021A deep learning driven pseudospectral PCE based FFT homogenization algorithm for complex microstructurescited by 3
  27. 2023TPMCF: Temporal QoS Prediction using Multi-Source Collaborative Featurescited by 3
  28. 2024Explaining in Diffusion: Explaining a Classifier Through Hierarchical Semantics with Text-to-Image Diffusion Modelscited by 3
  29. 2021Generalized Unsupervised Clustering of Hyperspectral Images of Geological Targets in the Near Infraredcited by 2
  30. 2021EmTract: Extracting Emotions from Social Mediacited by 2
  31. 2021Rank4Class: A Ranking Formulation for Multiclass Classificationcited by 2
  32. 2022Two-Stage Fine-Tuning: A Novel Strategy for Learning Class-Imbalanced Datacited by 2
  33. 2022Improved Anomaly Detection by Using the Attention-Based Isolation Forestcited by 2
  34. 2022ViT-LSLA: Vision Transformer with Light Self-Limited-Attentioncited by 2
  35. 2023ganX -- generate artificially new XRF a python library to generate MA-XRF raw data out of RGB imagescited by 2
  36. 2023Predicting small molecules solubilities on endpoint devices using deep ensemble neural networkscited by 2
  37. 2023PrNet: A Neural Network for Correcting Pseudoranges to Improve Positioning with Android Raw GNSS Measurementscited by 2
  38. 2023Unsupervised Pre-Training for Vietnamese Automatic Speech Recognition in the HYKIST Projectcited by 2

50 most cited of 111 All 111 (JSON)