mlsanityData to 14 Oct 2026

Ten Years after ImageNet: A 360deg Perspective on AI

arXiv 2210.01797 ↗First posted 1 Oct 2022cs.LG cs.AI cs.IRcited by 0

Not on the map. Why?

Abstract (arXiv)

It is ten years since neural networks made their spectacular comeback. Prompted by this anniversary, we take a holistic perspective on Artificial Intelligence (AI). Supervised Learning for cognitive tasks is effectively solved - provided we have enough high-quality labeled data. However, deep neural network models are not easily interpretable, and thus the debate between blackbox and whitebox modeling has come to the fore. The rise of attention networks, self-supervised learning, generative modeling, and graph neural networks has widened the application space of AI. Deep Learning has also propelled the return of reinforcement learning as a core building block of autonomous decision making systems. The possible harms made possible by new AI technologies have raised socio-technical issues such as transparency, fairness, and accountability. The dominance of AI by Big-Tech who control talent, computing resources, and most importantly, data may lead to an extreme AI divide. Failure to meet high expectations in high profile, and much heralded flagship projects like self-driving vehicles could trigger another AI winter.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 21 of its 47 references that are in the map. First posted on arXiv 1 Oct 2022.

Builds on

21 of 47 references.

References · 21

  1. 2017Attention Is All You Needcited by 60,361
  2. 2020Language Models are Few-Shot Learnerscited by 32,419
  3. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
  4. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
  5. 2022Generative Adversarial Networkscited by 5,627
  6. 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,548
  7. 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,375
  8. 2013Auto-Encoding Variational Bayescited by 4,053
  9. 2017Neural Message Passing for Quantum Chemistrycited by 3,487
  10. 2016Membership Inference Attacks against Machine Learning Modelscited by 2,281
  11. 2020Offline Reinforcement Learning: Tutorial, Review, and Perspectives on Open Problemscited by 1,920
  12. 2016Variational Inference: A Review for Statisticianscited by 1,472
9 more
  1. 2017Targeted Backdoor Attacks on Deep Learning Systems Using Data Poisoningcited by 1,055
  2. 2018Reconciling modern machine learning practice and the bias-variance trade-offcited by 927
  3. 2015Automatic differentiation in machine learning: a surveycited by 855
  4. 2019Deep Double Descent: Where Bigger Models and More Data Hurtcited by 672
  5. 2020Reinforcement Learning for Combinatorial Optimization: A Surveycited by 236
  6. 2018RoadTracer: Automatic Extraction of Road Networks from Aerial Imagescited by 102
  7. 2017Thinking Fast and Slow: Optimization Decomposition Across Timescalescited by 60
  8. 2022Testing Relational Understanding in Text-Guided Image Generationcited by 59
  9. 2018The age of secrecy and unfairness in recidivism predictioncited by 53

Built on by

Not cited yet.