mlsanityData to 7 Oct 2026

Brain-inspired Artificial Intelligence: A Comprehensive Review

arXiv 2408.14811 ↗First posted 27 Aug 2024cs.AIcited by 8

Not on the map. Why?

Abstract (arXiv)

Current artificial intelligence (AI) models often focus on enhancing performance through meticulous parameter tuning and optimization techniques. However, the fundamental design principles behind these models receive comparatively less attention, which can limit our understanding of their potential and constraints. This comprehensive review explores the diverse design inspirations that have shaped modern AI models, i.e., brain-inspired artificial intelligence (BIAI). We present a classification framework that categorizes BIAI approaches into physical structure-inspired and human behavior-inspired models. We also examine the real-world applications where different BIAI models excel, highlighting their practical benefits and deployment challenges. By delving into these areas, we provide new insights and propose future research directions to drive innovation and address current gaps in the field. This review offers researchers and practitioners a comprehensive overview of the BIAI landscape, helping them harness its potential and expedite advancements in AI development.

Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 59 of its 193 references that are in the map. First posted on arXiv 27 Aug 2024.

Builds on

59 of 193 references.

References · 59

  1. 2017Attention Is All You Needcited by 59,932
  2. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  3. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  4. 2023GPT-4 Technical Reportcited by 18,132
  5. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  6. 2022Generative Adversarial Networkscited by 5,603
  7. 2016Overcoming catastrophic forgetting in neural networkscited by 4,718
  8. 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,530
  9. 2023Mistral 7Bcited by 3,065
  10. 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,534
  11. 2014Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modelingcited by 2,341
  12. 2016Matching Networks for One Shot Learningcited by 2,246
38 more
  1. 2019A Survey on Bias and Fairness in Machine Learningcited by 1,911
  2. 2016Generative Adversarial Imitation Learningcited by 1,576
  3. 2019A Comprehensive Survey on Transfer Learningcited by 1,154
  4. 2024ChatGLM: A Family of Large Language Models from GLM-130B to GLM-4 All Toolscited by 1,096
  5. 2024How Far Are We to GPT-4V? Closing the Gap to Commercial Multimodal Models with Open-Source Suitescited by 1,033
  6. 2020Self-supervised Learning: Generative or Contrastivecited by 693
  7. 2017Dynamic Routing Between Capsulescited by 689
  8. 2020Image Segmentation Using Deep Learning: A Surveycited by 659
  9. 2021Recent Advances in Natural Language Processing via Large Pre-Trained Language Models: A Surveycited by 457
  10. 2023Generative Multimodal Models are In-Context Learnerscited by 446
  11. 2020A Survey of Convolutional Neural Networks: Analysis, Applications, and Prospectscited by 396
  12. 2021Graph Self-Supervised Learning: A Surveycited by 289
  13. 2020Going Deeper With Directly-Trained Larger Spiking Neural Networkscited by 268
  14. 2020Transfer Learning in Deep Reinforcement Learning: A Surveycited by 259
  15. 2018Deep Learning in Spiking Neural Networkscited by 258
  16. 2024MM1: Methods, Analysis & Insights from Multimodal LLM Pre-trainingcited by 230
  17. 2015A Critical Review of Recurrent Neural Networks for Sequence Learningcited by 223
  18. 2021Trustworthy AI: From Principles to Practicescited by 206
  19. 2021Self-Supervised Learning of Graph Neural Networks: A Unified Reviewcited by 184
  20. 2020Detecting Emergent Intersectional Biases: Contextualized Word Embeddings Contain a Distribution of Human-like Biasescited by 167
  21. 2022A Comprehensive Survey of Few-shot Learning: Evolution, Applications, Challenges, and Opportunitiescited by 162
  22. 2021Efficient Deep Learning: A Survey on Making Deep Learning Models Smaller, Faster, and Bettercited by 153
  23. 2023End-to-End Speech Recognition: A Surveycited by 127
  24. 2021Neural Machine Translation for Low-Resource Languages: A Surveycited by 108
  25. 2021Long-Short Transformer: Efficient Transformers for Language and Visioncited by 102
  26. 2022Self-Supervised Learning for Recommender Systems: A Surveycited by 95
  27. 2016Low Data Drug Discovery with One-shot Learningcited by 91
  28. 2020Artificial Intelligence in the Creative Industries: A Reviewcited by 61
  29. 2019M3ER: Multiplicative Multimodal Emotion Recognition Using Facial, Textual, and Speech Cuescited by 56
  30. 2021Advancing RNN Transducer Technology for Speech Recognitioncited by 44
  31. 2019Scalable Deep Learning on Distributed Infrastructures: Challenges, Techniques and Toolscited by 40
  32. 2019Real-Time Emotion Recognition via Attention Gated Hierarchical Memory Networkcited by 38
  33. 2021Do Humans Trust Advice More if it Comes from AI? An Analysis of Human-AI Interactionscited by 35
  34. 2019Cubic LSTMs for Video Predictioncited by 32
  35. 2017Born to Learn: the Inspiration, Progress, and Future of Evolved Plastic Artificial Neural Networkscited by 29
  36. 2024FairGT: A Fairness-aware Graph Transformercited by 29
  37. 2021Active Learning in Robotics: A Review of Control Principlescited by 26
  38. 2023Efficiently Forgetting What You Have Learned in Graph Representation Learning via Projectioncited by 20

50 most cited of 59 All 59 (JSON)

Built on by

Cited by year

Citing papers per year: 2025: 8.

8 papers.

  1. 2025A Survey of Context Engineering for Large Language Modelscited by 120
  2. 2025Thinking Beyond Tokens: From Brain-Inspired Intelligence to Cognitive Foundations for Artificial General Intelligence and its Societal Impactcited by 6
  3. 2025Rethinking Testing for LLM Applications: Characteristics, Challenges, and a Lightweight Interaction Protocolcited by 6
  4. 2025AttZoom: Attention Zoom for Better Visual Featurescited by 4
  5. 2025Refined Causal Graph Structure Learning via Curvature for Brain Disease Classificationcited by 2
  6. 2025Towards Neurocognitive-Inspired Intelligence: From AI's Structural Mimicry to Human-Like Functional Cognitioncited by 2
  7. 2025NeuroPathNet: Dynamic Path Trajectory Learning for Brain Functional Connectivity Analysiscited by 0
  8. 2025An Intelligent Multi-task Supply Chain Model Based on Bio-inspired Networkscited by 0