mlsanityData to 13 Oct 2026

Artificial Human Intelligence: The role of Humans in the Development of Next Generation AI

arXiv 2409.16001 ↗First posted 24 Sep 2024cs.AI q-bio.NCcited by 1

Not on the map. Why?

Abstract (arXiv)

Human intelligence, the most evident and accessible form of source of reasoning, hosted by biological hardware, has evolved and been refined over thousands of years, positioning itself today to create new artificial forms and preparing to self--design their evolutionary path forward. Beginning with the advent of foundation models, the rate at which human and artificial intelligence interact with each other has exceeded any anticipated quantitative figures. The close engagement led both bits of intelligence to be impacted in various ways, which naturally resulted in complex confluences that warrant close scrutiny. Recent advances, such as DeepSeek, exemplify this interplay: the novel contributions, we argue, draw indirect inspiration from biological principles like modular neural specialization and sparse episodic encoding, addressing computational bottlenecks while aligning with human-inspired scalability. In the sequel, using a novel taxonomy, we shall explore this interplay between human and machine intelligence, focusing on the crucial role humans play in developing ethical, responsible, and robust intelligent systems. We briefly delve into various aspects of implementation inspired by the mechanisms underlying neuroscience and human cognition. In addition, we propose future perspectives, capitalizing on the advantages of symbiotic designs to suggest a human-centered direction for next-generation developments, focusing on the augmentation role of AI. We finalize this evolving document with some thoughts and open questions yet to be addressed by the broader community.

Key facts. Cited by 1 paper in the map (data through 13 Oct 2026). Builds on 59 of its 188 references that are in the map. First posted on arXiv 24 Sep 2024.

Builds on

59 of 188 references.

References · 59

  1. 2017Attention Is All You Needcited by 60,106
  2. 2015Deep Residual Learning for Image Recognitioncited by 51,950
  3. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,588
  4. 2020Language Models are Few-Shot Learnerscited by 32,320
  5. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,043
  6. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,321
  7. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,072
  8. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,111
  9. 2016Overcoming catastrophic forgetting in neural networkscited by 4,753
  10. 2021On the Opportunities and Risks of Foundation Modelscited by 3,999
  11. 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,463
  12. 2019Benchmarking Neural Network Robustness to Common Corruptions and Perturbationscited by 2,862
38 more
  1. 2023Sparks of Artificial General Intelligence: Early experiments with GPT-4cited by 2,586
  2. 2016Matching Networks for One Shot Learningcited by 2,251
  3. 2019Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelismcited by 1,851
  4. 2018ImageNet-trained CNNs are biased towards texture; increasing shape bias improves accuracy and robustnesscited by 1,430
  5. 2017Visualizing the Loss Landscape of Neural Netscited by 1,129
  6. 2024DeepSeek-V2: A Strong, Economical, and Efficient Mixture-of-Experts Language Modelcited by 1,115
  7. 2016Generative Adversarial Text to Image Synthesiscited by 735
  8. 2021Do Vision Transformers See Like Convolutional Neural Networks?cited by 674
  9. 2020A Survey on Visual Transformercited by 654
  10. 2024KAN: Kolmogorov-Arnold Networkscited by 641
  11. 2017Understanding the Effective Receptive Field in Deep Convolutional Neural Networkscited by 551
  12. 2021Intriguing Properties of Vision Transformerscited by 446
  13. 2018Invertible Residual Networkscited by 364
  14. 2019On the Relationship between Self-Attention and Convolutional Layerscited by 300
  15. 2017Dilated Residual Networkscited by 294
  16. 2023A Survey on Self-supervised Learning: Algorithms, Applications, and Future Trendscited by 205
  17. 2019Universal Approximation with Deep Narrow Networkscited by 198
  18. 2020The Next Decade in AI: Four Steps Towards Robust Artificial Intelligencecited by 194
  19. 2016Deep Pyramidal Residual Networkscited by 163
  20. 2021Embodied Intelligence via Learning and Evolutioncited by 155
  21. 2024Who Validates the Validators? Aligning LLM-Assisted Evaluation of LLM Outputs with Human Preferencescited by 143
  22. 2023Large Language Models for Robotics: A Surveycited by 132
  23. 2021Towards artificial general intelligence via a multimodal foundation modelcited by 112
  24. 2021Are Convolutional Neural Networks or Transformers more like human vision?cited by 109
  25. 2018Assessing the Scalability of Biologically-Motivated Deep Learning Algorithms and Architecturescited by 101
  26. 2020Convolutional Neural Networks as a Model of the Visual System: Past, Present, and Futurecited by 83
  27. 2019Probabilistic Logic Neural Networks for Reasoningcited by 69
  28. 2015Towards Biologically Plausible Deep Learningcited by 66
  29. 2023Advances and Challenges in Meta-Learning: A Technical Reviewcited by 65
  30. 2022Harmonizing the object recognition strategies of deep neural networks with humanscited by 59
  31. 2017Regularizing Deep Neural Networks by Noise: Its Interpretation and Optimizationcited by 56
  32. 2023When Brain-inspired AI Meets AGIcited by 54
  33. 2020Towards Learning Convolutions from Scratchcited by 46
  34. 2016Bridging the Gaps Between Residual Learning, Recurrent Neural Networks and Visual Cortexcited by 42
  35. 2023π-Tuning: Transferring Multimodal Foundation Models with Optimal Multi-task Interpolationcited by 40
  36. 2022Can CNNs Be More Robust Than Transformers?cited by 38
  37. 2018Biologically-plausible learning algorithms can scale to large datasetscited by 37
  38. 2023ViT-Lens: Towards Omni-modal Representationscited by 29

50 most cited of 59 All 59 (JSON)

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.