mlsanityData to 14 Oct 2026

Shifting Attention to You: Personalized Brain-Inspired AI Models

arXiv 2502.04658 ↗First posted 7 Feb 2025q-bio.NC cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

The integration of human and artificial intelligence offers a powerful avenue for advancing our understanding of information processing, as each system provides unique computational insights. However, despite the promise of human-AI integration, current AI models are largely trained on massive datasets, optimized for population-level performance, lacking mechanisms to align their computations with individual users' perceptual semantics and neural dynamics. Here we show that integrating human behavioral insights and millisecond scale neural data within a fine tuned CLIP based model not only captures generalized and individualized aspects of perception but also over doubles behavioral performance compared to the unmodified CLIP baseline. By embedding human inductive biases and mirroring dynamic neural processes during training, personalized neural fine tuning improves predictions of human similarity judgments and tracks the temporal evolution of individual neural responses. Our work establishes a novel, interpretable framework for designing adaptive AI systems, with broad implications for neuroscience, personalized medicine, and human-computer interaction.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 22 of its 57 references that are in the map. First posted on arXiv 7 Feb 2025.

Builds on

22 of 57 references.

References · 22

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  3. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  4. 2017Towards A Rigorous Science of Interpretable Machine Learningcited by 1,416
  5. 2017Multimodal Machine Learning: A Survey and Taxonomycited by 1,013
  6. 2018RISE: Randomized Input Sampling for Explanation of Black-box Modelscited by 838
  7. 2024DoRA: Weight-Decomposed Low-Rank Adaptationcited by 758
  8. 2020Inductive Biases for Deep Learning of Higher-Level Cognitioncited by 275
  9. 2022Toward Next-Generation Artificial Intelligence: Catalyzing the NeuroAI Revolutioncited by 78
  10. 2022Human alignment of neural network representationscited by 74
  11. 2021Representation learning for neural population activity with Neural Data Transformerscited by 50
  12. 2022The neuroconnectionist research programmecited by 48
10 more
  1. 2023Improving neural network representations using human similarity judgmentscited by 38
  2. 2024Dimensions underlying the representational alignment of deep neural networks with humanscited by 22
  3. 2019Revealing interpretable object representations from human behaviorcited by 17
  4. 2016Decoding dynamic brain patterns from evoked responses: A tutorial on multivariate pattern analysis applied to time-series neuroimaging datacited by 9
  5. 2024Towards Neural Foundation Models for Vision: Aligning EEG, MEG, and fMRI Representations for Decoding, Encoding, and Modality Conversioncited by 9
  6. 2023The Universal Law of Generalization Holds for Naturalistic Stimulicited by 4
  7. 2024Achieving More Human Brain-Like Vision via Human EEG Representational Alignmentcited by 4
  8. 2021Do Invariances in Deep Neural Networks Align with Human Perception?cited by 2
  9. 2020Scale-specific dynamics of large-amplitude bursts in EEG capture behaviorally meaningful variabilitycited by 1
  10. 2023Computational limits to the legibility of the imaged human braincited by 1

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.