mlsanityData to 14 Oct 2026

A Parameter-efficient Multi-subject Model for Predicting fMRI Activity

arXiv 2308.02351 ↗First posted 4 Aug 2023cs.CVcited by 2

Not on the map. Why?

Abstract (arXiv)

This is the Algonauts 2023 submission report for team "BlobGPT". Our model consists of a multi-subject linear encoding head attached to a pretrained trunk model. The multi-subject head consists of three components: (1) a shared multi-layer feature projection, (2) shared plus subject-specific low-dimension linear transformations, and (3) a shared PCA fMRI embedding. In this report, we explain these components in more detail and present some experimental results. Our code is available at https://github.com/cmi-dair/algonauts23.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 16 of its 23 references that are in the map. First posted on arXiv 4 Aug 2023.

Builds on

16 of 23 references.

References · 16

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  3. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  4. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
  5. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
  6. 2021BEiT: BERT Pre-Training of Image Transformerscited by 2,375
  7. 2016Xception: Deep Learning with Depthwise Separable Convolutionscited by 2,332
  8. 2021LAION-400M: Open Dataset of CLIP-Filtered 400 Million Image-Text Pairscited by 1,555
  9. 2022Reproducible scaling laws for contrastive language-image learningcited by 1,173
  10. 2022EVA: Exploring the Limits of Masked Visual Representation Learning at Scalecited by 691
  11. 2018BOHB: Robust and Efficient Hyperparameter Optimization at Scalecited by 470
  12. 2023EVA-02: A Visual Representation for Neon Genesiscited by 381
4 more
  1. 2022BEiT v2: Masked Image Modeling with Vector-Quantized Visual Tokenizerscited by 303
  2. 2022Three things everyone should know about Vision Transformerscited by 90
  3. 2023The Algonauts Project 2023 Challenge: How the Human Brain Makes Sense of Natural Scenescited by 36
  4. 2023Memory Encoding Modelcited by 7

Built on by

Cited by year

Citing papers per year: 2024: 2.

2 papers.

  1. 2024MindEye2: Shared-Subject Models Enable fMRI-To-Image With 1 Hour of Datacited by 109
  2. 2024Generalizability analysis of deep learning predictions of human brain responses to augmented and semantically novel visual stimulicited by 0