NDAI-NeuroMAP: A Neuroscience-Specific Embedding Model for Domain-Specific Retrieval
Not on the map. Why?
Abstract (arXiv)
We present NDAI-NeuroMAP, the first neuroscience-domain-specific dense vector embedding model engineered for high-precision information retrieval tasks. Our methodology encompasses the curation of an extensive domain-specific training corpus comprising 500,000 carefully constructed triplets (query-positive-negative configurations), augmented with 250,000 neuroscience-specific definitional entries and 250,000 structured knowledge-graph triplets derived from authoritative neurological ontologies. We employ a sophisticated fine-tuning approach utilizing the FremyCompany/BioLORD-2023 foundation model, implementing a multi-objective optimization framework combining contrastive learning with triplet-based metric learning paradigms. Comprehensive evaluation on a held-out test dataset comprising approximately 24,000 neuroscience-specific queries demonstrates substantial performance improvements over state-of-the-art general-purpose and biomedical embedding models. These empirical findings underscore the critical importance of domain-specific embedding architectures for neuroscience-oriented RAG systems and related clinical natural language processing applications.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 17 of its 30 references that are in the map. First posted on arXiv 4 Jul 2025.
Builds on
17 of 30 references.
References · 17
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 4,993
- 2016Overcoming catastrophic forgetting in neural networkscited by 4,718
- 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,346
- 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,243
- 2023Qwen Technical Reportcited by 3,273
- 2019BioBERT: a pre-trained biomedical language representation model for biomedical text miningcited by 1,935
- 2019SciBERT: A Pretrained Language Model for Scientific Textcited by 1,404
- 2017Mixed Precision Trainingcited by 1,135
- 2024M3-Embedding: Multi-Linguality, Multi-Functionality, Multi-Granularity Text Embeddings Through Self-Knowledge Distillationcited by 1,050
5 more
- 2019Publicly Available Clinical BERT Embeddingscited by 995
- 2016Training Deep Nets with Sublinear Memory Costcited by 825
- 2023Towards General Text Embeddings with Multi-stage Contrastive Learningcited by 705
- 2022Text and Code Embeddings by Contrastive Pre-Trainingcited by 358
- 2024Jasper and Stella: distillation of SOTA embedding modelscited by 109
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Self-Aware Vector Embeddings for Retrieval-Augmented Generation: A Neuroscience-Inspired Framework for Temporal, Confidence-Weighted, and Relational Knowledge
- 2026Margin-Regularized Structured Semantic Alignment for Brain-Language Correspondence
- 2025Building Models of Neurological Language
- 2025NeuroPath: Neurobiology-Inspired Path Tracking and Reflection for Semantically Coherent Retrieval
- 2024HippoRAG: Neurobiologically Inspired Long-Term Memory for Large Language Models
- 2024Matching domain experts by training from scratch on domain knowledge
- 2025MedEIR: A Specialized Medical Embedding Model for Enhanced Information Retrieval
- 2026Neurosymbolic Retrievers for Retrieval-augmented Generation