mlsanityData to 7 Oct 2026

NDAI-NeuroMAP: A Neuroscience-Specific Embedding Model for Domain-Specific Retrieval

arXiv 2507.03329 ↗First posted 4 Jul 2025cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

We present NDAI-NeuroMAP, the first neuroscience-domain-specific dense vector embedding model engineered for high-precision information retrieval tasks. Our methodology encompasses the curation of an extensive domain-specific training corpus comprising 500,000 carefully constructed triplets (query-positive-negative configurations), augmented with 250,000 neuroscience-specific definitional entries and 250,000 structured knowledge-graph triplets derived from authoritative neurological ontologies. We employ a sophisticated fine-tuning approach utilizing the FremyCompany/BioLORD-2023 foundation model, implementing a multi-objective optimization framework combining contrastive learning with triplet-based metric learning paradigms. Comprehensive evaluation on a held-out test dataset comprising approximately 24,000 neuroscience-specific queries demonstrates substantial performance improvements over state-of-the-art general-purpose and biomedical embedding models. These empirical findings underscore the critical importance of domain-specific embedding architectures for neuroscience-oriented RAG systems and related clinical natural language processing applications.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 17 of its 30 references that are in the map. First posted on arXiv 4 Jul 2025.

Builds on

17 of 30 references.

References · 17

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  3. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  4. 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 4,993
  5. 2016Overcoming catastrophic forgetting in neural networkscited by 4,718
  6. 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,346
  7. 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,243
  8. 2023Qwen Technical Reportcited by 3,273
  9. 2019BioBERT: a pre-trained biomedical language representation model for biomedical text miningcited by 1,935
  10. 2019SciBERT: A Pretrained Language Model for Scientific Textcited by 1,404
  11. 2017Mixed Precision Trainingcited by 1,135
  12. 2024M3-Embedding: Multi-Linguality, Multi-Functionality, Multi-Granularity Text Embeddings Through Self-Knowledge Distillationcited by 1,050
5 more
  1. 2019Publicly Available Clinical BERT Embeddingscited by 995
  2. 2016Training Deep Nets with Sublinear Memory Costcited by 825
  3. 2023Towards General Text Embeddings with Multi-stage Contrastive Learningcited by 705
  4. 2022Text and Code Embeddings by Contrastive Pre-Trainingcited by 358
  5. 2024Jasper and Stella: distillation of SOTA embedding modelscited by 109

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Self-Aware Vector Embeddings for Retrieval-Augmented Generation: A Neuroscience-Inspired Framework for Temporal, Confidence-Weighted, and Relational Knowledge
  2. 2026Margin-Regularized Structured Semantic Alignment for Brain-Language Correspondence
  3. 2025Building Models of Neurological Language
  4. 2025NeuroPath: Neurobiology-Inspired Path Tracking and Reflection for Semantically Coherent Retrieval
  5. 2024HippoRAG: Neurobiologically Inspired Long-Term Memory for Large Language Models
  6. 2024Matching domain experts by training from scratch on domain knowledge
  7. 2025MedEIR: A Specialized Medical Embedding Model for Enhanced Information Retrieval
  8. 2026Neurosymbolic Retrievers for Retrieval-augmented Generation