BioSentVec: creating sentence embeddings for biomedical texts
Not on the map. Why?
Abstract (arXiv)
Sentence embeddings have become an essential part of today's natural language processing (NLP) systems, especially together advanced deep learning methods. Although pre-trained sentence encoders are available in the general domain, none exists for biomedical texts to date. In this work, we introduce BioSentVec: the first open set of sentence embeddings trained with over 30 million documents from both scholarly articles in PubMed and clinical notes in the MIMIC-III Clinical Database. We evaluate BioSentVec embeddings in two sentence pair similarity tasks in different text genres. Our benchmarking results demonstrate that the BioSentVec embeddings can better capture sentence semantics compared to the other competitive alternatives and achieve state-of-the-art performance in both tasks. We expect BioSentVec to facilitate the research and development in biomedical text mining and to complement the existing resources in biomedical word embeddings. BioSentVec is publicly available at https://github.com/ncbi-nlp/BioSentVec
Key facts. Cited by 47 papers in the map (data through 7 Oct 2026). First posted on arXiv 22 Oct 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 11; 2022: 12; 2023: 10; 2024: 7; 2025: 5; 2026: 2.
47 papers.
Sort:
- 2023MedCPT: Contrastive Pre-trained Transformers with Large-scale PubMed Search Logs for Zero-shot Biomedical Information Retrievalcited by 182
- 2021Pre-trained Language Models in Biomedical Domain: A Systematic Surveycited by 87
- 2023Benchmarking large language models for biomedical natural language processing applications and recommendationscited by 78
- 2021Automated Fact-Checking: A Surveycited by 55
- 2023Scientific Fact-Checking: A Survey of Resources and Approachescited by 53
- 2022Learning to Revise References for Faithful Summarizationcited by 28
- 2022Detailed Annotations of Chest X-Rays via CT Projection for Report Understandingcited by 24
- 2021Abstract, Rationale, Stance: A Joint Model for Scientific Claim Verificationcited by 20
- 2021CLIP: A Dataset for Extracting Action Items for Physicians from Hospital Discharge Notescited by 18
- 2025FinMTEB: Finance Massive Text Embedding Benchmarkcited by 18
- 2021Overview and Insights from the SciVer Shared Task on Scientific Claim Verificationcited by 17
- 2024Do We Need Domain-Specific Embedding Models? An Empirical Investigationcited by 12
35 more
- 2021Trust It or Not: Confidence-Guided Automatic Radiology Report Generationcited by 9
- 2023Bioformer: an efficient transformer language model for biomedical text miningcited by 9
- 2021Extracting Adverse Drug Events from Clinical Notescited by 7
- 2022How Can Graph Neural Networks Help Document Retrieval: A Case Study on CORD19 with Concept Map Generationcited by 7
- 2021QMUL-SDS at SCIVER: Step-by-Step Binary Classification for Scientific Claim Verificationcited by 6
- 2022Hardness-guided domain adaptation to recognise biomedical named entities under low-resource scenarioscited by 6
- 2022Automated Identification of Eviction Status from Electronic Health Record Notescited by 6
- 2023Zero-Shot Multi-Label Topic Inference with Sentence Encoderscited by 6
- 2024A Survey of Deep Learning-based Radiology Report Generation Using Multimodal Datacited by 6
- 2025The Next Phase of Scientific Fact-Checking: Advanced Evidence Retrieval from Complex Structured Academic Paperscited by 6
- 2022Using Bottleneck Adapters to Identify Cancer in Clinical Notes under Low-Resource Constraintscited by 5
- 2025PRISM: A Framework for Producing Interpretable Political Bias Embeddings with Political-Aware Cross-Encodercited by 5
- 2022Filter Drug-induced Liver Injury Literature with Natural Language Processing and Ensemble Learningcited by 4
- 2023Ascle: A Python Natural Language Processing Toolkit for Medical Text Generationcited by 3
- 2024SciGisPy: a Novel Metric for Biomedical Text Simplification via Gist Inference Scorecited by 3
- 2026EPPCMinerBen: A Novel Benchmark for Evaluating Large Language Models on Electronic Patient-Provider Communication via the Patient Portalcited by 3
- 2022Gender bias in (non)-contextual clinical word embeddings for stereotypical medical categoriescited by 2
- 2023Benchmarking and Analyzing In-context Learning, Fine-tuning and Supervised Learning for Biomedical Knowledge Curation: a focused study on chemical entities of biological interestcited by 2
- 2021EFloat: Entropy-coded Floating Point Format for Compressing Vector Embedding Modelscited by 1
- 2022An Automatic SOAP Classification System Using Weakly Supervision And Transfer Learningcited by 1
- 2022The effects of gender bias in word embeddings on depression predictioncited by 1
- 2023WellFactor: Patient Profiling using Integrative Embedding of Healthcare Datacited by 1
- 2024Health Text Simplification: An Annotated Corpus for Digestive Cancer Education and Novel Strategies for Reinforcement Learningcited by 1
- 2025Evaluating Causal Explanation in Medical Reports with LLM-Based and Human-Aligned Metricscited by 1
- 2021Semantic maps and metrics for science Semantic maps and metrics for science using deep transformer encoderscited by 0
- 2021Scope resolution of predicted negation cues: A two-step neural network-based approachcited by 0
- 2022A reproducible experimental survey on biomedical sentence similarity: a string-based method sets the state of the artcited by 0
- 2022MED-SE: Medical Entity Definition-based Sentence Embeddingcited by 0
- 2023Patient Clustering via Integrated Profiling of Clinical and Digital Datacited by 0
- 2023Screening of Pneumonia and Urinary Tract Infection at Triage using TriNetcited by 0
- 2024An Information Retrieval and Extraction Tool for Covid-19 Related Paperscited by 0
- 2024Tracing the Genealogies of Ideas with Large Language Model Embeddingscited by 0
- 2024BioBridge: Unified Bio-Embedding with Bridging Modality in Code-Switched EMRcited by 0
- 2025AI-Powered Detection of Inappropriate Language in Medical School Curriculacited by 0
- 2026BioHiCL: Hierarchical Multi-Label Contrastive Learning for Biomedical Retrieval with MeSH Labelscited by 0
- 2026BioHiCL: Hierarchical Multi-Label Contrastive Learning for Biomedical Retrieval with MeSH Labels17 Apr 2026
- 2026EPPCMinerBen: A Novel Benchmark for Evaluating Large Language Models on Electronic Patient-Provider Communication via the Patient Portal4 Feb 2026
- 2025AI-Powered Detection of Inappropriate Language in Medical School Curricula27 Aug 2025
- 2025The Next Phase of Scientific Fact-Checking: Advanced Evidence Retrieval from Complex Structured Academic Papers25 Jun 2025
- 2025Evaluating Causal Explanation in Medical Reports with LLM-Based and Human-Aligned Metrics23 Jun 2025
- 2025PRISM: A Framework for Producing Interpretable Political Bias Embeddings with Political-Aware Cross-Encoder30 May 2025
- 2025FinMTEB: Finance Massive Text Embedding Benchmark16 Feb 2025
- 2024BioBridge: Unified Bio-Embedding with Bridging Modality in Code-Switched EMR16 Dec 2024
- 2024SciGisPy: a Novel Metric for Biomedical Text Simplification via Gist Inference Score12 Oct 2024
- 2024Do We Need Domain-Specific Embedding Models? An Empirical Investigation27 Sep 2024
- 2024A Survey of Deep Learning-based Radiology Report Generation Using Multimodal Data21 May 2024
- 2024Health Text Simplification: An Annotated Corpus for Digestive Cancer Education and Novel Strategies for Reinforcement Learning26 Jan 2024
35 more
- 2024An Information Retrieval and Extraction Tool for Covid-19 Related Papers20 Jan 2024
- 2024Tracing the Genealogies of Ideas with Large Language Model Embeddings13 Jan 2024
- 2023WellFactor: Patient Profiling using Integrative Embedding of Healthcare Data21 Dec 2023
- 2023Benchmarking and Analyzing In-context Learning, Fine-tuning and Supervised Learning for Biomedical Knowledge Curation: a focused study on chemical entities of biological interest20 Dec 2023
- 2023Ascle: A Python Natural Language Processing Toolkit for Medical Text Generation28 Nov 2023
- 2023Screening of Pneumonia and Urinary Tract Infection at Triage using TriNet5 Sep 2023
- 2023Patient Clustering via Integrated Profiling of Clinical and Digital Data22 Aug 2023
- 2023MedCPT: Contrastive Pre-trained Transformers with Large-scale PubMed Search Logs for Zero-shot Biomedical Information Retrieval2 Jul 2023
- 2023Scientific Fact-Checking: A Survey of Resources and Approaches26 May 2023
- 2023Benchmarking large language models for biomedical natural language processing applications and recommendations10 May 2023
- 2023Zero-Shot Multi-Label Topic Inference with Sentence Encoders14 Apr 2023
- 2023Bioformer: an efficient transformer language model for biomedical text mining3 Feb 2023
- 2022The effects of gender bias in word embeddings on depression prediction15 Dec 2022
- 2022MED-SE: Medical Entity Definition-based Sentence Embedding9 Dec 2022
- 2022Automated Identification of Eviction Status from Electronic Health Record Notes6 Dec 2022
- 2022An Automatic SOAP Classification System Using Weakly Supervision And Transfer Learning26 Nov 2022
- 2022Hardness-guided domain adaptation to recognise biomedical named entities under low-resource scenarios11 Nov 2022
- 2022Using Bottleneck Adapters to Identify Cancer in Clinical Notes under Low-Resource Constraints17 Oct 2022
- 2022Detailed Annotations of Chest X-Rays via CT Projection for Report Understanding7 Oct 2022
- 2022Gender bias in (non)-contextual clinical word embeddings for stereotypical medical categories2 Aug 2022
- 2022A reproducible experimental survey on biomedical sentence similarity: a string-based method sets the state of the art18 May 2022
- 2022Learning to Revise References for Faithful Summarization13 Apr 2022
- 2022Filter Drug-induced Liver Injury Literature with Natural Language Processing and Ensemble Learning9 Mar 2022
- 2022How Can Graph Neural Networks Help Document Retrieval: A Case Study on CORD19 with Concept Map Generation12 Jan 2022
- 2021Pre-trained Language Models in Biomedical Domain: A Systematic Survey11 Oct 2021
- 2021Automated Fact-Checking: A Survey23 Sep 2021
- 2021Scope resolution of predicted negation cues: A two-step neural network-based approach15 Sep 2021
- 2021Abstract, Rationale, Stance: A Joint Model for Scientific Claim Verification13 Sep 2021
- 2021Overview and Insights from the SciVer Shared Task on Scientific Claim Verification17 Jul 2021
- 2021Trust It or Not: Confidence-Guided Automatic Radiology Report Generation21 Jun 2021
- 2021CLIP: A Dataset for Extracting Action Items for Physicians from Hospital Discharge Notes4 Jun 2021
- 2021QMUL-SDS at SCIVER: Step-by-Step Binary Classification for Scientific Claim Verification23 Apr 2021
- 2021Extracting Adverse Drug Events from Clinical Notes21 Apr 2021
- 2021Semantic maps and metrics for science Semantic maps and metrics for science using deep transformer encoders13 Apr 2021
- 2021EFloat: Entropy-coded Floating Point Format for Compressing Vector Embedding Models4 Feb 2021
- 2023MedCPT: Contrastive Pre-trained Transformers with Large-scale PubMed Search Logs for Zero-shot Biomedical Information Retrievalcited by 182
- 2021Pre-trained Language Models in Biomedical Domain: A Systematic Surveycited by 87
- 2023Benchmarking large language models for biomedical natural language processing applications and recommendationscited by 78
- 2021Automated Fact-Checking: A Surveycited by 55
- 2023Scientific Fact-Checking: A Survey of Resources and Approachescited by 53
- 2022Learning to Revise References for Faithful Summarizationcited by 28
- 2022Detailed Annotations of Chest X-Rays via CT Projection for Report Understandingcited by 24
- 2021Abstract, Rationale, Stance: A Joint Model for Scientific Claim Verificationcited by 20
- 2021CLIP: A Dataset for Extracting Action Items for Physicians from Hospital Discharge Notescited by 18
- 2025FinMTEB: Finance Massive Text Embedding Benchmarkcited by 18
- 2021Overview and Insights from the SciVer Shared Task on Scientific Claim Verificationcited by 17
- 2024Do We Need Domain-Specific Embedding Models? An Empirical Investigationcited by 12
12 most cited of 47 All 47 (JSON)
- 2026BioHiCL: Hierarchical Multi-Label Contrastive Learning for Biomedical Retrieval with MeSH Labels17 Apr 2026
- 2026EPPCMinerBen: A Novel Benchmark for Evaluating Large Language Models on Electronic Patient-Provider Communication via the Patient Portal4 Feb 2026
- 2025AI-Powered Detection of Inappropriate Language in Medical School Curricula27 Aug 2025
- 2025The Next Phase of Scientific Fact-Checking: Advanced Evidence Retrieval from Complex Structured Academic Papers25 Jun 2025
- 2025Evaluating Causal Explanation in Medical Reports with LLM-Based and Human-Aligned Metrics23 Jun 2025
- 2025PRISM: A Framework for Producing Interpretable Political Bias Embeddings with Political-Aware Cross-Encoder30 May 2025
- 2025FinMTEB: Finance Massive Text Embedding Benchmark16 Feb 2025
- 2024BioBridge: Unified Bio-Embedding with Bridging Modality in Code-Switched EMR16 Dec 2024
- 2024SciGisPy: a Novel Metric for Biomedical Text Simplification via Gist Inference Score12 Oct 2024
- 2024Do We Need Domain-Specific Embedding Models? An Empirical Investigation27 Sep 2024
- 2024A Survey of Deep Learning-based Radiology Report Generation Using Multimodal Data21 May 2024
- 2024Health Text Simplification: An Annotated Corpus for Digestive Cancer Education and Novel Strategies for Reinforcement Learning26 Jan 2024
12 newest of 47 All 47 (JSON)