mlsanityData to 7 Oct 2026

Spark NLP: Natural Language Understanding at Scale

arXiv 2101.10848 ↗First posted 26 Jan 2021cs.CLcited by 16

Not on the map. Why?

Abstract (arXiv)

Spark NLP is a Natural Language Processing (NLP) library built on top of Apache Spark ML. It provides simple, performant and accurate NLP annotations for machine learning pipelines that can scale easily in a distributed environment. Spark NLP comes with 1100 pre trained pipelines and models in more than 192 languages. It supports nearly all the NLP tasks and modules that can be used seamlessly in a cluster. Downloaded more than 2.7 million times and experiencing nine times growth since January 2020, Spark NLP is used by 54% of healthcare organizations as the worlds most widely used NLP library in the enterprise.

Key facts. Cited by 16 papers in the map (data through 7 Oct 2026). Builds on 8 of its 23 references that are in the map. First posted on arXiv 26 Jan 2021.

Builds on

8 of 23 references.

References · 8

  1. 2019ScispaCy: Fast and Robust Models for Biomedical Natural Language Processingcited by 244
  2. 2015Named Entity Recognition with Bidirectional LSTM-CNNscited by 201
  3. 2020CORD-19: The COVID-19 Open Research Datasetcited by 179
  4. 2019A Survey on Recent Advances in Named Entity Recognition from Deep Learning modelscited by 117
  5. 2020Biomedical Named Entity Recognition at Scalecited by 30
  6. 2018Cross-type Biomedical Named Entity Recognition with Deep Multi-Task Learningcited by 28
  7. 2020Improving Clinical Document Understanding on COVID-19 Research with Spark NLPcited by 4
  8. 2020Biomedical and Clinical English Model Packages in the Stanza Python NLP Librarycited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 4; 2022: 2; 2023: 4; 2024: 1; 2025: 2; 2026: 3.

16 papers.

Sort:

  1. 2021MedPerf: Open Benchmarking Platform for Medical Artificial Intelligence using Federated Evaluationcited by 88
  2. 2021Deeper Clinical Document Understanding Using Relation Extractioncited by 7
  3. 2021Regularization for Long Named Entity Recognitioncited by 5
  4. 2024Large language models for newspaper sentiment analysis during COVID-19: The Guardiancited by 4
  5. 2021Large-Scale News Classification using BERT Language Model: Spark NLP Approachcited by 3
  6. 2023Beyond Accuracy: Automated De-Identification of Large Real-World Clinical Text Datasetscited by 3
  7. 2022Understanding COVID-19 News Coverage using Medical NLPcited by 2
  8. 2026Bridging the Domain Divide: Supervised vs. Zero-Shot Clinical Section Segmentation from MIMIC-III to Obstetricscited by 2
  9. 2023An Evaluation of Persian-English Machine Translation Datasets with Transformerscited by 1
  10. 2023Extraction of Medication and Temporal Relation from Clinical Text using Neural Language Modelscited by 1
  11. 2023KhabarChin: Automatic Detection of Important News in the Persian Languagecited by 1
  12. 2025Beyond Negation Detection: Comprehensive Assertion Detection Models for Clinical NLPcited by 1
4 more
  1. 2025Can Zero-Shot Commercial APIs Deliver Regulatory-Grade Clinical Text DeIdentification?cited by 1
  2. 2022A Biomedical Pipeline to Detect Clinical and Non-Clinical Named Entitiescited by 0
  3. 2026Implicit Framing in Obstetric Counseling Notes: A Grounded LLM Pipeline on a VBAC-Eligible Cohortcited by 0
  4. 2026Building Socio-Affective Artificial Intelligence for Interactive Multi-Agent Simulationscited by 0