PySBD: Pragmatic Sentence Boundary Disambiguation
Not on the map. Why?
Abstract (arXiv)
In this paper, we present a rule-based sentence boundary disambiguation Python package that works out-of-the-box for 22 languages. We aim to provide a realistic segmenter which can provide logical sentences even when the format and domain of the input text is unknown. In our work, we adapt the Golden Rules Set (a language-specific set of sentence boundary exemplars) originally implemented as a ruby gem - pragmatic_segmenter - which we ported to Python with additional improvements and functionality. PySBD passes 97.92% of the Golden Rule Set exemplars for English, an improvement of 25% over the next best open-source Python tool.
Key facts. Cited by 38 papers in the map (data through 7 Oct 2026). First posted on arXiv 19 Oct 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 1; 2022: 3; 2023: 10; 2024: 12; 2025: 8; 2026: 4.
38 papers.
Sort:
By area:
- 2022Making Science Simple: Corpora for the Lay Summarisation of Scientific Literaturecited by 54
- 2024Segment Any Text: A Universal Approach for Robust, Efficient and Adaptable Sentence Segmentationcited by 41
- 2021VILA: Improving Structured Content Extraction from Scientific PDFs Using Visual Layout Groupscited by 27
- 2023ParaGuide: Guided Diffusion Paraphrasers for Plug-and-Play Textual Style Transfercited by 18
- 2023Where's the Point? Self-Supervised Multilingual Punctuation-Agnostic Sentence Segmentationcited by 17
- 2025High-Fidelity Simultaneous Speech-To-Speech Translationcited by 15
- 2023The MuSe 2023 Multimodal Sentiment Analysis Challenge: Mimicked Emotions, Cross-Cultural Humour, and Personalisationcited by 12
- 2024SciNews: From Scholarly Complexities to Public Narratives -- A Dataset for Scientific News Report Generationcited by 12
- 2022Using Multiple Instance Learning to Build Multimodal Representationscited by 7
- 2025MEMERAG: A Multilingual End-to-End Meta-Evaluation Benchmark for Retrieval Augmented Generationcited by 7
- 2023Glitter or Gold? Deriving Structured Insights from Sustainability Reports via Large Language Modelscited by 6
- 2025Zero-knowledge LLM hallucination detection and mitigation through fine-grained cross-model consistencycited by 6
26 more
- 2024Beyond Film Subtitles: Is YouTube the Best Approximation of Spoken Vocabulary?cited by 5
- 2024Modeling Emotional Trajectories in Written Stories Utilizing Transformers and Weakly-Supervised Learningcited by 4
- 2024The MuSe 2024 Multimodal Sentiment Analysis Challenge: Social Perception and Humor Recognitioncited by 3
- 2024uMedSum: A Unified Framework for Advancing Medical Abstractive Summarizationcited by 3
- 2023WikiSQE: A Large-Scale Dataset for Sentence Quality Estimation in Wikipediacited by 2
- 2023Cross-Lingual Knowledge Distillation for Answer Sentence Selection in Low-Resource Languagescited by 2
- 2024WikiSplit++: Easy Data Refinement for Split and Rephrasecited by 2
- 2024Topic Modeling with Fine-tuning LLMs and Bag of Sentencescited by 2
- 2023Efficient and Flexible Topic Modeling using Pretrained Embeddings and Bag of Sentencescited by 1
- 2023Sample-Specific Debiasing for Better Image-Text Modelscited by 1
- 2024WiDe-analysis: Enabling One-click Content Moderation Analysis on Wikipedia's Articles for Deletioncited by 1
- 2025DOLFIN -- Document-Level Financial test set for Machine Translationcited by 1
- 2025Precise Legal Sentence Boundary Detection for Retrieval at Scale: NUPunkt and CharBoundarycited by 1
- 2025OpenWHO: A Document-Level Parallel Corpus for Health Translation in Low-Resource Languagescited by 1
- 2026Arabic Sentence Segmentation Across Genres and Punctuation Conditionscited by 1
- 2026Difficulty-Adaptive Tree-Structured Policy Optimization for Expanding Reasoning Coverage in RLVRcited by 1
- 2022A Natural Language Processing Pipeline for Detecting Informal Data References in Academic Literaturecited by 0
- 2023CiteCaseLAW: Citation Worthiness Detection in Caselaw for Legal Assistive Writingcited by 0
- 2023Executive Voiced Laughter and Social Approval: An Explorative Machine Learning Studycited by 0
- 2024Semantic Scaling: Bayesian Ideal Point Estimates with Large Language Modelscited by 0
- 2024This Paper Had the Smartest Reviewers -- Flattery Detection Utilising an Audio-Textual Transformer-Based Approachcited by 0
- 2024Domain-specific long text classification from sparse relevant informationcited by 0
- 2025Divide (Text) and Conquer (Sentiment): Improved Sentiment Classification by Constituent Conflict Resolutioncited by 0
- 2025ChunkLLM: A Lightweight Pluggable Framework for Accelerating LLMs Inferencecited by 0
- 2026EMBL AI Librarian: Life-Sciences Knowledge Layer for AI Agentscited by 0
- 2026TranslatePsy-AfriSLM: High-Quality Data Scaling For Low-Resource Machine Translationcited by 0
- 2026Difficulty-Adaptive Tree-Structured Policy Optimization for Expanding Reasoning Coverage in RLVR8 Sep 2026
- 2026TranslatePsy-AfriSLM: High-Quality Data Scaling For Low-Resource Machine Translation19 Aug 2026
- 2026EMBL AI Librarian: Life-Sciences Knowledge Layer for AI Agents30 Jul 2026
- 2026Arabic Sentence Segmentation Across Genres and Punctuation Conditions6 Jun 2026
- 2025ChunkLLM: A Lightweight Pluggable Framework for Accelerating LLMs Inference28 Sep 2025
- 2025OpenWHO: A Document-Level Parallel Corpus for Health Translation in Low-Resource Languages22 Aug 2025
- 2025Zero-knowledge LLM hallucination detection and mitigation through fine-grained cross-model consistency19 Aug 2025
- 2025Divide (Text) and Conquer (Sentiment): Improved Sentiment Classification by Constituent Conflict Resolution8 May 2025
- 2025Precise Legal Sentence Boundary Detection for Retrieval at Scale: NUPunkt and CharBoundary5 Apr 2025
- 2025MEMERAG: A Multilingual End-to-End Meta-Evaluation Benchmark for Retrieval Augmented Generation24 Feb 2025
- 2025High-Fidelity Simultaneous Speech-To-Speech Translation5 Feb 2025
- 2025DOLFIN -- Document-Level Financial test set for Machine Translation5 Feb 2025
26 more
- 2024Beyond Film Subtitles: Is YouTube the Best Approximation of Spoken Vocabulary?4 Oct 2024
- 2024Domain-specific long text classification from sparse relevant information23 Aug 2024
- 2024uMedSum: A Unified Framework for Advancing Medical Abstractive Summarization22 Aug 2024
- 2024WiDe-analysis: Enabling One-click Content Moderation Analysis on Wikipedia's Articles for Deletion10 Aug 2024
- 2024Topic Modeling with Fine-tuning LLMs and Bag of Sentences6 Aug 2024
- 2024This Paper Had the Smartest Reviewers -- Flattery Detection Utilising an Audio-Textual Transformer-Based Approach25 Jun 2024
- 2024Segment Any Text: A Universal Approach for Robust, Efficient and Adaptable Sentence Segmentation24 Jun 2024
- 2024The MuSe 2024 Multimodal Sentiment Analysis Challenge: Social Perception and Humor Recognition11 Jun 2024
- 2024Modeling Emotional Trajectories in Written Stories Utilizing Transformers and Weakly-Supervised Learning4 Jun 2024
- 2024Semantic Scaling: Bayesian Ideal Point Estimates with Large Language Models3 May 2024
- 2024WikiSplit++: Easy Data Refinement for Split and Rephrase13 Apr 2024
- 2024SciNews: From Scholarly Complexities to Public Narratives -- A Dataset for Scientific News Report Generation26 Mar 2024
- 2023Glitter or Gold? Deriving Structured Insights from Sustainability Reports via Large Language Models9 Oct 2023
- 2023ParaGuide: Guided Diffusion Paraphrasers for Plug-and-Play Textual Style Transfer29 Aug 2023
- 2023Where's the Point? Self-Supervised Multilingual Punctuation-Agnostic Sentence Segmentation30 May 2023
- 2023Cross-Lingual Knowledge Distillation for Answer Sentence Selection in Low-Resource Languages25 May 2023
- 2023Executive Voiced Laughter and Social Approval: An Explorative Machine Learning Study16 May 2023
- 2023WikiSQE: A Large-Scale Dataset for Sentence Quality Estimation in Wikipedia10 May 2023
- 2023The MuSe 2023 Multimodal Sentiment Analysis Challenge: Mimicked Emotions, Cross-Cultural Humour, and Personalisation5 May 2023
- 2023CiteCaseLAW: Citation Worthiness Detection in Caselaw for Legal Assistive Writing3 May 2023
- 2023Sample-Specific Debiasing for Better Image-Text Models25 Apr 2023
- 2023Efficient and Flexible Topic Modeling using Pretrained Embeddings and Bag of Sentences6 Feb 2023
- 2022Using Multiple Instance Learning to Build Multimodal Representations11 Dec 2022
- 2022Making Science Simple: Corpora for the Lay Summarisation of Scientific Literature18 Oct 2022
- 2022A Natural Language Processing Pipeline for Detecting Informal Data References in Academic Literature23 May 2022
- 2021VILA: Improving Structured Content Extraction from Scientific PDFs Using Visual Layout Groups1 Jun 2021
- 2022Making Science Simple: Corpora for the Lay Summarisation of Scientific Literaturecited by 54
- 2024Segment Any Text: A Universal Approach for Robust, Efficient and Adaptable Sentence Segmentationcited by 41
- 2021VILA: Improving Structured Content Extraction from Scientific PDFs Using Visual Layout Groupscited by 27
- 2023Where's the Point? Self-Supervised Multilingual Punctuation-Agnostic Sentence Segmentationcited by 17
- 2025High-Fidelity Simultaneous Speech-To-Speech Translationcited by 15
- 2023The MuSe 2023 Multimodal Sentiment Analysis Challenge: Mimicked Emotions, Cross-Cultural Humour, and Personalisationcited by 12
- 2024SciNews: From Scholarly Complexities to Public Narratives -- A Dataset for Scientific News Report Generationcited by 12
- 2022Using Multiple Instance Learning to Build Multimodal Representationscited by 7
- 2023Glitter or Gold? Deriving Structured Insights from Sustainability Reports via Large Language Modelscited by 6
- 2025Zero-knowledge LLM hallucination detection and mitigation through fine-grained cross-model consistencycited by 6
- 2024Beyond Film Subtitles: Is YouTube the Best Approximation of Spoken Vocabulary?cited by 5
- 2024Modeling Emotional Trajectories in Written Stories Utilizing Transformers and Weakly-Supervised Learningcited by 4
12 most cited of 34 All 34 (JSON)
- 2026TranslatePsy-AfriSLM: High-Quality Data Scaling For Low-Resource Machine Translation19 Aug 2026
- 2026Arabic Sentence Segmentation Across Genres and Punctuation Conditions6 Jun 2026
- 2025ChunkLLM: A Lightweight Pluggable Framework for Accelerating LLMs Inference28 Sep 2025
- 2025OpenWHO: A Document-Level Parallel Corpus for Health Translation in Low-Resource Languages22 Aug 2025
- 2025Zero-knowledge LLM hallucination detection and mitigation through fine-grained cross-model consistency19 Aug 2025
- 2025Divide (Text) and Conquer (Sentiment): Improved Sentiment Classification by Constituent Conflict Resolution8 May 2025
- 2025Precise Legal Sentence Boundary Detection for Retrieval at Scale: NUPunkt and CharBoundary5 Apr 2025
- 2025High-Fidelity Simultaneous Speech-To-Speech Translation5 Feb 2025
- 2025DOLFIN -- Document-Level Financial test set for Machine Translation5 Feb 2025
- 2024Beyond Film Subtitles: Is YouTube the Best Approximation of Spoken Vocabulary?4 Oct 2024
- 2024Domain-specific long text classification from sparse relevant information23 Aug 2024
- 2024uMedSum: A Unified Framework for Advancing Medical Abstractive Summarization22 Aug 2024
12 newest of 34 All 34 (JSON)