# NCRF++: An Open-source Neural Sequence Labeling Toolkit

arXiv: https://arxiv.org/abs/1806.05626 · HTML: https://mlsanity.com/paper/1806.05626/

## Key facts

- Cited by 29 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 14 Jun 2018.

## Built on by (most cited first, 29 of 29)

- [Multimodal Masked Autoencoders Learn Transferable Representations](https://mlsanity.com/paper/2205.14204/) (2022)
- [DREEAM: Guiding Attention with Evidence for Improving Document-Level Relation Extraction](https://mlsanity.com/paper/2302.08675/) (2023)
- [GreenPLM: Cross-Lingual Transfer of Monolingual Pre-Trained Language Models at Almost No Cost](https://mlsanity.com/paper/2211.06993/) (2022)
- [The Possible, the Plausible, and the Desirable: Event-Based Modality Detection for Language Processing](https://mlsanity.com/paper/2106.08037/) (2021)
- [Capitalization and Punctuation Restoration: a Survey](https://mlsanity.com/paper/2111.10746/) (2021)
- [METS-CoV: A Dataset of Medical Entity and Targeted Sentiment on COVID-19 Related Tweets](https://mlsanity.com/paper/2209.13773/) (2022)
- [Using Context-to-Vector with Graph Retrofitting to Improve Word Embeddings](https://mlsanity.com/paper/2210.16848/) (2022)
- [A Little Pretraining Goes a Long Way: A Case Study on Dependency Parsing Task for Low-resource Morphologically Rich Languages](https://mlsanity.com/paper/2102.06551/) (2021)
- [Computer Science Named Entity Recognition in the Open Research Knowledge Graph](https://mlsanity.com/paper/2203.14579/) (2022)
- [Not All Linearizations Are Equally Data-Hungry in Sequence Labeling Parsing](https://mlsanity.com/paper/2108.07556/) (2021)
- [Nutri-bullets: Summarizing Health Studies by Composing Segments](https://mlsanity.com/paper/2103.11921/) (2021)
- [Unsupervised Domain Adaptation for Hate Speech Detection Using a Data Augmentation Approach](https://mlsanity.com/paper/2107.12866/) (2021)
- ["Laughing at you or with you": The Role of Sarcasm in Shaping the Disagreement Space](https://mlsanity.com/paper/2101.10952/) (2021)
- [VTCC-NLP at NL4Opt competition subtask 1: An Ensemble Pre-trained language models for Named Entity Recognition](https://mlsanity.com/paper/2212.07219/) (2022)
- [TMR: Evaluating NER Recall on Tough Mentions](https://mlsanity.com/paper/2103.12312/) (2021)
- [On the logistical difficulties and findings of Jopara Sentiment Analysis](https://mlsanity.com/paper/2105.02947/) (2021)
- [Revisiting Supertagging for Faster HPSG Pasing](https://mlsanity.com/paper/2309.07590/) (2023)
- [Neural Sequence-to-Sequence Modeling with Attention by Leveraging Deep Learning Architectures for Enhanced Contextual Understanding in Abstractive Text Summarization](https://mlsanity.com/paper/2404.08685/) (2024)
- [Nutribullets Hybrid: Multi-document Health Summarization](https://mlsanity.com/paper/2104.03465/) (2021)
- [Cross-Domain Contract Element Extraction with a Bi-directional Feedback Clause-Element Relation Network](https://mlsanity.com/paper/2105.06083/) (2021)
- [YATO: Yet Another deep learning based Text analysis Open toolkit](https://mlsanity.com/paper/2209.13877/) (2022)
- [From Heuristic to Analytic: Cognitively Motivated Strategies for Coherent Physical Commonsense Reasoning](https://mlsanity.com/paper/2310.18364/) (2023)
- [LoRA Users Beware: A Few Spurious Tokens Can Manipulate Your Finetuned Model](https://mlsanity.com/paper/2506.11402/) (2025)
- [LMN at SemEval-2022 Task 11: A Transformer-based System for English Named Entity Recognition](https://mlsanity.com/paper/2203.03546/) (2022)
- [Learning the Ordering of Coordinate Compounds and Elaborate Expressions in Hmong, Lahu, and Chinese](https://mlsanity.com/paper/2204.04080/) (2022)
- [Application of Data Encryption in Chinese Named Entity Recognition](https://mlsanity.com/paper/2208.14627/) (2022)
- [Samsung R&D Institute Philippines at WMT 2023](https://mlsanity.com/paper/2310.16322/) (2023)
- [Explainable History Distillation by Marked Temporal Point Process](https://mlsanity.com/paper/2311.07797/) (2023)
- [Nested Named Entity Recognition as Single-Pass Sequence Labeling](https://mlsanity.com/paper/2505.16855/) (2025)

## Abstract (arXiv)

This paper describes NCRF++, a toolkit for neural sequence labeling. NCRF++ is designed for quick implementation of different neural sequence labeling models with a CRF inference layer. It provides users with an inference for building the custom model structure through configuration file with flexible neural feature design and utilization. Built on PyTorch, the core operations are calculated in batch, making the toolkit efficient with the acceleration of GPU. It also includes the implementations of most state-of-the-art neural sequence labeling models such as LSTM-CRF, facilitating reproducing and refinement on those methods.