mlsanityData to 7 Oct 2026

EasyNLP: A Comprehensive and Easy-to-use Toolkit for Natural Language Processing

arXiv 2205.00258 ↗First posted 30 Apr 2022cs.CLcited by 9

Not on the map. Why?

Abstract (arXiv)

The success of Pre-Trained Models (PTMs) has reshaped the development of Natural Language Processing (NLP). Yet, it is not easy to obtain high-performing models and deploy them online for industrial practitioners. To bridge this gap, EasyNLP is designed to make it easy to build NLP applications, which supports a comprehensive suite of NLP algorithms. It further features knowledge-enhanced pre-training, knowledge distillation and few-shot learning functionalities for large-scale PTMs, and provides a unified framework of model training, inference and deployment for real-world applications. Currently, EasyNLP has powered over ten business units within Alibaba Group and is seamlessly integrated to the Platform of AI (PAI) products on Alibaba Cloud. The source code of our EasyNLP toolkit is released at GitHub (https://github.com/alibaba/EasyNLP).

Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Builds on 31 of its 37 references that are in the map. First posted on arXiv 30 Apr 2022.

Builds on

31 of 37 references.

References · 31

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2020Language Models are Few-Shot Learnerscited by 32,199
  3. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  4. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  5. 2015Distilling the Knowledge in a Neural Networkcited by 10,076
  6. 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,304
  7. 2018GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understandingcited by 4,854
  8. 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,243
  9. 2019XLNet: Generalized Autoregressive Pretraining for Language Understandingcited by 2,801
  10. 2017A Broad-Coverage Challenge Corpus for Sentence Understanding through Inferencecited by 2,665
  11. 2021Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processingcited by 2,222
  12. 2019Language Models as Knowledge Bases?cited by 1,922
19 more
  1. 2019Transformer-XL: Attentive Language Models Beyond a Fixed-Length Contextcited by 1,830
  2. 2020Making Pre-trained Language Models Better Few-shot Learnerscited by 1,255
  3. 2019TinyBERT: Distilling BERT for Natural Language Understandingcited by 1,153
  4. 2014Convolutional Neural Networks for Sentence Classificationcited by 1,124
  5. 2020Exploiting Cloze Questions for Few Shot Text Classification and Natural Language Inferencecited by 934
  6. 2021GPT Understands, Toocited by 715
  7. 2019ERNIE: Enhanced Language Representation with Informative Entitiescited by 525
  8. 2020Pre-trained Models for Natural Language Processing: A Surveycited by 504
  9. 2019Patient Knowledge Distillation for BERT Model Compressioncited by 502
  10. 2019KEPLER: A Unified Model for Knowledge Embedding and Pre-trained Language Representationcited by 356
  11. 2020K-Adapter: Infusing Knowledge into Pre-Trained Models with Adapterscited by 318
  12. 2019K-BERT: Enabling Language Representation with Knowledge Graphcited by 303
  13. 2020CLUE: A Chinese Language Understanding Evaluation Benchmarkcited by 277
  14. 2020Revisiting Pre-Trained Models for Chinese Natural Language Processingcited by 262
  15. 2020CoLAKE: Contextualized Language and Knowledge Embeddingcited by 86
  16. 2020Meta-KD: A Meta Knowledge Distillation Framework for Language Model Compression across Domainscited by 33
  17. 2022Making Pre-trained Language Models End-to-end Few-shot Learners with Contrastive Prompt Tuningcited by 19
  18. 2021DKPLM: Decomposable Knowledge-enhanced Pre-trained Language Model for Natural Language Understandingcited by 15
  19. 2020EasyTransfer -- A Simple and Scalable Deep Transfer Learning Platform for NLP Applicationscited by 7

Built on by

Cited by year

Citing papers per year: 2022: 5; 2023: 4.

9 papers.

  1. 2022Towards Unified Prompt Tuning for Few-shot Text Classificationcited by 18
  2. 2022SpanProto: A Two-stage Span-based Prototypical Network for Few-shot Named Entity Recognitioncited by 8
  3. 2022KECP: Knowledge Enhanced Contrastive Prompting for Few-shot Extractive Question Answeringcited by 6
  4. 2022Revisiting and Advancing Chinese Natural Language Understanding with Accelerated Heterogeneous Knowledge Pre-trainingcited by 6
  5. 2023PAI-Diffusion: Constructing and Serving a Family of Open Chinese Diffusion Models for Text-to-image Synthesis on the Cloudcited by 5
  6. 2023ConaCLIP: Exploring Distillation of Fully-Connected Knowledge Interaction Graph for Lightweight Text-Image Retrievalcited by 3
  7. 2023Making Small Language Models Better Multi-task Learners with Mixture-of-Task-Adapterscited by 3
  8. 2022YATO: Yet Another deep learning based Text analysis Open toolkitcited by 2
  9. 2023HugNLP: A Unified and Comprehensive Library for Natural Language Processingcited by 1