mlsanityData to 7 Oct 2026

CSL: A Large-scale Chinese Scientific Literature Dataset

arXiv 2209.05034 ↗First posted 12 Sep 2022cs.CLcited by 45

Not on the map. Why?

Abstract (arXiv)

Scientific literature serves as a high-quality corpus, supporting a lot of Natural Language Processing (NLP) research. However, existing datasets are centered around the English language, which restricts the development of Chinese scientific NLP. In this work, we present CSL, a large-scale Chinese Scientific Literature dataset, which contains the titles, abstracts, keywords and academic fields of 396k papers. To our knowledge, CSL is the first scientific document dataset in Chinese. The CSL can serve as a Chinese corpus. Also, this semi-structured data is a natural annotation that can constitute many supervised NLP tasks. Based on CSL, we present a benchmark to evaluate the performance of models across scientific domain tasks, i.e., summarization, keyword generation and text classification. We analyze the behavior of existing text-to-text models on the evaluation tasks and reveal the challenges for Chinese scientific NLP tasks, which provides a valuable reference for future research. Data and code are available at https://github.com/ydli-ai/CSL

Key facts. Cited by 45 papers in the map (data through 7 Oct 2026). Builds on 14 of its 29 references that are in the map. First posted on arXiv 12 Sep 2022.

Builds on

14 of 29 references.

References · 14

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  3. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
  4. 2020Don't Stop Pretraining: Adapt Language Models to Domains and Taskscited by 1,548
  5. 2019SciBERT: A Pretrained Language Model for Scientific Textcited by 1,404
  6. 2019PEGASUS: Pre-training with Extracted Gap-sentences for Abstractive Summarizationcited by 1,100
  7. 2020SPECTER: Document-level Representation Learning using Citation-informed Transformerscited by 426
  8. 2021CrossFit: A Few-shot Learning Challenge for Cross-task Generalization in NLPcited by 142
  9. 2017Deep Keyphrase Generationcited by 102
  10. 2021FLEX: Unifying Evaluation for Few-Shot NLPcited by 67
  11. 2015LCSTS: A Large Scale Chinese Short Text Summarization Datasetcited by 65
  12. 2019UER: An Open-Source Toolkit for Pre-training Modelscited by 61
2 more
  1. 2020CLUECorpus2020: A Large-scale Chinese Corpus for Pre-training Language Modelcited by 36
  2. 2017Scientific document summarization via citation contextualization and scientific discoursecited by 12

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 17; 2024: 13; 2025: 7; 2026: 8.

45 papers.

Sort:

By area:

  1. 2024Making Text Embedders Few-Shot Learnerscited by 78
  2. 2024ChatGLM-Math: Improving Math Problem-Solving in Large Language Models with a Self-Critique Pipelinecited by 47
  3. 2023Origin Tracing and Detecting of LLMscited by 39
  4. 2023Chinese Open Instruction Generalist: A Preliminary Releasecited by 35
  5. 2025KaLM-Embedding-V2: Superior Training Techniques and Data Inspire A Versatile Embedding Modelcited by 35
  6. 2023PanGu-π: Enhancing Language Model Architectures via Nonlinearity Compensationcited by 17
  7. 2023The ACL OCL Corpus: Advancing Open Science in Computational Linguisticscited by 16
  8. 2023Integrating Stock Features and Global Information via Large Language Models for Enhanced Stock Return Predictioncited by 16
  9. 2024EMMA-500: Enhancing Massively Multilingual Adaptation of Large Language Modelscited by 16
  10. 2023Is ChatGPT Involved in Texts? Measure the Polish Ratio to Detect ChatGPT-Generated Textcited by 15
  11. 2024TeleChat Technical Reportcited by 15
  12. 2023Evaluating Large Language Models for Radiology Natural Language Processingcited by 12
33 more
  1. 2024Tele-FLM Technical Reportcited by 12
  2. 2025More is not always better? Enhancing Many-Shot In-Context Learning with Differentiated and Reweighting Objectivescited by 12
  3. 2023MindLLM: Pre-training Lightweight Large Language Model from Scratch, Evaluations and Domain Applicationscited by 11
  4. 2024Piccolo2: General Text Embedding with Multi-task Hybrid Loss Trainingcited by 10
  5. 2026F2LLM-v2: Inclusive, Performant, and Efficient Embeddings for a Multilingual Worldcited by 10
  6. 2023NaSGEC: a Multi-Domain Chinese Grammatical Error Correction Dataset from Native Speaker Textscited by 9
  7. 2024AutoMIR: Effective Zero-Shot Medical Information Retrieval without Relevance Labelscited by 8
  8. 2023OpenBA: An Open-sourced 15B Bilingual Asymmetric seq2seq Model Pre-trained from Scratchcited by 7
  9. 2024A Survey of Pre-trained Language Models for Processing Scientific Textcited by 7
  10. 2023CARE-MI: Chinese Benchmark for Misinformation Evaluation in Maternity and Infant Carecited by 5
  11. 2023Soulstyler: Using Large Language Model to Guide Image Style Transfer for Target Objectcited by 5
  12. 2024InternLM-Law: An Open Source Chinese Legal Large Language Modelcited by 5
  13. 2023ZhuJiu: A Multi-dimensional, Multi-faceted Chinese Benchmark for Large Language Modelscited by 4
  14. 2023Continuous Training and Fine-tuning for Domain-Specific Language Models in Medical Question Answeringcited by 4
  15. 2024Head-wise Shareable Attention for Large Language Modelscited by 4
  16. 2025Massively Multilingual Adaptation of Large Language Models Using Bilingual Translation Datacited by 4
  17. 2023ERNIE 3.0 Tiny: Frustratingly Simple Method to Improve Task-Agnostic Distillation Generalizationcited by 3
  18. 2024An Empirical Study on Large Language Models in Accuracy and Robustness under Chinese Industrial Scenarioscited by 3
  19. 2024Dynamic data sampler for cross-language transfer learning in large language modelscited by 3
  20. 2025ListConRanker: A Contrastive Text Reranker with Listwise Encodingcited by 3
  21. 2025On The Role of Pretrained Language Models in General-Purpose Text Embeddings: A Surveycited by 3
  22. 2024A Learning Rate Path Switching Training Paradigm for Version Updates of Large Language Modelscited by 2
  23. 2023Towards Robust Text Retrieval with Progressive Learningcited by 1
  24. 2026MAGA-Bench: Machine-Augment-Generated Text via Alignment Detection Benchmarkcited by 1
  25. 2026Efficient LLM-based Advertising via Model Compression and Parallel Verificationcited by 1
  26. 2023Generate to Understand for Representationcited by 0
  27. 2025Can the capability of Large Language Models be described by human ability? A Meta Studycited by 0
  28. 2025RoCoISLR: A Romanian Corpus for Isolated Sign Language Recognitioncited by 0
  29. 2026EmbeddingRWKV: State-Centric Retrieval with Reusable Statescited by 0
  30. 2026ML-Embed: Inclusive and Efficient Embeddings for a Multilingual Worldcited by 0
  31. 2026AutoTail-BSFGM: Class-Balance-Aware Fine-Tuning for Chinese Scholarly Text Classificationcited by 0
  32. 2026ConSA: Controllable Sparsity in Hybrid Attention via Learnable Allocationcited by 0
  33. 2026KaLM-Reranker-V1: Fast but Not Late Interaction for Compressed Document Rerankingcited by 0