mlsanityData to 7 Oct 2026

Chinese Open Instruction Generalist: A Preliminary Release

arXiv 2304.07987 ↗First posted 17 Apr 2023cs.CL cs.AIcited by 35

Not on the map. Why?

Abstract (arXiv)

Instruction tuning is widely recognized as a key technique for building generalist language models, which has attracted the attention of researchers and the public with the release of InstructGPT~citepouyang2022training and ChatGPTfootnoteurlhttps://chat.openai.com/. Despite impressive progress in English-oriented large-scale language models (LLMs), it is still under-explored whether English-based foundation LLMs can perform similarly on multilingual tasks compared to English tasks with well-designed instruction tuning and how we can construct the corpora needed for the tuning. To remedy this gap, we propose the project as an attempt to create a Chinese instruction dataset by various methods adapted to the intrinsic characteristics of 4 sub-tasks. We collect around 200k Chinese instruction tuning samples, which have been manually checked to guarantee high quality. We also summarize the existing English and Chinese instruction corpora and briefly describe some potential applications of the newly constructed Chinese instruction corpora. The resulting Chinese Open Instruction Generalist (COIG) corpora are available in Huggingfacefootnoteurlhttps://huggingface.co/datasets/BAAI/COIG and Githubfootnoteurlhttps://github.com/BAAI-Zlab/COIG, and will be continuously updated.

Key facts. Cited by 35 papers in the map (data through 7 Oct 2026). Builds on 30 of its 54 references that are in the map. First posted on arXiv 17 Apr 2023.

Builds on

30 of 54 references.

References · 30

  1. 2022Training language models to follow instructions with human feedbackcited by 15,712
  2. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  3. 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,747
  4. 2022Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedbackcited by 3,634
  5. 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,500
  6. 2022Scaling Instruction-Finetuned Language Modelscited by 2,997
  7. 2022Self-Instruct: Aligning Language Models with Self-Generated Instructionscited by 2,674
  8. 2021Multitask Prompted Training Enables Zero-Shot Task Generalizationcited by 1,462
  9. 2020Gradient Surgery for Multi-Task Learningcited by 1,210
  10. 2022Super-NaturalInstructions: Generalization via Declarative Instructions on 1600+ NLP Taskscited by 858
  11. 2022GLM-130B: An Open Bilingual Pre-trained Modelcited by 837
  12. 2023The Flan Collection: Designing Data and Methods for Effective Instruction Tuningcited by 734
18 more
  1. 2022Red Teaming Language Models to Reduce Harms: Methods, Scaling Behaviors, and Lessons Learnedcited by 702
  2. 2021Cross-Task Generalization via Natural Language Crowdsourcing Instructionscited by 696
  3. 2023Instruction Tuning with GPT-4cited by 676
  4. 2018Learning to Reweight Examples for Robust Deep Learningcited by 670
  5. 2023How Close is ChatGPT to Human Experts? Comparison Corpus, Evaluation, and Detectioncited by 472
  6. 2021MetaICL: Learning to Learn In Contextcited by 450
  7. 2022Unnatural Instructions: Tuning Language Models with (Almost) No Human Laborcited by 395
  8. 2022PromptSource: An Integrated Development Environment and Repository for Natural Language Promptscited by 288
  9. 2020Social Chemistry 101: Learning to Reason about Social and Moral Normscited by 253
  10. 2022OPT-IML: Scaling Language Model Instruction Meta Learning through the Lens of Generalizationcited by 235
  11. 2022UnifiedSKG: Unifying and Multi-Tasking Structured Knowledge Grounding with Text-to-Text Language Modelscited by 231
  12. 2021ExT5: Towards Extreme Multi-Task Scaling for Transfer Learningcited by 161
  13. 2021CrossFit: A Few-shot Learning Challenge for Cross-task Generalization in NLPcited by 142
  14. 2020Moral Stories: Situated Reasoning about Norms, Intents, Actions, and their Consequencescited by 133
  15. 2022POTATO: The Portable Text Annotation Toolcited by 64
  16. 2022ZeroPrompt: Scaling Prompt-Based Pretraining to 1,000 Tasks Improves Zero-Shot Generalizationcited by 54
  17. 2022CSL: A Large-scale Chinese Scientific Literature Datasetcited by 45
  18. 2021CUGE: A Chinese Language Understanding and Generation Evaluation Benchmarkcited by 16

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 15; 2024: 13; 2025: 6; 2026: 1.

35 papers.

Sort:

By area:

  1. 2023Instruction Tuning for Large Language Models: A Surveycited by 617
  2. 2024Aya Model: An Instruction Finetuned Open-Access Multilingual Language Modelcited by 292
  3. 2023RoleLLM: Benchmarking, Eliciting, and Enhancing Role-Playing Abilities of Large Language Modelscited by 173
  4. 2023Mol-Instructions: A Large-Scale Biomolecular Instruction Dataset for Large Language Modelscited by 131
  5. 2023DISC-LawLLM: Fine-tuning Large Language Models for Intelligent Legal Servicescited by 117
  6. 2023EduChat: A Large-Scale Language Model-based Chatbot System for Intelligent Educationcited by 80
  7. 2024MAP-Neo: Highly Capable and Transparent Bilingual Large Language Model Seriescited by 67
  8. 2023From Instructions to Intrinsic Human Values -- A Survey of Alignment Goals for Big Modelscited by 45
  9. 2024COIG-CQIA: Quality is All You Need for Chinese Instruction Fine-tuningcited by 45
  10. 2024Peer Review as A Multi-Turn and Long-Context Dialogue with Role-Based Interactionscited by 43
  11. 2023Towards the Law of Capacity Gap in Distilling Language Modelscited by 41
  12. 2023Interactive Natural Language Processingcited by 31
23 more
  1. 2023Aligning Large Language Models with Human: A Surveycited by 31
  2. 2023Pushing the Limits of ChatGPT on NLP Taskscited by 27
  3. 2023An Empirical Study of Instruction-tuning Large Language Models in Chinesecited by 17
  4. 2024HRLAIF: Improvements in Helpfulness and Harmlessness in Open-domain Reinforcement Learning From AI Feedbackcited by 15
  5. 2025LongEval: A Comprehensive Analysis of Long-Text Generation Through a Plan-based Paradigmcited by 14
  6. 2023MindLLM: Pre-training Lightweight Large Language Model from Scratch, Evaluations and Domain Applicationscited by 11
  7. 2024CMDAG: A Chinese Metaphor Dataset with Annotated Grounds as CoT for Boosting Metaphor Generationcited by 11
  8. 2025LegalDelta: Enhancing Legal Reasoning in LLMs via Reinforcement Learning with Chain-of-Thought Guided Information Gaincited by 11
  9. 2024Don't Half-listen: Capturing Key-part Information in Continual Instruction Tuningcited by 9
  10. 2024Does Cross-Cultural Alignment Change the Commonsense Morality of Language Models?cited by 9
  11. 2025HiMA-Ecom: Enabling Joint Training of Hierarchical Multi-Agent E-commerce Assistantscited by 9
  12. 2024PatentGPT: A Large Language Model for Intellectual Propertycited by 8
  13. 2023Dynamics of Instruction Fine-Tuning for Chinese Large Language Modelscited by 6
  14. 2024RNR: Teaching Large Language Models to Follow Roles and Rulescited by 6
  15. 2023From Base to Conversational: Japanese Instruction Dataset and Tuning Large Language Modelscited by 5
  16. 2024A Study on Training and Developing Large Language Models for Behavior Tree Generationcited by 4
  17. 2024Dynamic data sampler for cross-language transfer learning in large language modelscited by 3
  18. 2026Reasoning While Asking: Transforming Reasoning Large Language Models from Passive Solvers to Proactive Inquirerscited by 3
  19. 2025TELEVAL: A Benchmark Designed for Spoken Language Models in Chinese Interactive Scenarioscited by 2
  20. 2023Panda LLM: Training Data and Evaluation for Open-Sourced Chinese Instruction-Following Large Language Modelscited by 1
  21. 2024CodingTeachLLM: Empowering LLM's Coding Ability via AST Prior Knowledgecited by 0
  22. 2025TaP: A Taxonomy-Guided Framework for Automated and Scalable Preference Data Generationcited by 0
  23. 2025COIG-Writer: A High-Quality Dataset for Chinese Creative Writing with Thought Processescited by 0