mlsanityData to 7 Oct 2026

EasyInstruct: An Easy-to-use Instruction Processing Framework for Large Language Models

arXiv 2402.03049 ↗First posted 5 Feb 2024cs.CL cs.AI cs.HCcited by 0

Not on the map. Why?

Abstract (arXiv)

In recent years, instruction tuning has gained increasing attention and emerged as a crucial technique to enhance the capabilities of Large Language Models (LLMs). To construct high-quality instruction datasets, many instruction processing approaches have been proposed, aiming to achieve a delicate balance between data quantity and data quality. Nevertheless, due to inconsistencies that persist among various instruction processing methods, there is no standard open-source instruction processing implementation framework available for the community, which hinders practitioners from further developing and advancing. To facilitate instruction processing research and development, we present EasyInstruct, an easy-to-use instruction processing framework for LLMs, which modularizes instruction generation, selection, and prompting, while also considering their combination and interaction. EasyInstruct is publicly released and actively maintained at https://github.com/zjunlp/EasyInstruct, along with an online demo app and a demo video for quick-start, calling for broader research centered on instruction data and synthetic data.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 26 of its 43 references that are in the map. First posted on arXiv 5 Feb 2024.

Builds on

26 of 43 references.

References · 26

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2022Training language models to follow instructions with human feedbackcited by 15,712
  3. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  4. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
  5. 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,747
  6. 2022Scaling Instruction-Finetuned Language Modelscited by 2,997
  7. 2022Self-Instruct: Aligning Language Models with Self-Generated Instructionscited by 2,674
  8. 2023A Survey of Large Language Modelscited by 2,537
  9. 2022BLOOM: A 176B-Parameter Open-Access Multilingual Language Modelcited by 1,968
  10. 2023WizardLM: Empowering large pre-trained language models to follow complex instructionscited by 1,116
  11. 2023LIMA: Less Is More for Alignmentcited by 1,080
  12. 2021GLM: General Language Model Pretraining with Autoregressive Blank Infillingcited by 1,026
14 more
  1. 2022Super-NaturalInstructions: Generalization via Declarative Instructions on 1600+ NLP Taskscited by 858
  2. 2023AlpacaFarm: A Simulation Framework for Methods that Learn from Human Feedbackcited by 738
  3. 2023The Flan Collection: Designing Data and Methods for Effective Instruction Tuningcited by 734
  4. 2023OpenAssistant Conversations -- Democratizing Large Language Model Alignmentcited by 712
  5. 2023Editing Large Language Models: Problems, Methods, and Opportunitiescited by 367
  6. 2023What Makes Good Data for Alignment? A Comprehensive Study of Automatic Data Selection in Instruction Tuningcited by 354
  7. 2023From Quantity to Quality: Boosting LLM Performance with Self-Guided Data Selection for Instruction Tuningcited by 301
  8. 2022Reasoning with Language Model Prompting: A Surveycited by 251
  9. 2021KnowPrompt: Knowledge-aware Prompt-tuning with Synergistic Optimization for Relation Extractioncited by 180
  10. 2024A Survey on Data Selection for LLM Instruction Tuningcited by 76
  11. 2024Comprehensive Exploration of Synthetic Data Generation: A Surveycited by 59
  12. 2023Active Instruction Tuning: Improving Cross-Task Generalization by Training on Prompt Sensitive Taskscited by 53
  13. 2023Self-Evolved Diverse Data Sampling for Efficient Instruction Tuningcited by 52
  14. 2023When Do Program-of-Thoughts Work for Reasoning?cited by 19

Built on by

Not cited yet.