Guiding the Growth: Difficulty-Controllable Question Generation through Step-by-Step Rewriting
Not on the map. Why?
Abstract (arXiv)
This paper explores the task of Difficulty-Controllable Question Generation (DCQG), which aims at generating questions with required difficulty levels. Previous research on this task mainly defines the difficulty of a question as whether it can be correctly answered by a Question Answering (QA) system, lacking interpretability and controllability. In our work, we redefine question difficulty as the number of inference steps required to answer it and argue that Question Generation (QG) systems should have stronger control over the logic of generated questions. To this end, we propose a novel framework that progressively increases question difficulty through step-by-step rewriting under the guidance of an extracted reasoning chain. A dataset is automatically constructed to facilitate the research, on which extensive experiments are conducted to test the performance of our method.
Key facts. Cited by 30 papers in the map (data through 7 Oct 2026). Builds on 23 of its 37 references that are in the map. First posted on arXiv 25 May 2021.
Builds on
23 of 37 references.
References · 23
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,243
- 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,115
- 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,686
- 2019HuggingFace's Transformers: State-of-the-art Natural Language Processingcited by 2,201
- 2014CIDEr: Consensus-based Image Description Evaluationcited by 2,027
- 2017Decoupled Weight Decay Regularizationcited by 1,722
- 2018The Web as a Knowledge-base for Answering Complex Questionscited by 409
- 2017End-to-end Neural Coreference Resolutioncited by 240
- 2019Multi-hop Reading Comprehension through Question Decomposition and Rescoringcited by 119
11 more
- 2020Question Rewriting for Conversational Question Answeringcited by 93
- 2017Neural Question Generation from Text: A Preliminary Studycited by 78
- 2020Text Modular Networks: Learning to Decompose Tasks in the Language of Existing Modelscited by 65
- 2020Efficient Probabilistic Logic Reasoning with Graph Neural Networkscited by 50
- 2019Recent Advances in Neural Question Generationcited by 42
- 2020Asking Questions the Human Way: Scalable Question-Answer Generation from Text Corpuscited by 40
- 2019Using Local Knowledge Graph Construction to Scale Seq2Seq Models to Multi-Document Inputscited by 38
- 2020Semantic Graphs for Generating Deep Questionscited by 38
- 2018Improving Neural Question Generation using Answer Separationcited by 30
- 2019Learning to Generate Questions by Learning What not to Generatecited by 17
- 2019Let Me Know What to Ask: Interrogative-Word-Aware Question Generationcited by 6
Built on by
Citing papers per year: 2022: 8; 2023: 5; 2024: 6; 2025: 6; 2026: 5.
30 papers.
Sort:
By area:
- 2022Varifocal Question Generation for Fact-checkingcited by 27
- 2022Multiple-Choice Question Generation: Towards an Automated Assessment Frameworkcited by 23
- 2022Towards Process-Oriented, Modular, and Versatile Question Generation that Meets Educational Needscited by 19
- 2023FrameBERT: Conceptual Metaphor Detection with Frame Embedding Learningcited by 18
- 2022RQUGE: Reference-Free Metric for Evaluating Question Generation by Answering the Questioncited by 17
- 2024QGEval: Benchmarking Multi-dimensional Evaluation for Question Generationcited by 17
- 2022NGEP: A Graph-based Event Planning Framework for Story Generationcited by 13
- 2023Metaphor Detection with Effective Context Denoisingcited by 13
- 2022QRelScore: Better Evaluating Generated Questions with Deeper Understanding of Context-aware Relevancecited by 9
- 2025Writing-RL: Advancing Long-form Writing via Adaptive Curriculum Reinforcement Learningcited by 9
- 2024Explainable Multi-hop Question Generation: An End-to-End Approach without Intermediate Question Labelingcited by 7
- 2023Diversity Enhanced Narrative Question Generation for Storybookscited by 5
18 more
- 2022Event Transition Planning for Open-ended Text Generationcited by 4
- 2024Synthetic Context Generation for Question Generationcited by 4
- 2026KNIGHT: Knowledge Graph-Driven Multiple-Choice Question Generation with Adaptive Hardness Calibrationcited by 4
- 2022Feeding What You Need by Understanding What You Learnedcited by 3
- 2024Survey of Natural Language Processing for Education: Taxonomy, Systematic Review, and Future Trendscited by 3
- 2025AutoJudger: An Agent-Driven Framework for Efficient Benchmarking of MLLMscited by 3
- 2024Increasing the Difficulty of Automatically Generated Questions via Reinforcement Learning with Synthetic Preferencecited by 2
- 2024ECIS-VQG: Generation of Entity-centric Information-seeking Questions from Videoscited by 2
- 2025HopWeaver: Cross-Document Synthesis of High-Quality and Authentic Multi-Hop Questionscited by 2
- 2023SkillQG: Learning to Generate Question for Reading Comprehension Assessmentcited by 1
- 2025Advancing Question Generation with Joint Narrative and Difficulty Controlcited by 1
- 2025Difficulty-Controllable Multiple-Choice Question Generation Using Large Language Models and Direct Preference Optimizationcited by 1
- 2026IRB: Automated Generation of Robust Factuality Benchmarkscited by 1
- 2023Contrastive Learning for Inference in Dialoguecited by 0
- 2025From Model to Classroom: Evaluating Generated MCQs for Portuguese with Narrative and Difficulty Concernscited by 0
- 2026Generating Multiple-Choice Knowledge Questions with Interpretable Difficulty Estimation using Knowledge Graphs and Large Language Modelscited by 0
- 2026MUSE: Benchmarking Large Vision-Language Models on Multi-Modal Understanding in Situated Educationcited by 0
- 2026ChemCLIR-Bench: Benchmarking Cross-Lingual Information Retrieval in Multilingual Chemical Patentscited by 0
- 2026ChemCLIR-Bench: Benchmarking Cross-Lingual Information Retrieval in Multilingual Chemical Patents19 Sep 2026
- 2026MUSE: Benchmarking Large Vision-Language Models on Multi-Modal Understanding in Situated Education16 Sep 2026
- 2026Generating Multiple-Choice Knowledge Questions with Interpretable Difficulty Estimation using Knowledge Graphs and Large Language Models12 Apr 2026
- 2026KNIGHT: Knowledge Graph-Driven Multiple-Choice Question Generation with Adaptive Hardness Calibration23 Feb 2026
- 2026IRB: Automated Generation of Robust Factuality Benchmarks8 Feb 2026
- 2025Difficulty-Controllable Multiple-Choice Question Generation Using Large Language Models and Direct Preference Optimization22 Oct 2025
- 2025From Model to Classroom: Evaluating Generated MCQs for Portuguese with Narrative and Difficulty Concerns18 Jun 2025
- 2025Advancing Question Generation with Joint Narrative and Difficulty Control7 Jun 2025
- 2025Writing-RL: Advancing Long-form Writing via Adaptive Curriculum Reinforcement Learning6 Jun 2025
- 2025AutoJudger: An Agent-Driven Framework for Efficient Benchmarking of MLLMs27 May 2025
- 2025HopWeaver: Cross-Document Synthesis of High-Quality and Authentic Multi-Hop Questions21 May 2025
- 2024ECIS-VQG: Generation of Entity-centric Information-seeking Questions from Videos13 Oct 2024
18 more
- 2024Increasing the Difficulty of Automatically Generated Questions via Reinforcement Learning with Synthetic Preference10 Oct 2024
- 2024Synthetic Context Generation for Question Generation19 Jun 2024
- 2024QGEval: Benchmarking Multi-dimensional Evaluation for Question Generation9 Jun 2024
- 2024Explainable Multi-hop Question Generation: An End-to-End Approach without Intermediate Question Labeling31 Mar 2024
- 2024Survey of Natural Language Processing for Education: Taxonomy, Systematic Review, and Future Trends15 Jan 2024
- 2023Diversity Enhanced Narrative Question Generation for Storybooks25 Oct 2023
- 2023Contrastive Learning for Inference in Dialogue19 Oct 2023
- 2023SkillQG: Learning to Generate Question for Reading Comprehension Assessment8 May 2023
- 2023Metaphor Detection with Effective Context Denoising11 Feb 2023
- 2023FrameBERT: Conceptual Metaphor Detection with Frame Embedding Learning9 Feb 2023
- 2022RQUGE: Reference-Free Metric for Evaluating Question Generation by Answering the Question2 Nov 2022
- 2022Varifocal Question Generation for Fact-checking22 Oct 2022
- 2022NGEP: A Graph-based Event Planning Framework for Story Generation19 Oct 2022
- 2022Multiple-Choice Question Generation: Towards an Automated Assessment Framework23 Sep 2022
- 2022Towards Process-Oriented, Modular, and Versatile Question Generation that Meets Educational Needs30 Apr 2022
- 2022QRelScore: Better Evaluating Generated Questions with Deeper Understanding of Context-aware Relevance29 Apr 2022
- 2022Event Transition Planning for Open-ended Text Generation20 Apr 2022
- 2022Feeding What You Need by Understanding What You Learned5 Mar 2022
- 2026KNIGHT: Knowledge Graph-Driven Multiple-Choice Question Generation with Adaptive Hardness Calibrationcited by 4
- 2024Increasing the Difficulty of Automatically Generated Questions via Reinforcement Learning with Synthetic Preferencecited by 2
- 2026IRB: Automated Generation of Robust Factuality Benchmarkscited by 1
- 2026KNIGHT: Knowledge Graph-Driven Multiple-Choice Question Generation with Adaptive Hardness Calibration23 Feb 2026
- 2026IRB: Automated Generation of Robust Factuality Benchmarks8 Feb 2026
- 2024Increasing the Difficulty of Automatically Generated Questions via Reinforcement Learning with Synthetic Preference10 Oct 2024
- 2022Varifocal Question Generation for Fact-checkingcited by 27
- 2022Multiple-Choice Question Generation: Towards an Automated Assessment Frameworkcited by 23
- 2022Towards Process-Oriented, Modular, and Versatile Question Generation that Meets Educational Needscited by 19
- 2023FrameBERT: Conceptual Metaphor Detection with Frame Embedding Learningcited by 18
- 2022RQUGE: Reference-Free Metric for Evaluating Question Generation by Answering the Questioncited by 17
- 2024QGEval: Benchmarking Multi-dimensional Evaluation for Question Generationcited by 17
- 2022NGEP: A Graph-based Event Planning Framework for Story Generationcited by 13
- 2023Metaphor Detection with Effective Context Denoisingcited by 13
- 2022QRelScore: Better Evaluating Generated Questions with Deeper Understanding of Context-aware Relevancecited by 9
- 2025Writing-RL: Advancing Long-form Writing via Adaptive Curriculum Reinforcement Learningcited by 9
- 2024Explainable Multi-hop Question Generation: An End-to-End Approach without Intermediate Question Labelingcited by 7
- 2023Diversity Enhanced Narrative Question Generation for Storybookscited by 5
12 most cited of 24 All 24 (JSON)
- 2026ChemCLIR-Bench: Benchmarking Cross-Lingual Information Retrieval in Multilingual Chemical Patents19 Sep 2026
- 2026Generating Multiple-Choice Knowledge Questions with Interpretable Difficulty Estimation using Knowledge Graphs and Large Language Models12 Apr 2026
- 2025From Model to Classroom: Evaluating Generated MCQs for Portuguese with Narrative and Difficulty Concerns18 Jun 2025
- 2025Advancing Question Generation with Joint Narrative and Difficulty Control7 Jun 2025
- 2025Writing-RL: Advancing Long-form Writing via Adaptive Curriculum Reinforcement Learning6 Jun 2025
- 2025HopWeaver: Cross-Document Synthesis of High-Quality and Authentic Multi-Hop Questions21 May 2025
- 2024ECIS-VQG: Generation of Entity-centric Information-seeking Questions from Videos13 Oct 2024
- 2024Synthetic Context Generation for Question Generation19 Jun 2024
- 2024QGEval: Benchmarking Multi-dimensional Evaluation for Question Generation9 Jun 2024
- 2024Explainable Multi-hop Question Generation: An End-to-End Approach without Intermediate Question Labeling31 Mar 2024
- 2024Survey of Natural Language Processing for Education: Taxonomy, Systematic Review, and Future Trends15 Jan 2024
- 2023Diversity Enhanced Narrative Question Generation for Storybooks25 Oct 2023
12 newest of 24 All 24 (JSON)