NAREOR: The Narrative Reordering Problem
Not on the map. Why?
Abstract (arXiv)
Many implicit inferences exist in text depending on how it is structured that can critically impact the text's interpretation and meaning. One such structural aspect present in text with chronology is the order of its presentation. For narratives or stories, this is known as the narrative order. Reordering a narrative can impact the temporal, causal, event-based, and other inferences readers draw from it, which in turn can have strong effects both on its interpretation and interestingness. In this paper, we propose and investigate the task of Narrative Reordering (NAREOR) which involves rewriting a given story in a different narrative order while preserving its plot. We present a dataset, NAREORC, with human rewritings of stories within ROCStories in non-linear orders, and conduct a detailed analysis of it. Further, we propose novel task-specific training methods with suitable evaluation metrics. We perform experiments on NAREORC using state-of-the-art models such as BART and T5 and conduct extensive automatic and human evaluations. We demonstrate that although our models can perform decently, NAREOR is a challenging task with potential for further exploration. We also investigate two applications of NAREOR: generation of more interesting variations of stories and serving as adversarial sets for temporal/event-related tasks, besides discussing other prospective ones, such as for pedagogical setups related to language skills like essay writing and applications to medicine involving clinical narratives.
Key facts. Cited by 14 papers in the map (data through 14 Oct 2026). Builds on 22 of its 80 references that are in the map. First posted on arXiv 14 Apr 2021.
Builds on
22 of 80 references.
References · 22
- 2017Attention Is All You Needcited by 60,361
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,512
- 2019The Curious Case of Neural Text Degenerationcited by 2,916
- 2018Hierarchical Neural Story Generationcited by 1,193
- 2019CTRL: A Conditional Transformer Language Model for Controllable Generationcited by 762
- 2016A Corpus and Evaluation Framework for Deeper Understanding of Commonsense Storiescited by 417
- 2019Explain Yourself! Leveraging Language Models for Commonsense Reasoningcited by 367
- 2016Visual Storytellingcited by 176
- 2021Teach Me to Explain: A Review of Datasets for Explainable Natural Language Processingcited by 126
10 more
- 2020KG-BART: Knowledge Graph-Augmented BART for Generative Commonsense Reasoningcited by 106
- 2018CGMH: Constrained Sentence Generation by Metropolis-Hastings Samplingcited by 94
- 2019Do Massively Pretrained Language Models Make Better Storytellers?cited by 90
- 2016Generating Natural Questions About an Imagecited by 56
- 2018Sentence-Level Fluency Evaluation: References Help, But Can Be Spared!cited by 43
- 2020GenAug: Data Augmentation for Finetuning Text Generatorscited by 41
- 2020Topological Sort for Sentence Orderingcited by 21
- 2020An Enhanced Knowledge Injection Model for Commonsense Generationcited by 21
- 2019Keep Calm and Switch On! Preserving Sentiment and Fluency in Semantic Text Exchangecited by 19
- 2016Neural Sentence Orderingcited by 18
Built on by
Citing papers per year: 2021: 4; 2022: 5; 2023: 4; 2024: 1.
14 papers.
Sort:
By area:
- 2021A Survey of Data Augmentation Approaches for NLPcited by 409
- 2024A Survey on Knowledge Distillation of Large Language Modelscited by 284
- 2023AugGPT: Leveraging ChatGPT for Text Data Augmentationcited by 130
- 2021NL-Augmenter: A Framework for Task-Sensitive Natural Language Augmentationcited by 73
- 2023GDA: Generative Data Augmentation Techniques for Relation Extraction Taskscited by 10
- 2021Retrieve, Caption, Generate: Visual Grounding for Enhancing Commonsense in Text Generation Modelscited by 9
- 2021SAPPHIRE: Approaches for Enhanced Concept-to-Text Generationcited by 8
- 2022Synopses of Movie Narratives: a Video-Language Dataset for Story Understandingcited by 8
- 2022CHARD: Clinical Health-Aware Reasoning Across Dimensions for Text Generation Modelscited by 7
- 2022PANCETTA: Phoneme Aware Neural Completion to Elicit Tongue Twisters Automaticallycited by 6
- 2022AugCSE: Contrastive Sentence Embedding with Diverse Augmentationscited by 5
- 2023STORYWARS: A Dataset and Instruction Tuning Baselines for Collaborative Story Understanding and Generationcited by 5
- 2024A Survey on Knowledge Distillation of Large Language Models20 Feb 2024
- 2023Hierarchical Evaluation Framework: Best Practices for Human Evaluation3 Oct 2023
- 2023GDA: Generative Data Augmentation Techniques for Relation Extraction Tasks26 May 2023
- 2023STORYWARS: A Dataset and Instruction Tuning Baselines for Collaborative Story Understanding and Generation14 May 2023
- 2023AugGPT: Leveraging ChatGPT for Text Data Augmentation25 Feb 2023
- 2022AugCSE: Contrastive Sentence Embedding with Diverse Augmentations20 Oct 2022
- 2022CHARD: Clinical Health-Aware Reasoning Across Dimensions for Text Generation Models9 Oct 2022
- 2022PINEAPPLE: Personifying INanimate Entities by Acquiring Parallel Personification data for Learning Enhanced generation16 Sep 2022
- 2022PANCETTA: Phoneme Aware Neural Completion to Elicit Tongue Twisters Automatically13 Sep 2022
- 2022Synopses of Movie Narratives: a Video-Language Dataset for Story Understanding11 Mar 2022
- 2021NL-Augmenter: A Framework for Task-Sensitive Natural Language Augmentation6 Dec 2021
- 2021Retrieve, Caption, Generate: Visual Grounding for Enhancing Commonsense in Text Generation Models8 Sep 2021
2 more
- 2021SAPPHIRE: Approaches for Enhanced Concept-to-Text Generation15 Aug 2021
- 2021A Survey of Data Augmentation Approaches for NLP7 May 2021
- 2024A Survey on Knowledge Distillation of Large Language Modelscited by 284
- 2024A Survey on Knowledge Distillation of Large Language Models20 Feb 2024
- 2021A Survey of Data Augmentation Approaches for NLPcited by 409
- 2023AugGPT: Leveraging ChatGPT for Text Data Augmentationcited by 130
- 2021NL-Augmenter: A Framework for Task-Sensitive Natural Language Augmentationcited by 73
- 2023GDA: Generative Data Augmentation Techniques for Relation Extraction Taskscited by 10
- 2021Retrieve, Caption, Generate: Visual Grounding for Enhancing Commonsense in Text Generation Modelscited by 9
- 2021SAPPHIRE: Approaches for Enhanced Concept-to-Text Generationcited by 8
- 2022Synopses of Movie Narratives: a Video-Language Dataset for Story Understandingcited by 8
- 2022CHARD: Clinical Health-Aware Reasoning Across Dimensions for Text Generation Modelscited by 7
- 2022PANCETTA: Phoneme Aware Neural Completion to Elicit Tongue Twisters Automaticallycited by 6
- 2022AugCSE: Contrastive Sentence Embedding with Diverse Augmentationscited by 5
- 2023STORYWARS: A Dataset and Instruction Tuning Baselines for Collaborative Story Understanding and Generationcited by 5
- 2023Hierarchical Evaluation Framework: Best Practices for Human Evaluationcited by 5
12 most cited of 13 All 13 (JSON)
- 2023Hierarchical Evaluation Framework: Best Practices for Human Evaluation3 Oct 2023
- 2023GDA: Generative Data Augmentation Techniques for Relation Extraction Tasks26 May 2023
- 2023STORYWARS: A Dataset and Instruction Tuning Baselines for Collaborative Story Understanding and Generation14 May 2023
- 2023AugGPT: Leveraging ChatGPT for Text Data Augmentation25 Feb 2023
- 2022AugCSE: Contrastive Sentence Embedding with Diverse Augmentations20 Oct 2022
- 2022CHARD: Clinical Health-Aware Reasoning Across Dimensions for Text Generation Models9 Oct 2022
- 2022PINEAPPLE: Personifying INanimate Entities by Acquiring Parallel Personification data for Learning Enhanced generation16 Sep 2022
- 2022PANCETTA: Phoneme Aware Neural Completion to Elicit Tongue Twisters Automatically13 Sep 2022
- 2022Synopses of Movie Narratives: a Video-Language Dataset for Story Understanding11 Mar 2022
- 2021NL-Augmenter: A Framework for Task-Sensitive Natural Language Augmentation6 Dec 2021
- 2021Retrieve, Caption, Generate: Visual Grounding for Enhancing Commonsense in Text Generation Models8 Sep 2021
- 2021SAPPHIRE: Approaches for Enhanced Concept-to-Text Generation15 Aug 2021
12 newest of 13 All 13 (JSON)