Neural Sentence Ordering Based on Constraint Graphs
Not on the map. Why?
Abstract (arXiv)
Sentence ordering aims at arranging a list of sentences in the correct order. Based on the observation that sentence order at different distances may rely on different types of information, we devise a new approach based on multi-granular orders between sentences. These orders form multiple constraint graphs, which are then encoded by Graph Isomorphism Networks and fused into sentence representations. Finally, sentence order is determined using the order-enhanced sentence representations. Our experiments on five benchmark datasets show that our method outperforms all the existing baselines significantly, achieving a new state-of-the-art performance. The results demonstrate the advantage of considering multiple types of order information and using graph neural networks to integrate sentence content and order information for the task. Our code is available at https://github.com/DaoD/ConstraintGraph4NSO.
Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 23 of its 40 references that are in the map. First posted on arXiv 27 Jan 2021.
Builds on
23 of 40 references.
References · 23
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
- 2017Graph Attention Networkscited by 8,854
- 2018How Powerful are Graph Neural Networks?cited by 4,355
- 2017Neural Message Passing for Quantum Chemistrycited by 3,460
- 2019ALBERT: A Lite BERT for Self-supervised Learning of Language Representationscited by 2,772
- 2019HuggingFace's Transformers: State-of-the-art Natural Language Processingcited by 2,201
- 2015Pointer Networkscited by 882
- 2020Benchmarking Graph Neural Networkscited by 672
- 2016SummaRuNNer: A Recurrent Neural Network based Sequence Model for Extractive Summarization of Documentscited by 245
11 more
- 2016Visual Storytellingcited by 176
- 2018QANet: Combining Local Convolution with Global Self-Attention for Reading Comprehensioncited by 164
- 2019Strategies for Structuring Story Generationcited by 124
- 2018N-Gram Graph: Simple Unsupervised Representation for Graphs, with Applications to Moleculescited by 93
- 2016Neural Net Models for Open-Domain Discourse Coherencecited by 23
- 2019Deep Attentive Ranking Networks for Learning to Order Sentencescited by 22
- 2020Topological Sort for Sentence Orderingcited by 21
- 2019Graph-based Neural Sentence Orderingcited by 19
- 2016Neural Sentence Orderingcited by 18
- 2016End-to-End Neural Sentence Ordering Using Pointer Networkcited by 17
- 2020ScriptWriter: Narrative-Guided Script Generationcited by 15
Built on by
Citing papers per year: 2021: 5; 2022: 1; 2023: 1; 2024: 0; 2025: 0; 2026: 1.
8 papers.
- 2021Is Everything in Order? A Simple Way to Order Sentencescited by 15
- 2021STaCK: Sentence Ordering with Temporal Commonsense Knowledgecited by 7
- 2023Positional Diffusion: Ordering Unordered Sets with Diffusion Probabilistic Modelscited by 5
- 2021Improving Graph-based Sentence Ordering with Iteratively Predicted Pairwise Orderingscited by 4
- 2021BERT4SO: Neural Sentence Ordering by Fine-tuning BERTcited by 2
- 2021Local and Global Context-Based Pairwise Models for Sentence Orderingcited by 1
- 2022Coarse-to-Fine: Hierarchical Multi-task Learning for Natural Language Understandingcited by 1
- 2026Learning Page Order in Shuffled WOO Releasescited by 0
- 2026Learning Page Order in Shuffled WOO Releases11 Feb 2026
- 2023Positional Diffusion: Ordering Unordered Sets with Diffusion Probabilistic Models20 Mar 2023
- 2022Coarse-to-Fine: Hierarchical Multi-task Learning for Natural Language Understanding19 Aug 2022
- 2021Improving Graph-based Sentence Ordering with Iteratively Predicted Pairwise Orderings13 Oct 2021
- 2021Local and Global Context-Based Pairwise Models for Sentence Ordering8 Oct 2021
- 2021STaCK: Sentence Ordering with Temporal Commonsense Knowledge6 Sep 2021
- 2021Is Everything in Order? A Simple Way to Order Sentences14 Apr 2021
- 2021BERT4SO: Neural Sentence Ordering by Fine-tuning BERT25 Mar 2021