Learning Structured Text Representations
Not on the map. Why?
Abstract (arXiv)
In this paper, we focus on learning structure-aware document representations from data without recourse to a discourse parser or additional annotations. Drawing inspiration from recent efforts to empower neural networks with a structural bias, we propose a model that can encode a document while automatically inducing rich structural dependencies. Specifically, we embed a differentiable non-projective parsing algorithm into a neural model and use attention mechanisms to incorporate the structural biases. Experimental evaluation across different tasks and datasets shows that the proposed model achieves state-of-the-art results on document modeling tasks while inducing intermediate structures which are both interpretable and meaningful.
Key facts. Cited by 24 papers in the map (data through 14 Oct 2026). First posted on arXiv 25 May 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 9; 2022: 8; 2023: 6; 2024: 1.
24 papers.
Sort:
By area:
- 2021Causal Inference in Natural Language Processing: Estimation, Prediction, Interpretation and Beyondcited by 178
- 2021Recent Advances in Deep Learning Based Dialogue Systems: A Systematic Surveycited by 130
- 2022Estimating the Personality of White-Box Language Modelscited by 48
- 2021Attribute Alignment: Controlling Text Generation from Pre-trained Language Modelscited by 27
- 2021Modeling Hierarchical Structures with Continuous Recursive Neural Networkscited by 15
- 2021Semantic Role Labeling as Dependency Parsing: Exploring Latent Tree Structures Inside Argumentscited by 14
- 2021Enriching Transformers with Structured Tensor-Product Representations for Abstractive Summarizationcited by 11
- 2021Predicting Discourse Trees from Transformer-based Neural Summarizerscited by 10
- 2022Innovations in Neural Data-to-text Generation: A Surveycited by 10
- 2022More Interpretable Graph Similarity Computation via Maximum Common Subgraph Inferencecited by 8
- 2023Advancements in Scientific Controllable Text Generation Methodscited by 7
- 2021To be Closer: Learning to Link up Aspects with Opinionscited by 5
12 more
- 2022Improving Topic Segmentation by Injecting Discourse Dependenciescited by 5
- 2023Discourse Structure Extraction from Pre-Trained and Fine-Tuned Language Models in Dialoguescited by 4
- 2023Structured Dialogue Discourse Parsingcited by 4
- 2023Efficient Beam Tree Recursioncited by 4
- 2022Learning with Latent Structures in Natural Language Processing: A Surveycited by 2
- 2022Discourse-Aware Graph Networks for Textual Logical Reasoningcited by 2
- 2023Equivariant vs. Invariant Layers: A Comparison of Backbone and Pooling for Point Cloud Classificationcited by 2
- 2024To be Continuous, or to be Discrete, Those are Bits of Questionscited by 2
- 2021Speaker-Oriented Latent Structures for Dialogue-Based Relation Extractioncited by 1
- 2022An Overview on Controllable Text Generation via Variational Auto-Encoderscited by 1
- 2023Learning Unbiased News Article Representations: A Knowledge-Infused Approachcited by 1
- 2022Testing the Robustness of a BiLSTM-based Structural Story Classifiercited by 0
- 2024To be Continuous, or to be Discrete, Those are Bits of Questions12 Jun 2024
- 2023Learning Unbiased News Article Representations: A Knowledge-Infused Approach12 Sep 2023
- 2023Efficient Beam Tree Recursion20 Jul 2023
- 2023Advancements in Scientific Controllable Text Generation Methods8 Jul 2023
- 2023Structured Dialogue Discourse Parsing26 Jun 2023
- 2023Equivariant vs. Invariant Layers: A Comparison of Backbone and Pooling for Point Cloud Classification8 Jun 2023
- 2023Discourse Structure Extraction from Pre-Trained and Fine-Tuned Language Models in Dialogues12 Feb 2023
- 2022An Overview on Controllable Text Generation via Variational Auto-Encoders15 Nov 2022
- 2022Improving Topic Segmentation by Injecting Discourse Dependencies18 Sep 2022
- 2022More Interpretable Graph Similarity Computation via Maximum Common Subgraph Inference9 Aug 2022
- 2022Innovations in Neural Data-to-text Generation: A Survey25 Jul 2022
- 2022Discourse-Aware Graph Networks for Textual Logical Reasoning4 Jul 2022
12 more
- 2022Estimating the Personality of White-Box Language Models25 Apr 2022
- 2022Testing the Robustness of a BiLSTM-based Structural Story Classifier3 Jan 2022
- 2022Learning with Latent Structures in Natural Language Processing: A Survey3 Jan 2022
- 2021Semantic Role Labeling as Dependency Parsing: Exploring Latent Tree Structures Inside Arguments13 Oct 2021
- 2021To be Closer: Learning to Link up Aspects with Opinions17 Sep 2021
- 2021Speaker-Oriented Latent Structures for Dialogue-Based Relation Extraction11 Sep 2021
- 2021Causal Inference in Natural Language Processing: Estimation, Prediction, Interpretation and Beyond2 Sep 2021
- 2021Modeling Hierarchical Structures with Continuous Recursive Neural Networks10 Jun 2021
- 2021Enriching Transformers with Structured Tensor-Product Representations for Abstractive Summarization2 Jun 2021
- 2021Recent Advances in Deep Learning Based Dialogue Systems: A Systematic Survey10 May 2021
- 2021Predicting Discourse Trees from Transformer-based Neural Summarizers14 Apr 2021
- 2021Attribute Alignment: Controlling Text Generation from Pre-trained Language Models20 Mar 2021
- 2021Causal Inference in Natural Language Processing: Estimation, Prediction, Interpretation and Beyondcited by 178
- 2021Recent Advances in Deep Learning Based Dialogue Systems: A Systematic Surveycited by 130
- 2022Estimating the Personality of White-Box Language Modelscited by 48
- 2021Attribute Alignment: Controlling Text Generation from Pre-trained Language Modelscited by 27
- 2021Modeling Hierarchical Structures with Continuous Recursive Neural Networkscited by 15
- 2021Semantic Role Labeling as Dependency Parsing: Exploring Latent Tree Structures Inside Argumentscited by 14
- 2021Enriching Transformers with Structured Tensor-Product Representations for Abstractive Summarizationcited by 11
- 2021Predicting Discourse Trees from Transformer-based Neural Summarizerscited by 10
- 2022Innovations in Neural Data-to-text Generation: A Surveycited by 10
- 2022More Interpretable Graph Similarity Computation via Maximum Common Subgraph Inferencecited by 8
- 2023Advancements in Scientific Controllable Text Generation Methodscited by 7
- 2021To be Closer: Learning to Link up Aspects with Opinionscited by 5
12 most cited of 23 All 23 (JSON)
- 2024To be Continuous, or to be Discrete, Those are Bits of Questions12 Jun 2024
- 2023Learning Unbiased News Article Representations: A Knowledge-Infused Approach12 Sep 2023
- 2023Efficient Beam Tree Recursion20 Jul 2023
- 2023Advancements in Scientific Controllable Text Generation Methods8 Jul 2023
- 2023Structured Dialogue Discourse Parsing26 Jun 2023
- 2023Equivariant vs. Invariant Layers: A Comparison of Backbone and Pooling for Point Cloud Classification8 Jun 2023
- 2023Discourse Structure Extraction from Pre-Trained and Fine-Tuned Language Models in Dialogues12 Feb 2023
- 2022An Overview on Controllable Text Generation via Variational Auto-Encoders15 Nov 2022
- 2022Improving Topic Segmentation by Injecting Discourse Dependencies18 Sep 2022
- 2022More Interpretable Graph Similarity Computation via Maximum Common Subgraph Inference9 Aug 2022
- 2022Innovations in Neural Data-to-text Generation: A Survey25 Jul 2022
- 2022Estimating the Personality of White-Box Language Models25 Apr 2022
12 newest of 23 All 23 (JSON)