Sentence-State LSTM for Text Representation
Not on the map. Why?
Abstract (arXiv)
Bi-directional LSTMs are a powerful tool for text representation. On the other hand, they have been shown to suffer various limitations due to their sequential nature. We investigate an alternative LSTM structure for encoding text, which consists of a parallel state for each word. Recurrent steps are used to perform local and global information exchange between words simultaneously, rather than incremental reading of a sequence of words. Results on various classification and sequence labelling benchmarks show that the proposed model has strong representation power, giving highly competitive performances compared to stacked BiLSTM models with similar parameter numbers.
Key facts. Cited by 22 papers in the map (data through 14 Oct 2026). First posted on arXiv 7 May 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 11; 2022: 5; 2023: 2; 2024: 1; 2025: 3.
22 papers.
Sort:
- 2021Graph Learning: A Surveycited by 141
- 2021Investigating Pose Representations and Motion Contexts Modeling for 3D Motion Predictioncited by 31
- 2021Exploring the Efficacy of Automatically Generated Counterfactuals for Sentiment Analysiscited by 30
- 2021Better Feature Integration for Named Entity Recognitioncited by 22
- 2023Multimodal Data Integration for Oncology in the Era of Deep Neural Networks: A Reviewcited by 20
- 2022BERTifying Sinhala -- A Comprehensive Analysis of Pre-trained Language Models for Sinhala Text Classificationcited by 16
- 2022InducT-GCN: Inductive Graph Convolutional Networks for Text Classificationcited by 15
- 2021Enhance Long Text Understanding via Distilled Gist Detector from Abstractive Summarizationcited by 6
- 2021Improving Graph-based Sentence Ordering with Iteratively Predicted Pairwise Orderingscited by 4
- 2022Graph-Based Multilingual Label Propagation for Low-Resource Part-of-Speech Taggingcited by 4
- 2024Improving Long Text Understanding with Knowledge Distilled from Summarization Modelcited by 3
- 2021Locally-Contextual Nonlinear CRFs for Sequence Labelingcited by 2
10 more
- 2021Named entity recognition architecture combining contextual and global featurescited by 2
- 2021Fine-grained Geolocation Prediction of Tweets with Human Machine Collaborationcited by 1
- 2022Pre-Training a Graph Recurrent Network for Language Representationcited by 1
- 2021Dual-State Capsule Networks for Text Classificationcited by 0
- 2021KARL-Trans-NER: Knowledge Aware Representation Learning for Named Entity Recognition using Transformerscited by 0
- 2022Pruned Graph Neural Network for Short Story Orderingcited by 0
- 2023A Global Context Mechanism for Sequence Labelingcited by 0
- 2025An Explainable Neural Radiomic Sequence Model with Spatiotemporal Continuity for Quantifying 4DCT-based Pulmonary Ventilationcited by 0
- 2025LinguaSynth: Heterogeneous Linguistic Signals for News Classificationcited by 0
- 2025AI-Assisted Authoring for Transparent, Data-Driven Documentscited by 0
- 2025AI-Assisted Authoring for Transparent, Data-Driven Documents27 Oct 2025
- 2025LinguaSynth: Heterogeneous Linguistic Signals for News Classification27 Jun 2025
- 2025An Explainable Neural Radiomic Sequence Model with Spatiotemporal Continuity for Quantifying 4DCT-based Pulmonary Ventilation31 Mar 2025
- 2024Improving Long Text Understanding with Knowledge Distilled from Summarization Model8 May 2024
- 2023A Global Context Mechanism for Sequence Labeling31 May 2023
- 2023Multimodal Data Integration for Oncology in the Era of Deep Neural Networks: A Review11 Mar 2023
- 2022Graph-Based Multilingual Label Propagation for Low-Resource Part-of-Speech Tagging18 Oct 2022
- 2022Pre-Training a Graph Recurrent Network for Language Representation8 Sep 2022
- 2022BERTifying Sinhala -- A Comprehensive Analysis of Pre-trained Language Models for Sinhala Text Classification16 Aug 2022
- 2022InducT-GCN: Inductive Graph Convolutional Networks for Text Classification1 Jun 2022
- 2022Pruned Graph Neural Network for Short Story Ordering13 Mar 2022
- 2021Investigating Pose Representations and Motion Contexts Modeling for 3D Motion Prediction30 Dec 2021
10 more
- 2021Named entity recognition architecture combining contextual and global features15 Dec 2021
- 2021KARL-Trans-NER: Knowledge Aware Representation Learning for Named Entity Recognition using Transformers30 Nov 2021
- 2021Improving Graph-based Sentence Ordering with Iteratively Predicted Pairwise Orderings13 Oct 2021
- 2021Enhance Long Text Understanding via Distilled Gist Detector from Abstractive Summarization10 Oct 2021
- 2021Dual-State Capsule Networks for Text Classification10 Sep 2021
- 2021Exploring the Efficacy of Automatically Generated Counterfactuals for Sentiment Analysis29 Jun 2021
- 2021Fine-grained Geolocation Prediction of Tweets with Human Machine Collaboration25 Jun 2021
- 2021Graph Learning: A Survey3 May 2021
- 2021Better Feature Integration for Named Entity Recognition12 Apr 2021
- 2021Locally-Contextual Nonlinear CRFs for Sequence Labeling30 Mar 2021
- 2021Graph Learning: A Surveycited by 141
- 2021Investigating Pose Representations and Motion Contexts Modeling for 3D Motion Predictioncited by 31
- 2021Exploring the Efficacy of Automatically Generated Counterfactuals for Sentiment Analysiscited by 30
- 2021Better Feature Integration for Named Entity Recognitioncited by 22
- 2023Multimodal Data Integration for Oncology in the Era of Deep Neural Networks: A Reviewcited by 20
- 2022BERTifying Sinhala -- A Comprehensive Analysis of Pre-trained Language Models for Sinhala Text Classificationcited by 16
- 2022InducT-GCN: Inductive Graph Convolutional Networks for Text Classificationcited by 15
- 2021Enhance Long Text Understanding via Distilled Gist Detector from Abstractive Summarizationcited by 6
- 2021Improving Graph-based Sentence Ordering with Iteratively Predicted Pairwise Orderingscited by 4
- 2022Graph-Based Multilingual Label Propagation for Low-Resource Part-of-Speech Taggingcited by 4
- 2024Improving Long Text Understanding with Knowledge Distilled from Summarization Modelcited by 3
- 2021Locally-Contextual Nonlinear CRFs for Sequence Labelingcited by 2
12 most cited of 22 All 22 (JSON)
- 2025AI-Assisted Authoring for Transparent, Data-Driven Documents27 Oct 2025
- 2025LinguaSynth: Heterogeneous Linguistic Signals for News Classification27 Jun 2025
- 2025An Explainable Neural Radiomic Sequence Model with Spatiotemporal Continuity for Quantifying 4DCT-based Pulmonary Ventilation31 Mar 2025
- 2024Improving Long Text Understanding with Knowledge Distilled from Summarization Model8 May 2024
- 2023A Global Context Mechanism for Sequence Labeling31 May 2023
- 2023Multimodal Data Integration for Oncology in the Era of Deep Neural Networks: A Review11 Mar 2023
- 2022Graph-Based Multilingual Label Propagation for Low-Resource Part-of-Speech Tagging18 Oct 2022
- 2022Pre-Training a Graph Recurrent Network for Language Representation8 Sep 2022
- 2022BERTifying Sinhala -- A Comprehensive Analysis of Pre-trained Language Models for Sinhala Text Classification16 Aug 2022
- 2022InducT-GCN: Inductive Graph Convolutional Networks for Text Classification1 Jun 2022
- 2022Pruned Graph Neural Network for Short Story Ordering13 Mar 2022
- 2021Investigating Pose Representations and Motion Contexts Modeling for 3D Motion Prediction30 Dec 2021
12 newest of 22 All 22 (JSON)