Improved Semantic Representations From Tree-Structured Long Short-Term Memory Networks
Not on the map. Why?
Abstract (arXiv)
Because of their superior ability to preserve sequence information over time, Long Short-Term Memory (LSTM) networks, a type of recurrent neural network with a more complex computational unit, have obtained strong results on a variety of sequence modeling tasks. The only underlying LSTM structure that has been explored so far is a linear chain. However, natural language exhibits syntactic properties that would naturally combine words to phrases. We introduce the Tree-LSTM, a generalization of LSTMs to tree-structured network topologies. Tree-LSTMs outperform all existing systems and strong LSTM baselines on two tasks: predicting the semantic relatedness of two sentences (SemEval 2014, Task 1) and sentiment classification (Stanford Sentiment Treebank).
Key facts. Cited by 305 papers in the map (data through 7 Oct 2026). First posted on arXiv 28 Feb 2015.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 108; 2022: 66; 2023: 56; 2024: 27; 2025: 32; 2026: 16.
305 papers.
Sort:
By area:
- 2021A Survey on Automated Fact-Checkingcited by 376
- 2021TransVG: End-to-End Visual Grounding with Transformerscited by 269
- 2022Learning on Large-scale Text-attributed Graphs via Variational Inferencecited by 153
- 2021A Comprehensive Survey of Scene Graphs: Generation and Applicationcited by 125
- 2022A Survey of Deep Learning for Mathematical Reasoningcited by 124
- 2022Generative Flow Networks for Discrete Probabilistic Modelingcited by 113
- 2021Directed Acyclic Graph Network for Conversational Emotion Recognitioncited by 97
- 2021A Review of the Gumbel-max Trick and its Extensions for Discrete Stochasticity in Machine Learningcited by 82
- 2023SpikeGPT: Generative Pre-trained Language Model with Spiking Neural Networkscited by 82
- 2022Scene Graph Generation: A Comprehensive Surveycited by 73
- 2021Recovering the Unbiased Scene Graphs from the Biased Onescited by 71
- 2021Directed Acyclic Graph Neural Networkscited by 70
38 more
- 2024Repetition Improves Language Model Embeddingscited by 70
- 2021Language-Agnostic Representation Learning of Source Code from Structure and Contextcited by 63
- 2021SynCoBERT: Syntax-Guided Multi-Modal Contrastive Pre-Training for Code Representationcited by 63
- 2021A Review of Graph Neural Networks and Their Applications in Power Systemscited by 62
- 2022Testing Relational Understanding in Text-Guided Image Generationcited by 59
- 2021Fully Convolutional Scene Graph Generationcited by 57
- 2024A Survey on Deep Learning for Theorem Provingcited by 55
- 2023Grokking of Hierarchical Structure in Vanilla Transformerscited by 53
- 2021Adversarial Text-to-Image Synthesis: A Reviewcited by 52
- 2021Complex Knowledge Base Question Answering: A Surveycited by 52
- 2021Syntax-BERT: Improving Pre-trained Transformers with Syntax Treescited by 51
- 2021Look Before You Leap: Learning Landmark Features for One-Stage Visual Groundingcited by 51
- 2021Integrating Visuospatial, Linguistic and Commonsense Structure into Story Visualizationcited by 51
- 2024Towards a Foundation Model for Partial Differential Equations: Multi-Operator Learning and Extrapolationcited by 45
- 2023RAP-Gen: Retrieval-Augmented Patch Generation with CodeT5 for Automatic Program Repaircited by 43
- 2022TransVG++: End-to-End Visual Grounding with Language Conditioned Vision Transformercited by 41
- 2022Transformer Grammars: Augmenting Transformer Language Models with Syntactic Inductive Biases at Scalecited by 40
- 2022Characterizing Intrinsic Compositionality in Transformers with Tree Projectionscited by 40
- 2023SceneHGN: Hierarchical Graph Networks for 3D Indoor Scene Generation with Fine-Grained Geometrycited by 38
- 2022On the Explainability of Natural Language Processing Deep Modelscited by 37
- 2021Evaluation of BERT and ALBERT Sentence Embedding Performance on Downstream NLP Taskscited by 32
- 2021Improving Cross-Modal Alignment in Vision Language Navigation via Syntactic Informationcited by 31
- 2021Learning Algebraic Recombination for Compositional Generalizationcited by 31
- 2021Sequence-to-Sequence Learning with Latent Neural Grammarscited by 30
- 2021Structured Sentiment Analysis as Dependency Graph Parsingcited by 28
- 2021Meta-Calibration: Learning of Model Calibration Using Differentiable Expected Calibration Errorcited by 28
- 2023ChatGraph: Interpretable Text Classification by Converting ChatGPT Knowledge to Graphscited by 27
- 2021Substructure Substitution: Structured Data Augmentation for NLPcited by 25
- 2021Segmentation-grounded Scene Graph Generationcited by 25
- 2021Curvature Graph Neural Networkcited by 24
- 2022Transformers over Directed Acyclic Graphscited by 23
- 2021End-to-end Semantic Role Labeling with Neural Transition-based Modelcited by 22
- 2022Knowledge Base Question Answering: A Semantic Parsing Perspectivecited by 22
- 2022Graph Neural Networks for Moleculescited by 21
- 2021Improving Code Summarization with Block-wise Abstract Syntax Tree Splittingcited by 19
- 2021R2D2: Recursive Transformer based on Differentiable Tree for Interpretable Hierarchical Language Modelingcited by 19
- 2021Multiplex Graph Neural Network for Extractive Text Summarizationcited by 19
- 2021ProTo: Program-Guided Transformer for Program-Guided Taskscited by 19
50 most cited of 305 All 305 (JSON)
- 2026From Rules to Neural Graphs: Scalable Structured Prediction for Patent Prior Art Search1 Oct 2026
- 2026Log-Depth Recurrent Language Modeling23 Sep 2026
- 2026DeepTable: Structural Attention Biases and Tree Path Encoding for Hierarchical Table Understanding7 Sep 2026
- 2026CLEARMIND: Closed-Form Laplacian Embeddings of Arakelov-Green Resistance for Morphological Intrinsic Neuronal Distances5 Aug 2026
- 2026Length Generalization with Log-Depth Recurrent Units25 May 2026
- 2026Parallel Recursive LSTM16 May 2026
- 2026A Hierarchical Language Model with Predictable Scaling Laws and Provable Benefits of Reasoning13 May 2026
- 2026The Association of Transformer-based Sentiment Analysis with Symptom Distress and Deterioration in Routine Psychotherapy Care11 May 2026
- 2026Region4Web: Rethinking Observation Space Granularity for Web Agents8 May 2026
- 2026MTA: Multi-Granular Trajectory Alignment for Large Language Model Distillation2 May 2026
- 2026Circuit Complexity of Hierarchical Knowledge Tracing and Implications for Log-Precision Transformers25 Mar 2026
- 2026Phishing the Phishers with SpecularNet: Hierarchical Graph Autoencoding for Reference-Free Web Phishing Detection2 Mar 2026
38 more
- 2026Wave-Attractor-Tree: A Hierarchical Binary Tree Reduction Architecture for Efficient Sequence Modeling28 Feb 2026
- 2026Entropy-Aware Structural Alignment for Zero-Shot Handwritten Chinese Character Recognition3 Feb 2026
- 2026Alpha Discovery via Grammar-Guided Learning and Search29 Jan 2026
- 2026Gated Tree Cross-Attention for Checkpoint-Compatible Syntax Injection in Decoder-Only LLMs23 Jan 2026
- 2025MS-SSM: A Multi-Scale State Space Model for Efficient Sequence Modeling29 Dec 2025
- 2025PI-MFM: Physics-informed multimodal foundation model for solving partial differential equations28 Dec 2025
- 2025Tree Meets Transformer: A Hybrid Architecture for Scalable Power Allocation in Cell-Free Networks27 Dec 2025
- 2025SMART SLM: Structured Memory and Reasoning Transformer, A Small Language Model for Accurate Document Assistance24 Dec 2025
- 2025Blood Pressure Prediction for Coronary Artery Disease Diagnosis using Coronary Computed Tomography Angiography11 Dec 2025
- 2025Edged Weisfeiler-Lehman Algorithm4 Dec 2025
- 2025DyFuLM: An Advanced Multimodal Framework for Sentiment Analysis1 Dec 2025
- 2025Tree Matching Networks for Natural Language Inference: Parameter-Efficient Semantic Understanding via Dependency Parse Trees28 Nov 2025
- 2025STED and Consistency Scoring: A Framework for Evaluating LLM Structured Output Reliability27 Nov 2025
- 2025Neurocircuitry-Inspired Hierarchical Graph Causal Attention Networks for Explainable Depression Identification18 Nov 2025
- 2025Inferring Group Intent as a Cooperative Game. An NLP-based Framework for Trajectory Analysis27 Oct 2025
- 2025Beyond Words: Enhancing Desire, Emotion, and Sentiment Recognition with Non-Verbal Cues19 Sep 2025
- 2025Weakly Supervised Vulnerability Localization via Multiple Instance Learning14 Sep 2025
- 2025Tree-Based Deep Learning for Ranking Symbolic Integration Algorithms8 Aug 2025
- 2025v-PuNNs: van der Put Neural Networks for Transparent Ultrametric Representation Learning1 Aug 2025
- 2025Scalable Generative Modeling of Weighted Graphs30 Jul 2025
- 2025Composing Linear Layers from Irreducibles15 Jul 2025
- 2025Seamlessly Integrating Tree-Based Positional Embeddings into Transformer Models for Source Code Representation5 Jul 2025
- 2025LLM4Hint: Leveraging Large Language Models for Hint Recommendation in Offline Query Optimization4 Jul 2025
- 2025pLSTM: parallelizable Linear Source Transition Mark networks13 Jun 2025
- 2025TeLoGraF: Temporal Logic Planning via Graph-encoded Flow Matching1 May 2025
- 2025Transformers for Complex Query Answering over Knowledge Hypergraphs23 Apr 2025
- 2025Bringing Structure to Naturalness: On the Naturalness of ASTs11 Apr 2025
- 2025From Text to Graph: Leveraging Graph Neural Networks for Enhanced Explainability in NLP2 Apr 2025
- 2025GIN-Graph: A Generative Interpretation Network for Model-Level Explanation of Graph Neural Networks8 Mar 2025
- 2025HREB-CRF: Hierarchical Reduced-bias EMA for Chinese Named Entity Recognition3 Mar 2025
- 2025Towards Human Cognition: Visual Context Guides Syntactic Priming in Fusion-Encoded Models24 Feb 2025
- 2025DEFT: Differentiable Branched Discrete Elastic Rods for Modeling Furcated DLOs in Real-Time20 Feb 2025
- 2025Solving Online Resource-Constrained Scheduling for Follow-Up Observation in Astronomy: a Reinforcement Learning Approach16 Feb 2025
- 2025Enhancing Video Understanding: Deep Neural Networks for Spatiotemporal Analysis11 Feb 2025
- 2025Reqo: A Comprehensive Learning-Based Cost Model for Robust and Explainable Query Optimization29 Jan 2025
- 2025UniQ: Unified Decoder with Task-specific Queries for Efficient Scene Graph Generation10 Jan 2025
- 2024Compositional Generalization Across Distributional Shifts with Sparse Tree Operations18 Dec 2024
- 2024Sneaking Syntax into Transformer Language Models with Tree Regularization28 Nov 2024
50 newest of 305 All 305 (JSON)
- 2022A Survey of Deep Learning for Mathematical Reasoningcited by 124
- 2022Type-aware Embeddings for Multi-Hop Reasoning over Knowledge Graphscited by 13
- 2026Region4Web: Rethinking Observation Space Granularity for Web Agentscited by 1
- 2025SMART SLM: Structured Memory and Reasoning Transformer, A Small Language Model for Accurate Document Assistancecited by 0
- 2026Region4Web: Rethinking Observation Space Granularity for Web Agents8 May 2026
- 2025SMART SLM: Structured Memory and Reasoning Transformer, A Small Language Model for Accurate Document Assistance24 Dec 2025
- 2022A Survey of Deep Learning for Mathematical Reasoning20 Dec 2022
- 2022Type-aware Embeddings for Multi-Hop Reasoning over Knowledge Graphs2 May 2022
- 2025pLSTM: parallelizable Linear Source Transition Mark networks13 Jun 2025
- 2021A Survey on Automated Fact-Checkingcited by 376
- 2021TransVG: End-to-End Visual Grounding with Transformerscited by 269
- 2022Learning on Large-scale Text-attributed Graphs via Variational Inferencecited by 153
- 2021A Comprehensive Survey of Scene Graphs: Generation and Applicationcited by 125
- 2022Generative Flow Networks for Discrete Probabilistic Modelingcited by 113
- 2021Directed Acyclic Graph Network for Conversational Emotion Recognitioncited by 97
- 2021A Review of the Gumbel-max Trick and its Extensions for Discrete Stochasticity in Machine Learningcited by 82
- 2023SpikeGPT: Generative Pre-trained Language Model with Spiking Neural Networkscited by 82
- 2022Scene Graph Generation: A Comprehensive Surveycited by 73
- 2021Recovering the Unbiased Scene Graphs from the Biased Onescited by 71
- 2021Directed Acyclic Graph Neural Networkscited by 70
- 2024Repetition Improves Language Model Embeddingscited by 70
12 most cited of 295 All 295 (JSON)
- 2026From Rules to Neural Graphs: Scalable Structured Prediction for Patent Prior Art Search1 Oct 2026
- 2026Log-Depth Recurrent Language Modeling23 Sep 2026
- 2026DeepTable: Structural Attention Biases and Tree Path Encoding for Hierarchical Table Understanding7 Sep 2026
- 2026CLEARMIND: Closed-Form Laplacian Embeddings of Arakelov-Green Resistance for Morphological Intrinsic Neuronal Distances5 Aug 2026
- 2026Length Generalization with Log-Depth Recurrent Units25 May 2026
- 2026Parallel Recursive LSTM16 May 2026
- 2026A Hierarchical Language Model with Predictable Scaling Laws and Provable Benefits of Reasoning13 May 2026
- 2026The Association of Transformer-based Sentiment Analysis with Symptom Distress and Deterioration in Routine Psychotherapy Care11 May 2026
- 2026Circuit Complexity of Hierarchical Knowledge Tracing and Implications for Log-Precision Transformers25 Mar 2026
- 2026Phishing the Phishers with SpecularNet: Hierarchical Graph Autoencoding for Reference-Free Web Phishing Detection2 Mar 2026
- 2026Wave-Attractor-Tree: A Hierarchical Binary Tree Reduction Architecture for Efficient Sequence Modeling28 Feb 2026
- 2026Entropy-Aware Structural Alignment for Zero-Shot Handwritten Chinese Character Recognition3 Feb 2026
12 newest of 295 All 295 (JSON)