Utilizing BERT Intermediate Layers for Aspect Based Sentiment Analysis and Natural Language Inference
Not on the map. Why?
Abstract (arXiv)
Aspect based sentiment analysis aims to identify the sentimental tendency towards a given aspect in text. Fine-tuning of pretrained BERT performs excellent on this task and achieves state-of-the-art performances. Existing BERT-based works only utilize the last output layer of BERT and ignore the semantic knowledge in the intermediate layers. This paper explores the potential of utilizing BERT intermediate layers to enhance the performance of fine-tuning of BERT. To the best of our knowledge, no existing work has been done on this research. To show the generality, we also apply this approach to a natural language inference task. Experimental results demonstrate the effectiveness and generality of the proposed approach.
Key facts. Cited by 14 papers in the map (data through 14 Oct 2026). First posted on arXiv 12 Feb 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 5; 2022: 4; 2023: 1; 2024: 3; 2025: 1.
14 papers.
Sort:
- 2021MentalBERT: Publicly Available Pretrained Language Models for Mental Healthcarecited by 161
- 2021Low-Dimensional Structure in the Space of Language Representations is Reflected in Brain Responsescited by 34
- 2021Evaluating Pre-Trained Models for User Feedback Analysis in Software Engineering: A Study on Classification of App-Reviewscited by 7
- 2021SILT: Efficient transformer training for inter-lingual inferencecited by 5
- 2023Transfer learning for conflict and duplicate detection in software requirement pairscited by 5
- 2022Visualizing and Explaining Language Modelscited by 4
- 2024Exploring Large Language Models and Hierarchical Frameworks for Classification of Large Unstructured Legal Documentscited by 4
- 2022BERT-Deep CNN: State-of-the-Art for Sentiment Analysis of COVID-19 Tweetscited by 2
- 2024Depression detection in social media posts using transformer-based models and auxiliary featurescited by 2
- 2022A multi-model-based deep learning framework for short text multiclass classification with the imbalanced and extremely small data setcited by 1
- 2022Aspect-specific Context Modeling for Aspect-based Sentiment Analysiscited by 1
- 2024Adaptive Large Language Models By Layerwise Attention Shortcutscited by 1
- 2025The Dream Within Huang Long Cave: AI-Driven Interactive Narrative for Family Storytelling and Emotional Reflection7 Apr 2025
- 2024Depression detection in social media posts using transformer-based models and auxiliary features30 Sep 2024
- 2024Adaptive Large Language Models By Layerwise Attention Shortcuts17 Sep 2024
- 2024Exploring Large Language Models and Hierarchical Frameworks for Classification of Large Unstructured Legal Documents11 Mar 2024
- 2023Transfer learning for conflict and duplicate detection in software requirement pairs9 Jan 2023
- 2022BERT-Deep CNN: State-of-the-Art for Sentiment Analysis of COVID-19 Tweets4 Nov 2022
- 2022Aspect-specific Context Modeling for Aspect-based Sentiment Analysis17 Jul 2022
- 2022A multi-model-based deep learning framework for short text multiclass classification with the imbalanced and extremely small data set24 Jun 2022
- 2022Visualizing and Explaining Language Models30 Apr 2022
- 2021MentalBERT: Publicly Available Pretrained Language Models for Mental Healthcare29 Oct 2021
- 2021Low-Dimensional Structure in the Space of Language Representations is Reflected in Brain Responses9 Jun 2021
- 2021T-BERT -- Model for Sentiment Analysis of Micro-blogs Integrating Topic Model and BERT2 Jun 2021
- 2021MentalBERT: Publicly Available Pretrained Language Models for Mental Healthcarecited by 161
- 2021Low-Dimensional Structure in the Space of Language Representations is Reflected in Brain Responsescited by 34
- 2021Evaluating Pre-Trained Models for User Feedback Analysis in Software Engineering: A Study on Classification of App-Reviewscited by 7
- 2021SILT: Efficient transformer training for inter-lingual inferencecited by 5
- 2023Transfer learning for conflict and duplicate detection in software requirement pairscited by 5
- 2022Visualizing and Explaining Language Modelscited by 4
- 2024Exploring Large Language Models and Hierarchical Frameworks for Classification of Large Unstructured Legal Documentscited by 4
- 2022BERT-Deep CNN: State-of-the-Art for Sentiment Analysis of COVID-19 Tweetscited by 2
- 2024Depression detection in social media posts using transformer-based models and auxiliary featurescited by 2
- 2022A multi-model-based deep learning framework for short text multiclass classification with the imbalanced and extremely small data setcited by 1
- 2022Aspect-specific Context Modeling for Aspect-based Sentiment Analysiscited by 1
- 2024Adaptive Large Language Models By Layerwise Attention Shortcutscited by 1
12 most cited of 14 All 14 (JSON)
- 2025The Dream Within Huang Long Cave: AI-Driven Interactive Narrative for Family Storytelling and Emotional Reflection7 Apr 2025
- 2024Depression detection in social media posts using transformer-based models and auxiliary features30 Sep 2024
- 2024Adaptive Large Language Models By Layerwise Attention Shortcuts17 Sep 2024
- 2024Exploring Large Language Models and Hierarchical Frameworks for Classification of Large Unstructured Legal Documents11 Mar 2024
- 2023Transfer learning for conflict and duplicate detection in software requirement pairs9 Jan 2023
- 2022BERT-Deep CNN: State-of-the-Art for Sentiment Analysis of COVID-19 Tweets4 Nov 2022
- 2022Aspect-specific Context Modeling for Aspect-based Sentiment Analysis17 Jul 2022
- 2022A multi-model-based deep learning framework for short text multiclass classification with the imbalanced and extremely small data set24 Jun 2022
- 2022Visualizing and Explaining Language Models30 Apr 2022
- 2021MentalBERT: Publicly Available Pretrained Language Models for Mental Healthcare29 Oct 2021
- 2021Low-Dimensional Structure in the Space of Language Representations is Reflected in Brain Responses9 Jun 2021
- 2021T-BERT -- Model for Sentiment Analysis of Micro-blogs Integrating Topic Model and BERT2 Jun 2021
12 newest of 14 All 14 (JSON)