Towards Few-Shot Identification of Morality Frames using In-Context Learning
Not on the map. Why?
Abstract (arXiv)
Data scarcity is a common problem in NLP, especially when the annotation pertains to nuanced socio-linguistic concepts that require specialized knowledge. As a result, few-shot identification of these concepts is desirable. Few-shot in-context learning using pre-trained Large Language Models (LLMs) has been recently applied successfully in many NLP tasks. In this paper, we study few-shot identification of a psycho-linguistic concept, Morality Frames (Roy et al., 2021), using LLMs. Morality frames are a representation framework that provides a holistic view of the moral sentiment expressed in text, identifying the relevant moral foundation (Haidt and Graham, 2007) and at a finer level of granularity, the moral sentiment expressed towards the entities mentioned in the text. Previous studies relied on human annotation to identify morality frames in text which is expensive. In this paper, we propose prompting-based approaches using pretrained Large Language Models for identification of morality frames, relying only on few-shot exemplars. We compare our models' performance with few-shot RoBERTa and found promising results.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 23 of its 33 references that are in the map. First posted on arXiv 3 Feb 2023.
Builds on
23 of 33 references.
References · 23
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
- 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,747
- 2019The Curious Case of Neural Text Degenerationcited by 2,881
- 2022Survey of Hallucination in Natural Language Generationcited by 2,056
- 2021Multitask Prompted Training Enables Zero-Shot Task Generalizationcited by 1,462
- 2021Calibrate Before Use: Improving Few-Shot Performance of Language Modelscited by 1,371
- 2020Making Pre-trained Language Models Better Few-shot Learnerscited by 1,255
- 2020Language (Technology) is Power: A Critical Survey of "Bias" in NLPcited by 951
- 2020Exploiting Cloze Questions for Few Shot Text Classification and Natural Language Inferencecited by 934
11 more
- 2021Cross-Task Generalization via Natural Language Crowdsourcing Instructionscited by 696
- 2021Recent Advances in Natural Language Processing via Large Pre-Trained Language Models: A Surveycited by 457
- 2021MetaICL: Learning to Learn In Contextcited by 450
- 2021Noisy Channel Language Model Prompting for Few-Shot Text Classificationcited by 163
- 2021A Recipe For Arbitrary Text Style Transfer with Large Language Modelscited by 107
- 2018Framing and Agenda-setting in Russian News: a Computational Analysis of Intricate Political Strategiescited by 47
- 2022Meet Your Favorite Character: Open-domain Chatbot Mimicking Fictional Characters with only a Few Utterancescited by 32
- 2020Weakly Supervised Learning of Nuanced Frames for Analyzing Polarization in News Mediacited by 27
- 2021Identifying Morality Frames in Political Tweets using Relational Learningcited by 26
- 2022A Holistic Framework for Analyzing the COVID-19 Vaccine Debatecited by 18
- 2020Modeling Content and Context with Deep Relational Learningcited by 16
Built on by
Citing papers per year: 2023: 1; 2024: 1; 2025: 4.
6 papers.
- 2023PlatoLM: Teaching LLMs in Multi-Round Dialogue via a User Simulatorcited by 28
- 2024Eagle: Ethical Dataset Given from Real Interactionscited by 3
- 2025The Moralization Corpus: Frame-Based Annotation and Analysis of Moralizing Speech Acts across Diverse Text Genrescited by 2
- 2025Can LLMs Assist Annotators in Identifying Morality Frames? -- Case Study on Vaccination Debate on Social Mediacited by 1
- 2025Mapping the Course for Prompt-based Structured Predictioncited by 1
- 2025Visual moral inference and communicationcited by 0
- 2025The Moralization Corpus: Frame-Based Annotation and Analysis of Moralizing Speech Acts across Diverse Text Genres17 Dec 2025
- 2025Mapping the Course for Prompt-based Structured Prediction20 Aug 2025
- 2025Visual moral inference and communication12 Apr 2025
- 2025Can LLMs Assist Annotators in Identifying Morality Frames? -- Case Study on Vaccination Debate on Social Media4 Feb 2025
- 2024Eagle: Ethical Dataset Given from Real Interactions22 Feb 2024
- 2023PlatoLM: Teaching LLMs in Multi-Round Dialogue via a User Simulator21 Aug 2023