A Survey on Moral Foundation Theory and Pre-Trained Language Models: Current Advances and Challenges
Not on the map. Why?
Abstract (arXiv)
Moral values have deep roots in early civilizations, codified within norms and laws that regulated societal order and the common good. They play a crucial role in understanding the psychological basis of human behavior and cultural orientation. The Moral Foundation Theory (MFT) is a well-established framework that identifies the core moral foundations underlying the manner in which different cultures shape individual and social lives. Recent advancements in natural language processing, particularly Pre-trained Language Models (PLMs), have enabled the extraction and analysis of moral dimensions from textual data. This survey presents a comprehensive review of MFT-informed PLMs, providing an analysis of moral tendencies in PLMs and their application in the context of the MFT. We also review relevant datasets and lexicons and discuss trends, limitations, and future directions. By providing a structured overview of the intersection between PLMs and MFT, this work bridges moral psychology insights within the realm of PLMs, paving the way for further research and development in creating morally aware AI systems.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 53 of its 103 references that are in the map. First posted on arXiv 20 Sep 2024.
Builds on
53 of 103 references.
References · 53
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
- 2014Explaining and Harnessing Adversarial Examplescited by 7,287
- 2020Learning to summarize from human feedbackcited by 2,562
- 2023A Survey on Evaluation of Large Language Modelscited by 1,227
- 2017Automated Hate Speech Detection and the Problem of Offensive Languagecited by 724
- 2023OpenAssistant Conversations -- Democratizing Large Language Model Alignmentcited by 712
38 more
- 2023Bias and Fairness in Large Language Models: A Surveycited by 626
- 2021Recent Advances in Natural Language Processing via Large Pre-Trained Language Models: A Surveycited by 457
- 2021A Survey of Transformerscited by 399
- 2023Exploring the Potential of Large Language Models (LLMs) in Learning on Graphscited by 271
- 2020Social Chemistry 101: Learning to Reason about Social and Moral Normscited by 253
- 2023Evaluating Large Language Models: A Comprehensive Surveycited by 200
- 2021Large Pre-trained Language Models Contain Human-like Biases of What is Right and Wrong to Docited by 178
- 2024Towards Measuring and Modeling "Culture" in LLMs: A Surveycited by 166
- 2023Cultural Bias and Cultural Alignment of Large Language Modelscited by 149
- 2021Can Machines Learn Morality? The Delphi Experimentcited by 140
- 2022The Ghost in the Machine has an American accent: value conflict in GPT-3cited by 105
- 2021UNICORN on RAINBOW: A Universal Commonsense Reasoning Model on a New Multitask Benchmarkcited by 98
- 2022When to Make Exceptions: Exploring Language Models as Accounts of Human Moral Judgmentcited by 93
- 2022The Moral Integrity Corpus: A Benchmark for Ethical Dialogue Systemscited by 92
- 2023Moral Foundations of Large Language Modelscited by 84
- 2022Moral Mimicry: Large Language Models Produce Moral Rationalizations Tailored to Political Identitycited by 71
- 2020SqueezeBERT: What can computer vision teach NLP about efficient neural networks?cited by 50
- 2022POLITICS: Pretraining with Same-story Article Comparison for Ideology Prediction and Stance Detectioncited by 50
- 2022Speaking Multiple Languages Affects the Moral Bias of Language Modelscited by 34
- 2019MoralStrength: Exploiting a Moral Lexicon and Embedding Similarity for Moral Foundations Predictioncited by 31
- 2022Does Moral Code Have a Moral Code? Probing Delphi's Moral Philosophycited by 31
- 2024Large Language Models are as persuasive as humans, but how? About the cognitive effort and moral-emotional language of LLM argumentscited by 30
- 2024MoralBERT: A Fine-Tuned Language Model for Capturing Moral Values in Social Discussionscited by 23
- 2022The Moral Debater: A Study on the Computational Generation of Morally Framed Argumentscited by 22
- 2022The Moral Foundations Reddit Corpuscited by 20
- 2024Whose Emotions and Moral Sentiments Do Language Models Reflect?cited by 20
- 2024Are Large Language Models Moral Hypocrites? A Study Based on Moral Foundationscited by 19
- 2022A Holistic Framework for Analyzing the COVID-19 Vaccine Debatecited by 18
- 2020Modeling Content and Context with Deep Relational Learningcited by 16
- 2023A Data Fusion Framework for Multi-Domain Morality Learningcited by 14
- 2023Leveraging Large Language Models to Detect Influence Campaigns in Social Mediacited by 13
- 2023Measuring Moral Dimensions in Social Media with Mformercited by 13
- 2023Social-LLM: Modeling User Behavior at Scale using Language Models and Social Network Datacited by 11
- 2024Contextual Moral Value Alignment Through Context-Based Aggregationcited by 10
- 2022Noise Audits Improve Moral Foundation Classificationcited by 7
- 2020Contextualized moral inferencecited by 6
- 2022Moral Narratives Around the Vaccination Debate on Facebookcited by 6
- 2023Pandemic Culture Wars: Partisan Differences in the Moral Language of COVID-19 Discussionscited by 6
50 most cited of 53 All 53 (JSON)
Built on by
Citing papers per year: 2025: 1; 2026: 2.
3 papers.