Human Values in a Single Sentence: Moral Presence, Hierarchies, and Transformer Ensembles on the Schwartz Continuum
Not on the map. Why?
Abstract (arXiv)
We study neural multi-label classification under severe label imbalance through sentence-level detection of the 19 refined Schwartz human values in 74k English news and manifesto sentences (ValueEval'24 corpus). Each sentence carries a roughly balanced moral-presence label and a 19-way value annotation. First, moral presence is learnable from single sentences: a DeBERTa-base classifier reaches positive-class F1 ≈ 0.73 at the default threshold, which calibration does not improve. Second, comparing direct multi-label detectors with presence-gated hierarchies under an 8 GB consumer-grade GPU budget, we find that gating does not improve over direct prediction, as gate recall becomes a bottleneck. Third, studying lightweight auxiliary signals and small ensembles, we isolate decision-threshold calibration as a decisive, often overlooked factor: a standard text-only baseline already matches the best official ValueEval'24 English run at the default threshold (macro-F1 = 0.282 vs. ≈ 0.28), and tuning the threshold on validation alone raises it to 0.315, most of our overall gain. Lightweight features do not survive a paired per-seed test; a soft-voting ensemble reaches our best macro-F1 = 0.332. Calibration is not architecture-specific: it reproduces on RoBERTa-base, where the gain is larger (+0.043). To our knowledge, this is the first systematic comparison of direct and presence-gated architectures, lightweight feature-augmented encoders, and instruction-tuned Large Language Models (LLMs) at sentence level; benchmarked 7-9B LLMs (zero-/few-shot and QLoRA) lag behind the supervised ensemble under the same budget. We provide empirical guidance for compute-efficient, value-aware NLP models.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 29 of its 76 references that are in the map. First posted on arXiv 20 Jan 2026.
Builds on
29 of 76 references.
References · 29
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
- 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,747
- 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,355
- 2019Optuna: A Next-generation Hyperparameter Optimization Frameworkcited by 2,455
- 2020DeBERTa: Decoding-enhanced BERT with Disentangled Attentioncited by 2,157
- 2020MiniLM: Deep Self-Attention Distillation for Task-Agnostic Compression of Pre-Trained Transformerscited by 1,414
- 2023ChatGPT Outperforms Crowd-Workers for Text-Annotation Taskscited by 849
- 2022BERTopic: Neural topic modeling with a class-based TF-IDF procedurecited by 779
- 2020Stance Detection on Social Media: State of the Art and Trendscited by 93
17 more
- 2017Latent Dirichlet Allocation (LDA) and Topic modeling: models, applications, a surveycited by 90
- 2023Value FULCRA: Mapping Large Language Models to the Multidimensional Spectrum of Basic Human Valuescited by 49
- 2023The Touch'e23-ValueEval Dataset for Identifying Human Values behind Argumentscited by 27
- 2024MoralBERT: A Fine-Tuned Language Model for Capturing Moral Values in Social Discussionscited by 23
- 2024ValueCompass: A Framework for Measuring Contextual Value Alignment Between Human and LLMscited by 20
- 2021Interpretable Propaganda Detection in News Articlescited by 16
- 2024Do LLMs have Consistent Values?cited by 13
- 2024Measuring Human and AI Values Based on Generative Psychometrics with Large Language Modelscited by 13
- 2024Investigating Human Values in Online Communitiescited by 10
- 2025MoVa: Towards Generalizable Classification of Human Morals and Valuescited by 7
- 2023Enhancing Stance Classification on Social Media Using Quantified Moral Foundationscited by 4
- 2024Fine-tuning vs Prompting, Can Language Models Understand Human Values?cited by 4
- 2025The Value of Nothing: Multimodal Extraction of Human Values Expressed by TikTok Influencerscited by 4
- 2025EAVIT: Efficient and Accurate Human Value Identification from Text data via LLMscited by 4
- 2025Value Alignment of Social Media Ranking Algorithmscited by 4
- 2024An Empirical Study of Large Language Models for Type and Call Graph Analysis in Python and JavaScriptcited by 3
- 2025Beyond Sentiment: Examining the Role of Moral Foundations in User Engagement with News on Twittercited by 1
Built on by
Citing papers per year: 2026: 3.
3 papers.
- 2026Do Schwartz Higher-Order Values Help Sentence-Level Human Value Detection? A Study of Hierarchical Gating and Calibrationcited by 3
- 2026More Context, Larger Models, or Moral Knowledge? A Systematic Study of Schwartz Value Detection in Political Textscited by 1
- 2026KVpop -- Key-Value Cache Compression with Predictive Online Pruningcited by 1
- 2026KVpop -- Key-Value Cache Compression with Predictive Online Pruning6 Jul 2026
- 2026More Context, Larger Models, or Moral Knowledge? A Systematic Study of Schwartz Value Detection in Political Texts21 May 2026
- 2026Do Schwartz Higher-Order Values Help Sentence-Level Human Value Detection? A Study of Hierarchical Gating and Calibration31 Jan 2026