mlsanityData to 7 Oct 2026

Human Values in a Single Sentence: Moral Presence, Hierarchies, and Transformer Ensembles on the Schwartz Continuum

arXiv 2601.14172 ↗First posted 20 Jan 2026cs.CL cs.AIcited by 3

Not on the map. Why?

Abstract (arXiv)

We study neural multi-label classification under severe label imbalance through sentence-level detection of the 19 refined Schwartz human values in 74k English news and manifesto sentences (ValueEval'24 corpus). Each sentence carries a roughly balanced moral-presence label and a 19-way value annotation. First, moral presence is learnable from single sentences: a DeBERTa-base classifier reaches positive-class F1 ≈ 0.73 at the default threshold, which calibration does not improve. Second, comparing direct multi-label detectors with presence-gated hierarchies under an 8 GB consumer-grade GPU budget, we find that gating does not improve over direct prediction, as gate recall becomes a bottleneck. Third, studying lightweight auxiliary signals and small ensembles, we isolate decision-threshold calibration as a decisive, often overlooked factor: a standard text-only baseline already matches the best official ValueEval'24 English run at the default threshold (macro-F1 = 0.282 vs. ≈ 0.28), and tuning the threshold on validation alone raises it to 0.315, most of our overall gain. Lightweight features do not survive a paired per-seed test; a soft-voting ensemble reaches our best macro-F1 = 0.332. Calibration is not architecture-specific: it reproduces on RoBERTa-base, where the gain is larger (+0.043). To our knowledge, this is the first systematic comparison of direct and presence-gated architectures, lightweight feature-augmented encoders, and instruction-tuned Large Language Models (LLMs) at sentence level; benchmarked 7-9B LLMs (zero-/few-shot and QLoRA) lag behind the supervised ensemble under the same budget. We provide empirical guidance for compute-efficient, value-aware NLP models.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 29 of its 76 references that are in the map. First posted on arXiv 20 Jan 2026.

Builds on

29 of 76 references.

References · 29

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2022Training language models to follow instructions with human feedbackcited by 15,712
  3. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  4. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
  5. 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,747
  6. 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,355
  7. 2019Optuna: A Next-generation Hyperparameter Optimization Frameworkcited by 2,455
  8. 2020DeBERTa: Decoding-enhanced BERT with Disentangled Attentioncited by 2,157
  9. 2020MiniLM: Deep Self-Attention Distillation for Task-Agnostic Compression of Pre-Trained Transformerscited by 1,414
  10. 2023ChatGPT Outperforms Crowd-Workers for Text-Annotation Taskscited by 849
  11. 2022BERTopic: Neural topic modeling with a class-based TF-IDF procedurecited by 779
  12. 2020Stance Detection on Social Media: State of the Art and Trendscited by 93
17 more
  1. 2017Latent Dirichlet Allocation (LDA) and Topic modeling: models, applications, a surveycited by 90
  2. 2023Value FULCRA: Mapping Large Language Models to the Multidimensional Spectrum of Basic Human Valuescited by 49
  3. 2023The Touch'e23-ValueEval Dataset for Identifying Human Values behind Argumentscited by 27
  4. 2024MoralBERT: A Fine-Tuned Language Model for Capturing Moral Values in Social Discussionscited by 23
  5. 2024ValueCompass: A Framework for Measuring Contextual Value Alignment Between Human and LLMscited by 20
  6. 2021Interpretable Propaganda Detection in News Articlescited by 16
  7. 2024Do LLMs have Consistent Values?cited by 13
  8. 2024Measuring Human and AI Values Based on Generative Psychometrics with Large Language Modelscited by 13
  9. 2024Investigating Human Values in Online Communitiescited by 10
  10. 2025MoVa: Towards Generalizable Classification of Human Morals and Valuescited by 7
  11. 2023Enhancing Stance Classification on Social Media Using Quantified Moral Foundationscited by 4
  12. 2024Fine-tuning vs Prompting, Can Language Models Understand Human Values?cited by 4
  13. 2025The Value of Nothing: Multimodal Extraction of Human Values Expressed by TikTok Influencerscited by 4
  14. 2025EAVIT: Efficient and Accurate Human Value Identification from Text data via LLMscited by 4
  15. 2025Value Alignment of Social Media Ranking Algorithmscited by 4
  16. 2024An Empirical Study of Large Language Models for Type and Call Graph Analysis in Python and JavaScriptcited by 3
  17. 2025Beyond Sentiment: Examining the Role of Moral Foundations in User Engagement with News on Twittercited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 3.

3 papers.