mlsanityData to 7 Oct 2026

The Touch'e23-ValueEval Dataset for Identifying Human Values behind Arguments

arXiv 2301.13771 ↗First posted 31 Jan 2023cs.CLcited by 27

Not on the map. Why?

Abstract (arXiv)

We present the Touch'e23-ValueEval Dataset for Identifying Human Values behind Arguments. To investigate approaches for the automated detection of human values behind arguments, we collected 9324 arguments from 6 diverse sources, covering religious texts, political discussions, free-text arguments, newspaper editorials, and online democracy platforms. Each argument was annotated by 3 crowdworkers for 54 values. The Touch'e23-ValueEval dataset extends the Webis-ArgValues-22. In comparison to the previous dataset, the effectiveness of a 1-Baseline decreases, but that of an out-of-the-box BERT model increases. Therefore, though the classification difficulty increased as per the label distribution, the larger dataset allows for training better models.

Key facts. Cited by 27 papers in the map (data through 7 Oct 2026). Builds on 6 of its 30 references that are in the map. First posted on arXiv 31 Jan 2023.

Builds on

6 of 30 references.

References · 6

  1. 2020Social Chemistry 101: Learning to Reason about Social and Moral Normscited by 253
  2. 2020ParsBERT: Transformer-based Model for Persian Language Understandingcited by 92
  3. 2019A Large-scale Dataset for Argument Quality Ranking: Construction and Analysiscited by 66
  4. 2021ValueNet: A New Dataset for Human Value Driven Dialogue Systemcited by 34
  5. 2022Aligning to Social Norms and Values in Interactive Narrativescited by 32
  6. 2023Second Thoughts are Best: Learning to Re-Align With Human Values from Text Editscited by 27

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 6; 2024: 5; 2025: 7; 2026: 9.

27 papers.

Sort:

By area:

  1. 2023The Past, Present and Better Future of Feedback Learning in Large Language Models for Subjective Human Preferences and Valuescited by 53
  2. 2025Value Portrait: Assessing Language Models' Values through Psychometrically and Ecologically Valid Itemscited by 18
  3. 2024Measuring Human and AI Values Based on Generative Psychometrics with Large Language Modelscited by 13
  4. 2023From Values to Opinions: Predicting Human Behaviors and Stances Using Value-Injected Large Language Modelscited by 10
  5. 2023Adam-Smith at SemEval-2023 Task 4: Discovering Human Values in Arguments with Ensembles of Transformer-based Modelscited by 6
  6. 2025Unintended Harms of Value-Aligned LLMs: Psychological and Empirical Insightscited by 6
  7. 2025Counterfactual Reasoning for Steerable Pluralistic Value Alignment of Large Language Modelscited by 5
  8. 2023Epicurus at SemEval-2023 Task 4: Improving Prediction of Human Values behind Arguments by Leveraging Their Definitionscited by 4
  9. 2024MAGPIE: Multi-Task Media-Bias Analysis Generalization for Pre-Trained Identification of Expressionscited by 4
  10. 2025AdAEM: An Adaptively and Automated Extensible Measurement of LLMs' Value Differencecited by 4
  11. 2026Human Values in a Single Sentence: Moral Presence, Hierarchies, and Transformer Ensembles on the Schwartz Continuumcited by 3
  12. 2026Do Schwartz Higher-Order Values Help Sentence-Level Human Value Detection? A Study of Hierarchical Gating and Calibrationcited by 3
15 more
  1. 2023Rudolf Christoph Eucken at SemEval-2023 Task 4: An Ensemble Approach for Identifying Human Values from Argumentscited by 2
  2. 2024Consolidating Strategies for Countering Hate Speech Using Persuasive Dialoguescited by 2
  3. 2025From Argumentation to Deliberation: Perspectivized Stance Vectors for Fine-grained (Dis)agreement Analysiscited by 2
  4. 2025Will Annotators Disagree? Identifying Subjectivity in Value-Laden Argumentscited by 2
  5. 2026Measuring Human Value Expression in Social Media Texts: Calibrated LLM Annotation and Encoder Transfercited by 2
  6. 2023Detecting value-expressive text posts in Russian social mediacited by 1
  7. 2024Explainable Moral Values: a neuro-symbolic approach to value classificationcited by 1
  8. 2026Growth First, Care Second? Tracing the Landscape of LLM Value Preferences in Everyday Dilemmascited by 1
  9. 2026More Context, Larger Models, or Moral Knowledge? A Systematic Study of Schwartz Value Detection in Political Textscited by 1
  10. 2026KVpop -- Key-Value Cache Compression with Predictive Online Pruningcited by 1
  11. 2024Fantastic Biases (What are They) and Where to Find Themcited by 0
  12. 2025Prompt-Based Value Steering of Large Language Modelscited by 0
  13. 2026Event-Centric Human Value Understanding in News-Domain Texts: An Actor-Conditioned, Multi-Granularity Benchmarkcited by 0
  14. 2026Which Values Do LLMs Confuse? A Schwartz-Based Recognition Studycited by 0
  15. 2026Steering Geometry: Validating Human Value Geometry in LLM Steering Spacecited by 0