Event-Centric Human Value Understanding in News-Domain Texts: An Actor-Conditioned, Multi-Granularity Benchmark
Not on the map. Why?
Abstract (arXiv)
Existing human value datasets do not directly support value understanding in factual news: many are actor-agnostic, rely on isolated utterances or synthetic scenarios, and lack explicit event structure or value direction. We present NEVU (News Event-centric Value Understanding), a benchmark for actor-conditioned, event-centric, and direction-aware human value recognition in factual news. NEVU evaluates whether models can identify value cues, attribute them to the correct actor, and determine value direction from grounded evidence. Built from 2,865 English news articles, NEVU organizes annotations at four semantic unit levels (Subevent, behavior-based composite event, story-based composite event, and Article) and labels mbox(unit, actor) pairs for fine-grained evaluation across local and composite contexts. The annotations are produced through an LLM-assisted pipeline with staged verification and targeted human auditing. Using a hierarchical value space with 54 fine-grained values and 20 coarse-grained categories, NEVU covers 45,793 unit--actor pairs and 168,061 directed value instances. We provide unified baselines for proprietary and open-source LLMs, and find that lightweight adaptation (LoRA) consistently improves open-source models, showing that although NEVU is designed primarily as a benchmark, it also supports supervised adaptation beyond prompting-only evaluation. Data availability is described in Appendix~refapp:datacodeavailability.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 67 of its 99 references that are in the map. First posted on arXiv 18 Mar 2026.
Builds on
67 of 99 references.
References · 67
- 2023GPT-4 Technical Reportcited by 18,132
- 2025Qwen3 Technical Reportcited by 8,195
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
- 2022Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedbackcited by 3,634
- 2022Constitutional AI: Harmlessness from AI Feedbackcited by 2,950
- 2024Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phonecited by 1,883
- 2021A General Language Assistant as a Laboratory for Alignmentcited by 1,023
- 2022Red Teaming Language Models with Language Modelscited by 983
- 2023BeaverTails: Towards Improved Safety Alignment of LLM via a Human-Preference Datasetcited by 828
- 2025DeepSeek-V3.2: Pushing the Frontier of Open Large Language Modelscited by 755
- 2019COMET: Commonsense Transformers for Automatic Knowledge Graph Constructioncited by 450
- 2020COMET-ATOMIC 2020: On Symbolic and Neural Commonsense Knowledge Graphscited by 254
38 more
- 2023Evaluating the Moral Beliefs Encoded in LLMscited by 211
- 2023Personality Traits in Large Language Modelscited by 166
- 2021Document-Level Event Argument Extraction by Conditional Generationcited by 154
- 2021Can Machines Learn Morality? The Delphi Experimentcited by 140
- 2022Evaluating and Inducing Personality in Pre-trained Language Modelscited by 122
- 2022Who is GPT-3? An Exploration of Personality, Values and Demographicscited by 112
- 2020Scruples: A Corpus of Community Ethical Judgments on 32,000 Real-Life Anecdotescited by 100
- 2023Value Kaleidoscope: Engaging AI with Pluralistic Human Values, Rights, and Dutiescited by 97
- 2023Moral Foundations of Large Language Modelscited by 84
- 2022Moral Mimicry: Large Language Models Produce Moral Rationalizations Tailored to Political Identitycited by 71
- 2023Can ChatGPT Assess Human Personalities? A General Evaluation Frameworkcited by 69
- 2023Bad Actor, Good Advisor: Exploring the Role of Large Language Models in Fake News Detectioncited by 69
- 2019A Large-scale Dataset for Argument Quality Ranking: Construction and Analysiscited by 66
- 2024Are Large Language Models Consistent over Value-laden Questions?cited by 58
- 2023Do LLMs Possess a Personality? Making the MBTI Test an Amazing Evaluation for Large Language Modelscited by 54
- 2024A Systematic Survey of Text Summarization: From Statistical Methods to Large Language Modelscited by 52
- 2023Value FULCRA: Mapping Large Language Models to the Multidimensional Spectrum of Basic Human Valuescited by 49
- 2022Estimating the Personality of White-Box Language Modelscited by 47
- 2023From Instructions to Intrinsic Human Values -- A Survey of Alignment Goals for Big Modelscited by 45
- 2022Identifying and Manipulating the Personality Traits of Language Modelscited by 40
- 2021The Future is not One-dimensional: Complex Event Schema Induction by Graph Modeling for Event Predictioncited by 39
- 2021ValueNet: A New Dataset for Human Value Driven Dialogue Systemcited by 34
- 2023Have Large Language Models Developed a Personality?: Applicability of Self-Assessment Tests in Measuring Personality in LLMscited by 32
- 2022Does Moral Code Have a Moral Code? Probing Delphi's Moral Philosophycited by 31
- 2023Systematic Evaluation of GPT-3 for Zero-Shot Personality Estimationcited by 28
- 2023The Touch'e23-ValueEval Dataset for Identifying Human Values behind Argumentscited by 27
- 2023TextEE: Benchmark, Reevaluation, Reflections, and Future Challenges in Event Extractioncited by 27
- 2023Accuracy and Political Bias of News Source Credibility Ratings by Large Language Modelscited by 25
- 2024Analyzing Temporal Complex Events with Large Language Models? A Benchmark towards Temporal, Long Context Understandingcited by 23
- 2024CLAVE: An Adaptive Framework for Evaluating Values of LLM Generated Responsescited by 23
- 2025Normative Evaluation of Large Language Models with Everyday Moral Dilemmascited by 23
- 2025Llama-3.1-FoundationAI-SecurityLLM-8B-Instruct Technical Reportcited by 21
- 2024ValueCompass: A Framework for Measuring Contextual Value Alignment Between Human and LLMscited by 20
- 2021What is Event Knowledge Graph: A Surveycited by 19
- 2024Open Models, Closed Minds? On Agents Capabilities in Mimicking Human Personalities through Open Large Language Modelscited by 19
- 2024ValueBench: Towards Comprehensively Evaluating Value Orientations and Understanding of Large Language Modelscited by 19
- 2024LLM×MapReduce: Simplified Long-Sequence Processing using Large Language Modelscited by 17
- 2023A Survey on Event-based News Narrative Extractioncited by 16
50 most cited of 67 All 67 (JSON)
Built on by
Not cited yet.