Beyond Independent Labels: Schwartz-Geometry Decoding for Human Value Detection
Not on the map. Why?
Abstract (arXiv)
Human value detection is commonly formulated as sentence-level multi-label classification over the 19 refined Schwartz values, typically predicted as independent labels. Schwartz theory, however, describes them as a circular motivational continuum, in which adjacent values are compatible and opposing values are in tension. We ask whether this structure can be operationalized as an explicit output-space geometry and used as a soft bias rather than a hard constraint. On a DeBERTa-v3-base classifier, we compare two ways of injecting it: training-time geometry-aware objectives and a post-hoc Schwartz-aware energy decoder that scores whole label sets jointly. Across five seeds, training-time geometry gives only limited gains-no larger for the true continuum than for a random ordering-whereas the decoder makes label sets more coherent with the continuum-on theory-aware coherence metrics we introduce-at no cost to Macro-F1 or Micro-F1 (held fixed by its selection rule). The gain is specific to the true Schwartz ordering: it does not appear for a random permutation or an empirical co-occurrence graph through the identical decoder. A bounded Qwen2.5-72B-Instruct diagnostic shows that supplying the continuum at inference shifts behavior but does not match supervised structured prediction. Theory-aware decoding thus offers a lightweight, controllable way to make value detection faithful to its label space.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 25 of its 34 references that are in the map. First posted on arXiv 6 Jul 2026.
Builds on
25 of 34 references.
References · 25
- 2020Measuring Massive Multitask Language Understandingcited by 7,768
- 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,193
- 2023Pythia: A Suite for Analyzing Large Language Models Across Training and Scalingcited by 1,734
- 2024OLMo: Accelerating the Science of Language Modelscited by 599
- 20242 OLMo 2 Furiouscited by 302
- 2024tinyBenchmarks: evaluating LLMs with fewer examplescited by 295
- 2023Prediction-Powered Inferencecited by 214
- 2022Attributed Question Answering: Evaluation and Modeling for Attributed Large Language Modelscited by 108
- 2023PPI++: Efficient Prediction-Powered Inferencecited by 103
- 2023LLM360: Towards Fully Transparent Open-Source LLMscited by 100
- 2024MetricX-24: The Google Submission to the WMT 2024 Metrics Shared Taskcited by 92
- 2023Anchor Points: Benchmarking Models with Much Fewer Examplescited by 84
13 more
- 2025WMT24++: Expanding the Language Coverage of WMT24 to 55 Languages & Dialectscited by 79
- 2023Cross-Prediction-Powered Inferencecited by 57
- 2024AutoEval Done Right: Using Synthetic Data for Model Evaluationcited by 53
- 2024Can Unconfident LLM Annotations Be Used for Confident Conclusions?cited by 44
- 2024metabench -- A Sparse Benchmark of Reasoning and Knowledge in Large Language Modelscited by 35
- 2023How Predictable Are Large Language Model Capabilities? A Case Study on BIG-benchcited by 34
- 2025Fluid Language Model Benchmarkingcited by 30
- 2024Prediction-Powered Ranking of Large Language Modelscited by 29
- 2024On Speeding Up Language Model Evaluationcited by 14
- 2025LLM360 K2: Building a 65B 360-Open-Source Large Language Model from Scratchcited by 14
- 2025Cost-Optimal Active AI Model Evaluationcited by 14
- 2024Collaborative Performance Prediction for Large Language Modelscited by 9
- 2026Rich Insights from Cheap Signals: Efficient Evaluations via Tensor Factorizationcited by 1
Built on by
Not cited yet.