mlsanityData to 14 Oct 2026

BACH-V: Bridging Abstract and Concrete Human-Values in Large Language Models

arXiv 2601.14007 ↗First posted 20 Jan 2026cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Do large language models (LLMs) genuinely understand abstract concepts, or merely manipulate them as statistical patterns? We introduce an abstraction-grounding framework that decomposes conceptual understanding into three capacities: interpretation of abstract concepts (Abstract-Abstract, A-A), grounding of abstractions in concrete events (Abstract-Concrete, A-C), and application of abstract principles to regulate concrete decisions (Concrete-Concrete, C-C). Using human values as a testbed - given their semantic richness and centrality to alignment - we employ probing (detecting value traces in internal activations) and steering (modifying representations to shift behavior). Across six open-source LLMs and ten value dimensions, probing shows that diagnostic probes trained solely on abstract value descriptions reliably detect the same values in concrete event narratives and decision reasoning, demonstrating cross-level transfer. Steering reveals an asymmetry: intervening on value representations causally shifts concrete judgments and decisions (A-C, C-C), yet leaves abstract interpretations unchanged (A-A), suggesting that encoded abstract values function as stable anchors rather than malleable activations. These findings indicate LLMs maintain structured value representations that bridge abstraction and action, providing a mechanistic and operational foundation for building value-driven autonomous AI systems with more transparent, generalizable alignment and control.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 16 of its 32 references that are in the map. First posted on arXiv 20 Jan 2026.

Builds on

16 of 32 references.

References · 16

  1. 2017Attention Is All You Needcited by 60,361
  2. 2022Training language models to follow instructions with human feedbackcited by 15,971
  3. 2022Constitutional AI: Harmlessness from AI Feedbackcited by 3,050
  4. 2023Inference-Time Intervention: Eliciting Truthful Answers from a Language Modelcited by 1,302
  5. 2023Fine-tuning Aligned Language Models Compromises Safety, Even When Users Do Not Intend To!cited by 1,154
  6. 2023Steering Llama 2 via Contrastive Activation Additioncited by 1,085
  7. 2022In-context Learning and Induction Headscited by 964
  8. 2020Artificial Intelligence, Values and Alignmentcited by 448
  9. 2024Transcoders Find Interpretable LLM Feature Circuitscited by 200
  10. 2023Large Language Models Are Not Strong Abstract Reasonerscited by 53
  11. 2024Language Models Resist Alignment: Evidence From Data Compressioncited by 53
  12. 2017Interpreting CNN Knowledge via an Explanatory Graphcited by 49
4 more
  1. 2024Defining and Extracting generalizable interaction primitives from DNNscited by 14
  2. 2025Stress-Testing Model Specs Reveals Character Differences among Language Modelscited by 13
  3. 2024Are the Values of LLMs Structurally Aligned with Humans? A Causal Perspectivecited by 9
  4. 2024Meaningful Learning: Enhancing Abstract Reasoning in Large Language Models via Generic Fact Guidancecited by 8

Built on by

Not cited yet.