mlsanityData to 14 Oct 2026

Reading and Steering Representations of Materials-Science Mechanisms in an Open-Weight Language Model

arXiv 2607.20058 ↗First posted 22 Jul 2026cs.AI cond-mat.mes-hall cond-mat.mtrl-scicited by 1

Not on the map. Why?

Abstract (arXiv)

Large language models can answer scientific questions, yet a correct output does not reveal whether the model represents or uses the governing physics. Here, using three open-weight Gemma 4 models (google/gemma-4-E4B-it, google/gemma-4-12B-it, google/gemma-4-31B-it) we identify three experimentally separable signatures of materials-science mechanism information: selective concept readability, relational encoding of qualitative constitutive orientation, and causal, context-dependent control of constrained engineering answers. We combine matched direct and Jacobian vocabulary readouts, option-free state geometry, a 60-law counterfactual benchmark and causal interventions. In 50 held-out materials descriptions, three independently fitted Jacobian lenses reproduced concept ranks, and target-free word sets from both readouts enabled blinded identification of 9 of 10 mechanism families. A separate 72-prompt benchmark produced mechanism-specific hidden-state neighborhoods, but an exact graph audit showed that this apparent physical organization was equally explained by numerical comparison. We therefore compared otherwise identical prompts in which only the direction of the physical input was reversed, asking whether the resulting hidden-state movement followed the supplied constitutive law. These state transformations ordered direct, physically neutral and inverse laws across 60 frozen relations and correctly oriented 39 of 40 directional laws, whereas lexical controls were near chance. Bidirectional interventions shifted answer probabilities toward or away from the physically appropriate outcome across all 12 matched cases, while counterfactual state patches transferred opposing decision signals across mechanisms and answer formats. Physical relationships were therefore more visible in controlled state changes than in absolute states alone.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 29 of its 55 references that are in the map. First posted on arXiv 22 Jul 2026.

Builds on

29 of 55 references.

References · 29

  1. 2017Attention Is All You Needcited by 60,361
  2. 2022Training language models to follow instructions with human feedbackcited by 15,971
  3. 2017Deep reinforcement learning from human preferencescited by 3,912
  4. 2023Let's Verify Step by Stepcited by 3,789
  5. 2018UMAP: Uniform Manifold Approximation and Projection for Dimension Reductioncited by 2,898
  6. 2020Transformer Feed-Forward Layers Are Key-Value Memoriescited by 1,336
  7. 2023Representation Engineering: A Top-Down Approach to AI Transparencycited by 1,336
  8. 2024The AI Scientist: Towards Fully Automated Open-Ended Scientific Discoverycited by 1,071
  9. 2023Steering Language Models With Activation Engineeringcited by 922
  10. 2022Discovering Latent Knowledge in Language Models Without Supervisioncited by 767
  11. 2019Designing and Interpreting Probes with Control Taskscited by 640
  12. 2023Eliciting Latent Predictions from Transformers with the Tuned Lenscited by 623
17 more
  1. 2025The AI Scientist-v2: Workshop-Level Automated Scientific Discovery via Agentic Tree Searchcited by 422
  2. 2019Paired Open-Ended Trailblazer (POET): Endlessly Generating Increasingly Complex and Diverse Learning Environments and Their Solutionscited by 192
  3. 2026Scaling Monosemanticity: Extracting Interpretable Features from Claude 3 Sonnetcited by 191
  4. 2026Verbalizable Representations Form a Global Workspace in Language Modelscited by 75
  5. 2024ProtAgents: Protein discovery via large language model multi-agent collaborations combining physics and machine learningcited by 64
  6. 2023Towards a Mechanistic Interpretation of Multi-Step Reasoning Capabilities of Language Modelscited by 50
  7. 2023MechGPT, a language-based strategy for mechanics and materials modeling that connects knowledge across scales, disciplines and modalitiescited by 38
  8. 2025AutoDiscovery: Open-ended Scientific Discovery via Bayesian Surprisecited by 33
  9. 2023BioinspiredLLM: Conversational Large Language Model for the Mechanics of Biological and Bio-inspired Materialscited by 30
  10. 2023MeLM, a generative pretrained language modeling framework that solves forward and inverse mechanics problemscited by 29
  11. 2023LLM-Prop: Predicting Physical And Electronic Properties Of Crystalline Solids From Their Text Descriptionscited by 29
  12. 2024Accelerating Scientific Discovery with Generative Knowledge Extraction, Graph-Based Representation, and Multimodal Intelligent Graph Reasoningcited by 27
  13. 2024PRefLexOR: Preference-based Recursive Language Modeling for Exploratory Optimization of Reasoning and Agentic Thinkingcited by 17
  14. 2026Autonomous Agents Coordinating Distributed Discovery Through Emergent Artifact Exchangecited by 11
  15. 2026BeamPERL: Parameter-Efficient RL with Verifiable Rewards Specializes Compact LLMs for Structured Beam Mechanics Reasoningcited by 4
  16. 2026Graph-Native Reinforcement Learning Enables Traceable Scientific Hypothesis Generation through Conceptual Recombinationcited by 4
  17. 2024MaterialBENCH: Evaluating College-Level Materials Science Problem-Solving Abilities of Large Language Modelscited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.