mlsanityData to 7 Oct 2026

Global Evolutionary Steering: Refining Activation Steering Control via Cross-Layer Consistency

arXiv 2603.12298 ↗First posted 12 Mar 2026cs.LG cs.AIcited by 4

Not on the map. Why?

Abstract (arXiv)

Activation engineering enables precise control over Large Language Models (LLMs) without the computational cost of fine-tuning. However, existing methods deriving vectors from static activation differences are susceptible to high-dimensional noise and layer-wise semantic drift, often capturing spurious correlations rather than the target intent. To address this, we propose Global Evolutionary Refined Steering (GER-steer), a training-free framework that grounded in the geometric stability of the network's representation evolution. GER-steer exploits this global signal to rectify raw steering vectors, effectively decoupling robust semantic intent from orthogonal artifacts. Extensive evaluations confirm that GER-steer consistently outperforms baselines, delivering superior efficacy and generalization without layer-specific tuning, establishing a universal solution for reliable model alignment.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 39 of its 50 references that are in the map. First posted on arXiv 12 Mar 2026.

Builds on

39 of 50 references.

References · 39

  1. 2024The Llama 3 Herd of Modelscited by 14,192
  2. 2021Training Verifiers to Solve Math Word Problemscited by 9,743
  3. 2020Measuring Massive Multitask Language Understandingcited by 7,768
  4. 2018GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understandingcited by 4,854
  5. 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,769
  6. 2013Distributed Representations of Words and Phrases and their Compositionalitycited by 3,462
  7. 2021TruthfulQA: Measuring How Models Mimic Human Falsehoodscited by 2,919
  8. 2023Universal and Transferable Adversarial Attacks on Aligned Language Modelscited by 2,914
  9. 2024Qwen2 Technical Reportcited by 2,076
  10. 2025Gemma 3 Technical Reportcited by 1,686
  11. 2016Man is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddingscited by 1,304
  12. 2023Inference-Time Intervention: Eliciting Truthful Answers from a Language Modelcited by 1,259
27 more
  1. 2023Representation Engineering: A Top-Down Approach to AI Transparencycited by 1,239
  2. 2023Steering Llama 2 via Contrastive Activation Additioncited by 1,009
  3. 2022Discovering Latent Knowledge in Language Models Without Supervisioncited by 733
  4. 2023The Linear Representation Hypothesis and the Geometry of Large Language Modelscited by 679
  5. 2023Eliciting Latent Predictions from Transformers with the Tuned Lenscited by 579
  6. 2022Extracting Latent Steering Vectors from Pretrained Language Modelscited by 217
  7. 2019The Bottom-up Evolution of Representations in the Transformer: A Study with Machine Translation and Language Modeling Objectivescited by 139
  8. 2024Analyzing the Generalization and Reliability of Steering Vectorscited by 130
  9. 2024Personalized Steering of Large Language Models: Versatile Steering Vectors Through Bi-directional Preference Optimizationcited by 112
  10. 2023SteerLM: Attribute Conditioned SFT as an (User-Steerable) Alternative to RLHFcited by 107
  11. 2024Adaptive Activation Steering: A Tuning-Free LLM Truthfulness Improvement Method for Diverse Hallucinations Categoriescited by 74
  12. 2025Steering Large Language Model Activations in Sparse Spacescited by 58
  13. 2024Latent Space Chain-of-Embedding Enables Output-free LLM Self-Evaluationcited by 56
  14. 2025Angular Steering: Behavior Control via Rotation in Activation Spacecited by 45
  15. 2025A Unified Understanding and Evaluation of Steering Methodscited by 40
  16. 2025Understanding (Un)Reliability of Steering Vectors in Language Modelscited by 39
  17. 2023HC3 Plus: A Semantic-Invariant Human ChatGPT Comparison Corpuscited by 33
  18. 2024AI-LieDar: Examine the Trade-off Between Utility and Truthfulness in LLM Agentscited by 28
  19. 2025Beyond Linear Steering: Unified Multi-Attribute Control for Language Modelscited by 23
  20. 2025LogitLens4LLMs: Extending Logit Lens Analysis to Modern Large Language Modelscited by 22
  21. 2025Steering Dialogue Dynamics for Robustness against Multi-turn Jailbreaking Attackscited by 20
  22. 2025Steering LLM Reasoning Through Bias-Only Adaptationcited by 16
  23. 2024Behavior Alignment: A New Perspective of Evaluating LLM-based Conversational Recommender Systemscited by 11
  24. 2025DRESSing Up LLM: Efficient Stylized Question-Answering via Style Subspace Editingcited by 10
  25. 2025LF-Steering: Latent Feature Activation Steering for Enhancing Semantic Consistency in Large Language Modelscited by 7
  26. 2025Dynamically Scaled Activation Steeringcited by 6
  27. 2025GCAV: A Global Concept Activation Vector Framework for Cross-Layer Consistency in Interpretabilitycited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 4.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Where to Steer: Input-Dependent Layer Selection for Steering Improves LLM Alignment
  2. 2026UniSteer: Text-Guided Flow Matching in Activation Space for Versatile LLM Steering
  3. 2026CircuitSteer: Geometrically Aligned Multi-Layer Steering via Sparse Autoencoder Circuits
  4. 2026Steer2Edit: From Activation Steering to Component-Level Editing
  5. 2026ODESteer: A Unified ODE-Based Steering Framework for LLM Alignment
  6. 2026MetaSteer: Context-Conditioned, nonlinear Steering via Attention-Projection Adaptation
  7. 2025Self-Improving Model Steering
  8. 2024Controlling Language and Diffusion Models by Transporting Activations