Global Evolutionary Steering: Refining Activation Steering Control via Cross-Layer Consistency
Not on the map. Why?
Abstract (arXiv)
Activation engineering enables precise control over Large Language Models (LLMs) without the computational cost of fine-tuning. However, existing methods deriving vectors from static activation differences are susceptible to high-dimensional noise and layer-wise semantic drift, often capturing spurious correlations rather than the target intent. To address this, we propose Global Evolutionary Refined Steering (GER-steer), a training-free framework that grounded in the geometric stability of the network's representation evolution. GER-steer exploits this global signal to rectify raw steering vectors, effectively decoupling robust semantic intent from orthogonal artifacts. Extensive evaluations confirm that GER-steer consistently outperforms baselines, delivering superior efficacy and generalization without layer-specific tuning, establishing a universal solution for reliable model alignment.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 39 of its 50 references that are in the map. First posted on arXiv 12 Mar 2026.
Builds on
39 of 50 references.
References · 39
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2021Training Verifiers to Solve Math Word Problemscited by 9,743
- 2020Measuring Massive Multitask Language Understandingcited by 7,768
- 2018GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understandingcited by 4,854
- 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,769
- 2013Distributed Representations of Words and Phrases and their Compositionalitycited by 3,462
- 2021TruthfulQA: Measuring How Models Mimic Human Falsehoodscited by 2,919
- 2023Universal and Transferable Adversarial Attacks on Aligned Language Modelscited by 2,914
- 2024Qwen2 Technical Reportcited by 2,076
- 2025Gemma 3 Technical Reportcited by 1,686
- 2016Man is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddingscited by 1,304
- 2023Inference-Time Intervention: Eliciting Truthful Answers from a Language Modelcited by 1,259
27 more
- 2023Representation Engineering: A Top-Down Approach to AI Transparencycited by 1,239
- 2023Steering Llama 2 via Contrastive Activation Additioncited by 1,009
- 2022Discovering Latent Knowledge in Language Models Without Supervisioncited by 733
- 2023The Linear Representation Hypothesis and the Geometry of Large Language Modelscited by 679
- 2023Eliciting Latent Predictions from Transformers with the Tuned Lenscited by 579
- 2022Extracting Latent Steering Vectors from Pretrained Language Modelscited by 217
- 2019The Bottom-up Evolution of Representations in the Transformer: A Study with Machine Translation and Language Modeling Objectivescited by 139
- 2024Analyzing the Generalization and Reliability of Steering Vectorscited by 130
- 2024Personalized Steering of Large Language Models: Versatile Steering Vectors Through Bi-directional Preference Optimizationcited by 112
- 2023SteerLM: Attribute Conditioned SFT as an (User-Steerable) Alternative to RLHFcited by 107
- 2024Adaptive Activation Steering: A Tuning-Free LLM Truthfulness Improvement Method for Diverse Hallucinations Categoriescited by 74
- 2025Steering Large Language Model Activations in Sparse Spacescited by 58
- 2024Latent Space Chain-of-Embedding Enables Output-free LLM Self-Evaluationcited by 56
- 2025Angular Steering: Behavior Control via Rotation in Activation Spacecited by 45
- 2025A Unified Understanding and Evaluation of Steering Methodscited by 40
- 2025Understanding (Un)Reliability of Steering Vectors in Language Modelscited by 39
- 2023HC3 Plus: A Semantic-Invariant Human ChatGPT Comparison Corpuscited by 33
- 2024AI-LieDar: Examine the Trade-off Between Utility and Truthfulness in LLM Agentscited by 28
- 2025Beyond Linear Steering: Unified Multi-Attribute Control for Language Modelscited by 23
- 2025LogitLens4LLMs: Extending Logit Lens Analysis to Modern Large Language Modelscited by 22
- 2025Steering Dialogue Dynamics for Robustness against Multi-turn Jailbreaking Attackscited by 20
- 2025Steering LLM Reasoning Through Bias-Only Adaptationcited by 16
- 2024Behavior Alignment: A New Perspective of Evaluating LLM-based Conversational Recommender Systemscited by 11
- 2025DRESSing Up LLM: Efficient Stylized Question-Answering via Style Subspace Editingcited by 10
- 2025LF-Steering: Latent Feature Activation Steering for Enhancing Semantic Consistency in Large Language Modelscited by 7
- 2025Dynamically Scaled Activation Steeringcited by 6
- 2025GCAV: A Global Concept Activation Vector Framework for Cross-Layer Consistency in Interpretabilitycited by 1
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026Two-dimensional early exit optimisation of LLM inferencecited by 0
- 2026Multi-Adapter Representation Interventions via Energy Calibrationcited by 0
- 2026Write Back the Delta: Revisiting the Same Tokens with Fresh Representationscited by 0
- 2026How Do Agentic LLMs Decide to Call Tools? A Tool-Call Vector Shaped by Suppressioncited by 0
- 2026How Do Agentic LLMs Decide to Call Tools? A Tool-Call Vector Shaped by Suppression7 Oct 2026
- 2026Write Back the Delta: Revisiting the Same Tokens with Fresh Representations26 Sep 2026
- 2026Multi-Adapter Representation Interventions via Energy Calibration27 May 2026
- 2026Two-dimensional early exit optimisation of LLM inference27 Mar 2026
Similar, not cited
Close in wording, no citation either way
- 2026Where to Steer: Input-Dependent Layer Selection for Steering Improves LLM Alignment
- 2026UniSteer: Text-Guided Flow Matching in Activation Space for Versatile LLM Steering
- 2026CircuitSteer: Geometrically Aligned Multi-Layer Steering via Sparse Autoencoder Circuits
- 2026Steer2Edit: From Activation Steering to Component-Level Editing
- 2026ODESteer: A Unified ODE-Based Steering Framework for LLM Alignment
- 2026MetaSteer: Context-Conditioned, nonlinear Steering via Attention-Projection Adaptation
- 2025Self-Improving Model Steering
- 2024Controlling Language and Diffusion Models by Transporting Activations