mlsanityData to 7 Oct 2026

PIXEL: Adaptive Steering Via Position-wise Injection with eXact Estimated Levels under Subspace Calibration

arXiv 2510.10205 ↗First posted 11 Oct 2025cs.AIcited by 10

Not on the map. Why?

Abstract (arXiv)

Reliable behavior control is central to deploying large language models (LLMs) on the web. Activation steering offers a tuning-free route to align attributes (e.g., truthfulness) that ensure trustworthy generation. Prevailing approaches rely on coarse heuristics and lack a principled account of where to steer and how strongly to intervene. To this end, we propose Position-wise Injection with eXact Estimated Levels (PIXEL), a position-wise activation steering framework that, in contrast to prior work, learns a property-aligned subspace from dual views (tail-averaged and end-token) and selects intervention strength via a constrained geometric objective with a closed-form solution, thereby adapting to token-level sensitivity without global hyperparameter tuning. PIXEL further performs sample-level orthogonal residual calibration to refine the global attribute direction and employs a lightweight position-scanning routine to identify receptive injection sites. We additionally provide representation-level guarantees for the minimal-intervention rule, supporting reliable alignment. Across diverse models and evaluation paradigms, PIXEL consistently improves attribute alignment while preserving model general capabilities, offering a practical and principled method for LLMs' controllable generation. Our code is available at https://github.com/V1centNevwake/PIXEL-Adaptive-Steering

Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). Builds on 40 of its 66 references that are in the map. First posted on arXiv 11 Oct 2025.

Builds on

40 of 66 references.

References · 40

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2022Training language models to follow instructions with human feedbackcited by 15,712
  3. 2024The Llama 3 Herd of Modelscited by 14,192
  4. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  5. 2020Measuring Massive Multitask Language Understandingcited by 7,768
  6. 2018GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understandingcited by 4,854
  7. 2017Deep reinforcement learning from human preferencescited by 3,846
  8. 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,747
  9. 2022Constitutional AI: Harmlessness from AI Feedbackcited by 2,950
  10. 2021TruthfulQA: Measuring How Models Mimic Human Falsehoodscited by 2,919
  11. 2022Locating and Editing Factual Associations in GPTcited by 2,609
  12. 2018Can a Suit of Armor Conduct Electricity? A New Dataset for Open Book Question Answeringcited by 2,114
28 more
  1. 2024Qwen2 Technical Reportcited by 2,076
  2. 2023Inference-Time Intervention: Eliciting Truthful Answers from a Language Modelcited by 1,259
  3. 2023Steering Llama 2 via Contrastive Activation Additioncited by 1,009
  4. 2017RACE: Large-scale ReAding Comprehension Dataset From Examinationscited by 851
  5. 2021BBQ: A Hand-Built Bias Benchmark for Question Answeringcited by 683
  6. 2023Dissecting Recall of Factual Associations in Auto-Regressive Language Modelscited by 512
  7. 2021Attention is Not All You Need: Pure Attention Loses Rank Doubly Exponentially with Depthcited by 411
  8. 2024SORRY-Bench: Systematically Evaluating Large Language Model Safety Refusalcited by 224
  9. 2023DetectLLM: Leveraging Log Rank Information for Zero-Shot Detection of Machine-Generated Textcited by 207
  10. 2024ReFT: Representation Finetuning for Language Modelscited by 186
  11. 2023HelpSteer: Multi-attribute Helpfulness Dataset for SteerLMcited by 140
  12. 2024Personalized Steering of Large Language Models: Versatile Steering Vectors Through Bi-directional Preference Optimizationcited by 112
  13. 2024Adaptive Activation Steering: A Tuning-Free LLM Truthfulness Improvement Method for Diverse Hallucinations Categoriescited by 74
  14. 2025Steering Large Language Model Activations in Sparse Spacescited by 58
  15. 2025Understanding Aha Moments: from External Observations to Internal Mechanismscited by 48
  16. 2025AlphaSteer: Learning Refusal Steering with Principled Null-Space Constraintcited by 45
  17. 2025Multi-Attribute Steering of Language Models via Targeted Interventioncited by 44
  18. 2025A Unified Understanding and Evaluation of Steering Methodscited by 40
  19. 2024Multi-hop Question Answering under Temporal Knowledge Editingcited by 36
  20. 2024Locate-then-edit for Multi-hop Factual Recall under Knowledge Editingcited by 36
  21. 2025Understanding the Repeat Curse in Large Language Models from a Feature Perspectivecited by 36
  22. 2025Fraud-R1 : A Multi-Round Benchmark for Assessing the Robustness of LLM Against Augmented Fraud and Phishing Inducementscited by 31
  23. 2025Beyond Linear Steering: Unified Multi-Attribute Control for Language Modelscited by 23
  24. 2024Exploring the Personality Traits of LLMs through Latent Features Steeringcited by 21
  25. 2023Differentially Private Natural Language Models: Recent Advances and Future Directionscited by 20
  26. 2025Understanding and Mitigating Cross-lingual Privacy Leakage via Language-specific and Universal Privacy Neuronscited by 13
  27. 2024Dialectical Alignment: Resolving the Tension of 3H and Security Threats of LLMscited by 11
  28. 2025Teach Me How to Denoise: A Universal Framework for Denoising Multi-modal Recommender Systems via Guided Calibrationcited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 1; 2026: 9.

10 papers.