Command-V: Pasting LLM Behaviors via Activation Profiles
Not on the map. Why?
Abstract (arXiv)
Retrofitting large language models (LLMs) with new behaviors typically requires full finetuning or distillation-costly steps that must be repeated for every architecture. In this work, we introduce Command-V, a backpropagation-free behavior transfer method that copies an existing residual activation adapter from a donor model and pastes its effect into a recipient model. Command-V profiles layer activations on a small prompt set, derives linear converters between corresponding layers, and applies the donor intervention in the recipient's activation space. This process does not require access to the original training data and needs minimal compute. In three case studies-safety-refusal enhancement, jailbreak facilitation, and automatic chain-of-thought reasoning--Command-V matches or exceeds the performance of direct finetuning while using orders of magnitude less compute. Our code and data are accessible at https://github.com/GithuBarry/Command-V/.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 46 of its 50 references that are in the map. First posted on arXiv 23 Jun 2025.
Builds on
46 of 50 references.
References · 46
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2015Distilling the Knowledge in a Neural Networkcited by 10,324
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
- 2022Large Language Models are Zero-Shot Reasonerscited by 4,374
- 2019Parameter-Efficient Transfer Learning for NLPcited by 4,236
- 2021Prefix-Tuning: Optimizing Continuous Prompts for Generationcited by 3,915
- 2017Deep reinforcement learning from human preferencescited by 3,912
- 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,780
- 2023Universal and Transferable Adversarial Attacks on Aligned Language Modelscited by 3,104
- 2022Locating and Editing Factual Associations in GPTcited by 2,691
34 more
- 2024Qwen2 Technical Reportcited by 2,120
- 2024Gemma 2: Improving Open Language Models at a Practical Sizecited by 1,998
- 2022Challenging BIG-Bench Tasks and Whether Chain-of-Thought Can Solve Themcited by 1,807
- 2014FitNets: Hints for Thin Deep Netscited by 1,653
- 2024HarmBench: A Standardized Evaluation Framework for Automated Red Teaming and Robust Refusalcited by 1,429
- 2023Jailbreaking Black Box Large Language Models in Twenty Queriescited by 1,420
- 2022Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference timecited by 1,396
- 2023Representation Engineering: A Top-Down Approach to AI Transparencycited by 1,336
- 2022Editing Models with Task Arithmeticcited by 1,120
- 2023Steering Llama 2 via Contrastive Activation Additioncited by 1,085
- 2019BERT Rediscovers the Classical NLP Pipelinecited by 1,059
- 2022Red Teaming Language Models with Language Modelscited by 1,026
- 2022Mass-Editing Memory in a Transformercited by 1,001
- 2023BeaverTails: Towards Improved Safety Alignment of LLM via a Human-Preference Datasetcited by 860
- 2023TIES-Merging: Resolving Interference When Merging Modelscited by 818
- 2024Phi-4 Technical Reportcited by 711
- 2023Baseline Defenses for Adversarial Attacks Against Aligned Language Modelscited by 651
- 2021Merging Models with Fisher-Weighted Averagingcited by 621
- 2024Scaling and evaluating sparse autoencoderscited by 553
- 2024TOFU: A Task of Fictitious Unlearning for LLMscited by 533
- 2023SmoothLLM: Defending Large Language Models Against Jailbreaking Attackscited by 469
- 2019What do you learn from context? Probing for sentence structure in contextualized word representationscited by 438
- 2023Safety-Tuned LLaMAs: Lessons From Improving the Safety of Large Language Models that Follow Instructionscited by 387
- 20242 OLMo 2 Furiouscited by 340
- 2023LLM-Adapters: An Adapter Family for Parameter-Efficient Fine-Tuning of Large Language Modelscited by 324
- 2023Are aligned neural networks adversarially aligned?cited by 315
- 2024ReFT: Reasoning with Reinforced Fine-Tuningcited by 239
- 2024WildTeaming at Scale: From In-the-Wild Jailbreaks to (Adversarially) Safer Language Modelscited by 223
- 2024ReFT: Representation Finetuning for Language Modelscited by 197
- 2023Do-Not-Answer: A Dataset for Evaluating Safeguards in LLMscited by 184
- 2025AIMO-2 Winning Solution: Building State-of-the-Art Mathematical Reasoning Models with OpenMathReasoning datasetcited by 174
- 2024Style Vectors for Steering Generative Large Language Modelcited by 56
- 2024Understanding the Performance and Estimating the Cost of LLM Fine-Tuningcited by 48
- 2024PaCE: Parsimonious Concept Engineering for Large Language Modelscited by 19
Built on by
Citing papers per year: 2026: 1.
1 paper.
- 2026PreFT: Prefill-only finetuning for efficient inferencecited by 0
- 2026PreFT: Prefill-only finetuning for efficient inference14 May 2026
Similar, not cited
Close in wording, no citation either way
- 2024Model Surgery: Modulating LLM's Behavior Via Simple Parameter Editing
- 2024AtP*: An efficient and scalable method for localizing LLM behaviour to components
- 2025Guiding Giants: Lightweight Controllers for Weighted Activation Steering in LLMs
- 2025Learning a Single Token to Replace Long System Prompts in LLMs
- 2025Watch your steps: Dormant Adversarial Behaviors that Activate upon LLM Finetuning
- 2026Training-Free Task Vectors for LLM Behavioral Control
- 2024Semantics-Adaptive Activation Intervention for LLMs via Dynamic Steering Vectors
- 2026Activation Surgery: Jailbreaking White-box LLMs without Touching the Prompt