mlsanityData to 14 Oct 2026

Command-V: Pasting LLM Behaviors via Activation Profiles

arXiv 2506.19140 ↗First posted 23 Jun 2025cs.LGcited by 1

Not on the map. Why?

Abstract (arXiv)

Retrofitting large language models (LLMs) with new behaviors typically requires full finetuning or distillation-costly steps that must be repeated for every architecture. In this work, we introduce Command-V, a backpropagation-free behavior transfer method that copies an existing residual activation adapter from a donor model and pastes its effect into a recipient model. Command-V profiles layer activations on a small prompt set, derives linear converters between corresponding layers, and applies the donor intervention in the recipient's activation space. This process does not require access to the original training data and needs minimal compute. In three case studies-safety-refusal enhancement, jailbreak facilitation, and automatic chain-of-thought reasoning--Command-V matches or exceeds the performance of direct finetuning while using orders of magnitude less compute. Our code and data are accessible at https://github.com/GithuBarry/Command-V/.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 46 of its 50 references that are in the map. First posted on arXiv 23 Jun 2025.

Builds on

46 of 50 references.

References · 46

  1. 2024The Llama 3 Herd of Modelscited by 14,715
  2. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  3. 2015Distilling the Knowledge in a Neural Networkcited by 10,324
  4. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  5. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
  6. 2022Large Language Models are Zero-Shot Reasonerscited by 4,374
  7. 2019Parameter-Efficient Transfer Learning for NLPcited by 4,236
  8. 2021Prefix-Tuning: Optimizing Continuous Prompts for Generationcited by 3,915
  9. 2017Deep reinforcement learning from human preferencescited by 3,912
  10. 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,780
  11. 2023Universal and Transferable Adversarial Attacks on Aligned Language Modelscited by 3,104
  12. 2022Locating and Editing Factual Associations in GPTcited by 2,691
34 more
  1. 2024Qwen2 Technical Reportcited by 2,120
  2. 2024Gemma 2: Improving Open Language Models at a Practical Sizecited by 1,998
  3. 2022Challenging BIG-Bench Tasks and Whether Chain-of-Thought Can Solve Themcited by 1,807
  4. 2014FitNets: Hints for Thin Deep Netscited by 1,653
  5. 2024HarmBench: A Standardized Evaluation Framework for Automated Red Teaming and Robust Refusalcited by 1,429
  6. 2023Jailbreaking Black Box Large Language Models in Twenty Queriescited by 1,420
  7. 2022Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference timecited by 1,396
  8. 2023Representation Engineering: A Top-Down Approach to AI Transparencycited by 1,336
  9. 2022Editing Models with Task Arithmeticcited by 1,120
  10. 2023Steering Llama 2 via Contrastive Activation Additioncited by 1,085
  11. 2019BERT Rediscovers the Classical NLP Pipelinecited by 1,059
  12. 2022Red Teaming Language Models with Language Modelscited by 1,026
  13. 2022Mass-Editing Memory in a Transformercited by 1,001
  14. 2023BeaverTails: Towards Improved Safety Alignment of LLM via a Human-Preference Datasetcited by 860
  15. 2023TIES-Merging: Resolving Interference When Merging Modelscited by 818
  16. 2024Phi-4 Technical Reportcited by 711
  17. 2023Baseline Defenses for Adversarial Attacks Against Aligned Language Modelscited by 651
  18. 2021Merging Models with Fisher-Weighted Averagingcited by 621
  19. 2024Scaling and evaluating sparse autoencoderscited by 553
  20. 2024TOFU: A Task of Fictitious Unlearning for LLMscited by 533
  21. 2023SmoothLLM: Defending Large Language Models Against Jailbreaking Attackscited by 469
  22. 2019What do you learn from context? Probing for sentence structure in contextualized word representationscited by 438
  23. 2023Safety-Tuned LLaMAs: Lessons From Improving the Safety of Large Language Models that Follow Instructionscited by 387
  24. 20242 OLMo 2 Furiouscited by 340
  25. 2023LLM-Adapters: An Adapter Family for Parameter-Efficient Fine-Tuning of Large Language Modelscited by 324
  26. 2023Are aligned neural networks adversarially aligned?cited by 315
  27. 2024ReFT: Reasoning with Reinforced Fine-Tuningcited by 239
  28. 2024WildTeaming at Scale: From In-the-Wild Jailbreaks to (Adversarially) Safer Language Modelscited by 223
  29. 2024ReFT: Representation Finetuning for Language Modelscited by 197
  30. 2023Do-Not-Answer: A Dataset for Evaluating Safeguards in LLMscited by 184
  31. 2025AIMO-2 Winning Solution: Building State-of-the-Art Mathematical Reasoning Models with OpenMathReasoning datasetcited by 174
  32. 2024Style Vectors for Steering Generative Large Language Modelcited by 56
  33. 2024Understanding the Performance and Estimating the Cost of LLM Fine-Tuningcited by 48
  34. 2024PaCE: Parsimonious Concept Engineering for Large Language Modelscited by 19

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2024Model Surgery: Modulating LLM's Behavior Via Simple Parameter Editing
  2. 2024AtP*: An efficient and scalable method for localizing LLM behaviour to components
  3. 2025Guiding Giants: Lightweight Controllers for Weighted Activation Steering in LLMs
  4. 2025Learning a Single Token to Replace Long System Prompts in LLMs
  5. 2025Watch your steps: Dormant Adversarial Behaviors that Activate upon LLM Finetuning
  6. 2026Training-Free Task Vectors for LLM Behavioral Control
  7. 2024Semantics-Adaptive Activation Intervention for LLMs via Dynamic Steering Vectors
  8. 2026Activation Surgery: Jailbreaking White-box LLMs without Touching the Prompt