Sell Me This Stock: Unsafe Recommendation Drift in LLM Agents
On the map: LLM agents and tool use → Financial trading and forecasting agents
Abstract (arXiv)
People increasingly use LLM agents for multi-turn financial recommendations, where the agent pulls market data through tools and tracks user preferences across turns. When tool outputs are manipulated, the recommendations stop matching the user's stated risk profile, but because standard metrics like NDCG only score general relevance, risky and safe stocks score alike, so the metric says nothing went wrong. We call this gap evaluation blindness. We replay 23-turn financial advisory conversations across eight language models, running each dialogue twice with clean and manipulated tool data. Quality scores stay nearly identical to clean sessions while the agents produce risk-mismatched recommendations in 65-99% of turns, unanimous across all eight models. The mechanism is visible turn-by-turn: 80% of risk-score citations across 1,840 turns reproduce the manipulated value verbatim, not a single turn pushes back, and safe-language framing of high-risk stocks ranges from 14% (Qwen2.5-7B) to 69% (Claude Sonnet 4.6). The property that makes frontier models good agents, faithfully grounding their reasoning in tool outputs, also makes them follow manipulated ones. The damage is not memory-driven: contaminating only the current turn still produces 95% of the violations. The model internally distinguishes the manipulation (sparse autoencoder features separate adversarial from random perturbations), but this does not translate into safer output. Activation-level interventions recover under 6% of the safety gap, prompt-level self-verification fails because the self-check reads the same manipulated data, and a parametric cross-check that flags contamination at 99-100% per turn on a frontier model still leaves aggregate suitability unchanged: the agent identifies the tampering and recommends it anyway.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Financial trading and forecasting agents, one of 16 directions in LLM agents and tool use. Builds on 24 of its 52 references that are in the map. First posted on arXiv 13 Mar 2026.
Builds on
24 of 52 references.
References · 24
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,182
- 2023Universal and Transferable Adversarial Attacks on Aligned Language Modelscited by 3,104
- 2022Locating and Editing Factual Associations in GPTcited by 2,691
- 2023Not what you've signed up for: Compromising Real-World LLM-Integrated Applications with Indirect Prompt Injectioncited by 1,443
- 2023Sparse Autoencoders Find Highly Interpretable Features in Language Modelscited by 1,420
- 2024τ-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domainscited by 1,402
- 2016Understanding intermediate layers using linear classifier probescited by 1,353
- 2023Gorilla: Large Language Model Connected with Massive APIscited by 1,332
- 2023GAIA: a benchmark for General AI Assistantscited by 1,128
- 2023BloombergGPT: A Large Language Model for Financecited by 939
- 2021Probing Classifiers: Promises, Shortcomings, and Advancescited by 876
- 2022Ignore Previous Prompt: Attack Techniques For Language Modelscited by 832
12 more
- 2023Identifying the Risks of LM Agents with an LM-Emulated Sandboxcited by 548
- 2023A Survey on Large Language Models for Recommendationcited by 379
- 2013Direct and Indirect Effectscited by 280
- 2023Finding Alignments Between Interpretable Causal Variables and Distributed Neural Representationscited by 209
- 2019Are We Really Making Much Progress? A Worrying Analysis of Recent Neural Recommendation Approachescited by 185
- 2023Do the Rewards Justify the Means? Measuring Trade-Offs Between Rewards and Ethical Behavior in the MACHIAVELLI Benchmarkcited by 182
- 2022A Survey on Trustworthy Recommender Systemscited by 41
- 2026Unsafer in Many Turns: Benchmarking and Defending Multi-Turn Safety Risks in Tool-Using Agentscited by 30
- 2025SABER: Small Actions, Big Errors -- Safeguarding Mutating Steps in LLM Agentscited by 21
- 2026Adversarial News and Lost Profits: Manipulating Headlines in LLM-Driven Algorithmic Tradingcited by 4
- 2026Conv-FinRe: A Conversational and Longitudinal Benchmark for Utility-Grounded Financial Recommendationcited by 4
- 2025Safe for Whom? Rethinking How We Evaluate the Safety of LLMs for Real Userscited by 2
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2025Standard Benchmarks Fail -- Auditing LLM Agents in Finance Must Prioritize Risk
- 2026Signal or Noise in Multi-Agent LLM-based Stock Recommendations?
- 2026Measurement Boundaries in LLM Financial Agent Evaluation: Fixed-Tape Execution and Multi-Defect Auditing
- 2026Are LLMs Good Financial User Simulators? Multi-view Investor Logic Alignment (MILA)
- 2026The Price of Agreement: Measuring LLM Sycophancy in Agentic Financial Applications
- 2024INVESTORBENCH: A Benchmark for Financial Decision-Making Tasks with LLM-based Agent
- 2026Representation Signatures and Risk-Feedback Alignment in LLM Trading Agents
- 2026Agent Policy-Value Audit: Separating Transition Composition from Event Selection in Financial LLM Agents