mlsanityData to 7 Oct 2026

One Size Fits None: Heuristic Collapse in LLM Investment Advice

arXiv 2604.23837 ↗First posted 26 Apr 2026cs.CL cs.LGcited by 1

Not on the map. Why?

Abstract (arXiv)

Large language models are increasingly deployed as advisors in high-stakes domains -- answering medical questions, interpreting legal documents, recommending financial products -- where good advice requires integrating a user's full context rather than responding to salient surface features. We investigate whether frontier LLMs actually do this, or whether they instead exhibit heuristic collapse: a systematic reduction of complex, multi-factor decisions to a small number of dominant inputs. We study the phenomenon in investment advice, where legal standards explicitly require individualized reasoning over a client's full circumstances. Applying interpretable surrogate models to LLM outputs, we find systematic heuristic collapse: investment allocation decisions are largely determined by self-reported risk tolerance, while other relevant factors contribute minimally. We further find that web search partially attenuates heuristic collapse but does not resolve it. These findings suggest that heuristic collapse is not resolved by web search augmentation or model scale alone, and that deploying LLMs as advisors requires auditing input sensitivity, not just output quality.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 15 of its 22 references that are in the map. First posted on arXiv 26 Apr 2026.

Builds on

15 of 22 references.

References · 15

  1. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
  2. 2017A Unified Approach to Interpreting Model Predictionscited by 6,488
  3. 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,040
  4. 2024GPT-4o System Cardcited by 4,467
  5. 2022Locating and Editing Factual Associations in GPTcited by 2,609
  6. 2020Shortcut Learning in Deep Neural Networkscited by 1,928
  7. 2020Beyond Accuracy: Behavioral Testing of NLP models with CheckListcited by 979
  8. 2021Probing Classifiers: Promises, Shortcomings, and Advancescited by 831
  9. 2023Inspecting and Editing Knowledge Representations in Language Modelscited by 140
  10. 2024Cognitive Bias in Decision-Making with LLMscited by 104
  11. 2024LLM economicus? Mapping the Behavioral Biases of LLMs via Utility Theorycited by 44
  12. 2023Do Large Language Models Show Decision Heuristics Similar to Humans? A Case Study Using GPT-3.5cited by 41
3 more
  1. 2024Anchoring Bias in Large Language Models: An Experimental Studycited by 37
  2. 2024A Comprehensive Evaluation of Cognitive Biases in LLMscited by 32
  3. 2025Are Generative AI Agents Effective Personalized Financial Advisors?cited by 18

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.