mlsanityData to 14 Oct 2026

Trading Devil RL: Backdoor attack via Stock market, Bayesian Optimization and Reinforcement Learning

arXiv 2412.17908 ↗First posted 23 Dec 2024cs.LG cs.CE physics.comp-phcited by 0

On the map: Deep reinforcement learning methods → Adversarial robustness and RL in finance

Abstract (arXiv)

With the rapid development of generative artificial intelligence, particularly large language models a number of sub-fields of deep learning have made significant progress and are now very useful in everyday applications. For example,financial institutions simulate a wide range of scenarios for various models created by their research teams using reinforcement learning, both before production and after regular operations. In this work, we propose a backdoor attack that focuses solely on data poisoning and a method of detection by dynamic systems and statistical analysis of the distribution of data. This particular backdoor attack is classified as an attack without prior consideration or trigger, and we name it FinanceLLMsBackRL. Our aim is to examine the potential effects of large language models that use reinforcement learning systems for text production or speech recognition, finance, physics, or the ecosystem of contemporary artificial intelligence models.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Adversarial robustness and RL in finance, one of 15 directions in Deep reinforcement learning methods. Builds on 98 of its 197 references that are in the map. First posted on arXiv 23 Dec 2024.

Builds on

98 of 197 references.

Closest ancestors · 2

Same direction, newest first

  1. 2024The Evolution of Reinforcement Learning in Quantitative Finance: A Survey20 Aug
  2. 2024Reinforcement Learning applied to Insurance Portfolio Pursuit1 Aug

Other references · 96

  1. 2018Soft Actor-Critic: Off-Policy Maximum Entropy Deep Reinforcement Learning with a Stochastic Actorcited by 4,885
  2. 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 4,057
  3. 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,905
  4. 2021HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden Unitscited by 2,342
  5. 2023BloombergGPT: A Large Language Model for Financecited by 939
  6. 2022data2vec: A General Framework for Self-supervised Learning in Speech, Vision and Languagecited by 727
  7. 2017A Brief Survey of Deep Reinforcement Learningcited by 483
  8. 2018Reinforcement Learning and Control as Probabilistic Inference: Tutorial and Reviewcited by 482
  9. 2023A Survey on Large Language Model (LLM) Security and Privacy: The Good, the Bad, and the Uglycited by 387
  10. 2019FinBERT: Financial Sentiment Analysis with Pre-trained Language Modelscited by 385
  11. 2017Deep Reinforcement Learning: An Overviewcited by 333
  12. 2019Reinforcement Learning in Healthcare: A Surveycited by 310
38 more
  1. 2024TrustLLM: Trustworthiness in Large Language Modelscited by 285
  2. 2023FinGPT: Open-Source Financial Large Language Modelscited by 253
  3. 2024Reinforcement learningcited by 247
  4. 2021Sustainable AI: Environmental Implications, Challenges and Opportunitiescited by 242
  5. 2023Large Language Models in Finance: A Surveycited by 226
  6. 2023PIXIU: A Large Language Model, Instruction Data and Evaluation Benchmark for Financecited by 222
  7. 2023Seamless: Multilingual Expressive and Streaming Speech Translationcited by 192
  8. 2024LLaMA-Omni: Seamless Speech Interaction with Large Language Modelscited by 173
  9. 2018Applications of Deep Reinforcement Learning in Communications and Networking: A Surveycited by 167
  10. 2018Deep Learning Methods for Reynolds-Averaged Navier-Stokes Simulations of Airfoil Flowscited by 150
  11. 2017A Deep Reinforcement Learning Framework for the Financial Portfolio Management Problemcited by 128
  12. 2022WHEN FLUE MEETS FLANG: Benchmarks and Large Pre-trained Language Model for Financial Domaincited by 117
  13. 2024FinCon: A Synthesized LLM Multi-Agent System with Conceptual Verbal Reinforcement for Enhanced Financial Decision Makingcited by 113
  14. 2021Recent Advances in Reinforcement Learning in Financecited by 110
  15. 2023A Survey of Safety and Trustworthiness of Large Language Models through the Lens of Verification and Validationcited by 93
  16. 2023XuanYuan 2.0: A Large Chinese Financial Chat Model with Hundreds of Billions Parameterscited by 92
  17. 2024A Survey of Large Language Models for Financial Applications: Progress, Prospects and Challengescited by 90
  18. 2020FinRL: A Deep Reinforcement Learning Library for Automated Stock Trading in Quantitative Financecited by 87
  19. 2023InvestLM: A Large Language Model for Investment using Financial Domain Instruction Tuningcited by 82
  20. 2021AI in Finance: Challenges, Techniques and Opportunitiescited by 81
  21. 2024A Survey of Large Language Models in Finance (FinLLMs)cited by 79
  22. 2024StepCoder: Improve Code Generation with Reinforcement Learning from Compiler Feedbackcited by 77
  23. 2019Deep Reinforcement Learning for Tradingcited by 73
  24. 2024An Overview of Diffusion Models: Applications, Guided Generation, Statistical Rates and Optimizationcited by 73
  25. 2023A Comprehensive Survey on Applications of Transformers for Deep Learning Taskscited by 71
  26. 2019Meta-learning of Sequential Strategiescited by 70
  27. 2021BACKDOORL: Backdoor Attack against Competitive Reinforcement Learningcited by 68
  28. 2019A review on Deep Reinforcement Learning for Fluid Mechanicscited by 66
  29. 2023DISC-FinLLM: A Chinese Financial Large Language Model based on Multiple Experts Fine-tuningcited by 64
  30. 2023Unifying the Perspectives of NLP and Software Engineering: A Survey on Language Models for Codecited by 62
  31. 2020Challenges and Countermeasures for Adversarial Attacks on Deep Reinforcement Learningcited by 61
  32. 2023BBT-Fin: Comprehensive Construction of Chinese Financial Domain Pre-trained Language Model, Corpus and Benchmarkcited by 60
  33. 2023Generative Pre-trained Transformer: A Comprehensive Review on Enabling Technologies, Potential Applications, Emerging Challenges, and Future Directionscited by 55
  34. 2019Data Poisoning Attacks on Stochastic Banditscited by 53
  35. 2018Practical Deep Reinforcement Learning Approach for Stock Tradingcited by 49
  36. 2018Market Making via Reinforcement Learningcited by 47
  37. 2021Can You Hear It? Backdoor Attacks via Ultrasonic Triggerscited by 44
  38. 2022LyaNet: A Lyapunov Framework for Training Neural ODEscited by 44

50 most cited of 96 All 96 (JSON)

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024Trading Devil Final: Backdoor attack via Stock market and Bayesian Optimization
  2. 2023Hiding Backdoors within Event Sequence Data via Poisoning Attacks
  3. 2026SoK: Trading Agents or Market Crashers? Dissecting Robustness and Security Failures in Academic Financial LLM Trading Schemes
  4. 2026Contagion on the Trading Floor: How Adversarial Signals Spread in Multi-Agent Trading Systems
  5. 2024Mitigating Backdoor Threats to Large Language Models: Advancement and Challenges
  6. 2024SleeperNets: Universal Backdoor Poisoning Attacks Against Reinforcement Learning Agents
  7. 2025A Survey on Backdoor Threats in Large Language Models (LLMs): Attacks, Defenses, and Evaluations
  8. 2024BackdoorLLM: A Comprehensive Benchmark for Backdoor Attacks and Defenses on Large Language Models