mlsanityData to 14 Oct 2026

Position Paper: Rethinking Privacy in RL for Sequential Decision-making in the Age of LLMs

arXiv 2504.11511 ↗First posted 15 Apr 2025cs.LG cs.AIcited by 0

On the map: LLM reasoning → Reasoning for agents, planning and code

Abstract (arXiv)

The rise of reinforcement learning (RL) in critical real-world applications demands a fundamental rethinking of privacy in AI systems. Traditional privacy frameworks, designed to protect isolated data points, fall short for sequential decision-making systems where sensitive information emerges from temporal patterns, behavioral strategies, and collaborative dynamics. Modern RL paradigms, such as federated RL (FedRL) and RL with human feedback (RLHF) in large language models (LLMs), exacerbate these challenges by introducing complex, interactive, and context-dependent learning environments that traditional methods do not address. In this position paper, we argue for a new privacy paradigm built on four core principles: multi-scale protection, behavioral pattern protection, collaborative privacy preservation, and context-aware adaptation. These principles expose inherent tensions between privacy, utility, and interpretability that must be navigated as RL systems become more pervasive in high-stakes domains like healthcare, autonomous vehicles, and decision support systems powered by LLMs. To tackle these challenges, we call for the development of new theoretical frameworks, practical mechanisms, and rigorous evaluation methodologies that collectively enable effective privacy protection in sequential decision-making systems.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 7 of its 54 references that are in the map. First posted on arXiv 15 Apr 2025.

Builds on

7 of 54 references.

References · 7

  1. 2019Fine-Tuning Language Models from Human Preferencescited by 2,150
  2. 2024DeepSeek-V3 Technical Reportcited by 811
  3. 2024FedRLHF: A Convergence-Guaranteed Federated Framework for Privacy-Preserving and Personalized RLHFcited by 12
  4. 2024Cannot or Should Not? Automatic Analysis of Refusal Composition in IFT/RLHF Datasets and Refusal Behavior of Black-Box LLMscited by 11
  5. 2023Action and Trajectory Planning for Urban Autonomous Driving with Hierarchical Reinforcement Learningcited by 7
  6. 2023FedHQL: Federated Heterogeneous Q-Learningcited by 6
  7. 2025FedHPD: Heterogeneous Federated Reinforcement Learning via Policy Distillationcited by 4

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Privacy-R1: Privacy-Aware Multi-LLM Agent Collaboration via Reinforcement Learning
  2. 2025Towards User-level Private Reinforcement Learning with Human Feedback
  3. 2024Privacy Preserving Reinforcement Learning for Population Processes
  4. 2024Preserving Expert-Level Privacy in Offline Reinforcement Learning
  5. 2026Contextualized Privacy Defense for LLM Agents
  6. 2026Privacy-Preserving Reinforcement Learning from Human Feedback via Decoupled Reward Modeling
  7. 2022Offline Reinforcement Learning with Differential Privacy
  8. 2024Differentially Private Reinforcement Learning with Self-Play