mlsanityData to 14 Oct 2026

Potent but Stealthy: Rethink Profile Pollution against Sequential Recommendation via Bi-level Constrained Reinforcement Paradigm

arXiv 2511.09392 ↗First posted 12 Nov 2025cs.LG cs.AIcited by 0

On the map: Deep reinforcement learning methods → RL training of language and agent models

Abstract (arXiv)

Sequential Recommenders, which exploit dynamic user intents through interaction sequences, is vulnerable to adversarial attacks. While existing attacks primarily rely on data poisoning, they require large-scale user access or fake profiles thus lacking practicality. In this paper, we focus on the Profile Pollution Attack that subtly contaminates partial user interactions to induce targeted mispredictions. Previous PPA methods suffer from two limitations, i.e., i) over-reliance on sequence horizon impact restricts fine-grained perturbations on item transitions, and ii) holistic modifications cause detectable distribution shifts. To address these challenges, we propose a constrained reinforcement driven attack CREAT that synergizes a bi-level optimization framework with multi-reward reinforcement learning to balance adversarial efficacy and stealthiness. We first develop a Pattern Balanced Rewarding Policy, which integrates pattern inversion rewards to invert critical patterns and distribution consistency rewards to minimize detectable shifts via unbalanced co-optimal transport. Then we employ a Constrained Group Relative Reinforcement Learning paradigm, enabling step-wise perturbations through dynamic barrier constraints and group-shared experience replay, achieving targeted pollution with minimal detectability. Extensive experiments demonstrate the effectiveness of CREAT.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in RL training of language and agent models, one of 15 directions in Deep reinforcement learning methods. Builds on 26 of its 45 references that are in the map. First posted on arXiv 12 Nov 2025.

Builds on

26 of 45 references.

References · 26

  1. 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,415
  2. 2018Self-Attentive Sequential Recommendationcited by 1,184
  3. 2019BERT4Rec: Sequential Recommendation with Bidirectional Encoder Representations from Transformercited by 964
  4. 2018Personalized Top-N Sequential Recommendation via Convolutional Sequence Embeddingcited by 476
  5. 2018Session-based Recommendation with Graph Neural Networkscited by 312
  6. 2017Neural Attentive Session-based Recommendationcited by 237
  7. 2023GPT4Rec: A Generative Framework for Personalized Recommendation and User Interests Interpretationcited by 103
  8. 2023Generate What You Prefer: Reshaping Sequential Recommendation via Guided Diffusioncited by 74
  9. 2020On Unbalanced Optimal Transport: An Analysis of Sinkhorn Algorithmcited by 61
  10. 2024LLM-ESR: Large Language Models Enhancement for Long-tailed Sequential Recommendationcited by 47
  11. 2021Data Poisoning Attacks to Deep Learning Based Recommender Systemscited by 43
  12. 2021Black-Box Attacks on Sequential Recommenders via Data-Free Model Extractioncited by 37
14 more
  1. 2021PipAttack: Poisoning Federated Recommender Systems forManipulating Item Promotioncited by 37
  2. 2020Revisiting Adversarially Learned Injection Attacks Against Recommender Systemscited by 32
  3. 2020Attacking Black-box Recommendations via Copying Cross-domain User Profilescited by 31
  4. 2020Practical Data Poisoning Attack against Next-Item Recommendationcited by 29
  5. 2022Faster Unbalanced Optimal Transport: Translation invariant Sinkhorn and 1-D Frank-Wolfecited by 22
  6. 2022Shilling Black-box Recommender Systems by Learning to Generate Fake User Profilescited by 15
  7. 2024Personalized Behavior-Aware Transformer for Multi-Behavior Sequential Recommendationcited by 15
  8. 2022Defending Substitution-Based Profile Pollution Attacks on Sequential Recommenderscited by 11
  9. 2023Enhancing User Intent Capture in Session-Based Recommendation with Attribute Patternscited by 11
  10. 2025Data Augmentation as Free Lunch: Exploring the Test-Time Augmentation for Sequential Recommendationcited by 9
  11. 2020DGTN: Dual-channel Graph Transition Network for Session-based Recommendationcited by 8
  12. 2024Poisoning Attacks against Recommender Systems: A Surveycited by 7
  13. 2024LoRec: Large Language Model for Robust Sequential Recommendation against Poisoning Attackscited by 3
  14. 2024Precision Profile Pollution Attack on Sequential Recommenders via Influence Functioncited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2023Robust Reinforcement Learning Objectives for Sequential Recommender Systems
  2. 2026Fairness Attacks on Recommender Systems
  3. 2026An Efficient and Effective Agentic Group Shilling Attack on Recommender Systems
  4. 2024UOEP: User-Oriented Exploration Policy for Enhancing Long-Term User Experiences in Recommender Systems
  5. 2025Reward Balancing Revisited: Enhancing Offline Reinforcement Learning for Recommender Systems
  6. 2025Energy-Guided Diffusion Sampling for Long-Term User Behavior Prediction in Reinforcement Learning-based Recommendation
  7. 2026VirusCascade: Hijacking Collaborative Reflection in LLM-Powered Recommender Agents
  8. 2026ProRL: Effective Reinforcement Learning for Proactive Recommendation via Rectified Policy Gradient Estimation