mlsanityData to 7 Oct 2026

On the Unreasonable Efficiency of State Space Clustering in Personalization Tasks

arXiv 2112.13141 ↗First posted 24 Dec 2021cs.LG cs.AI cs.NAcited by 3

Not on the map. Why?

Abstract (arXiv)

In this effort we consider a reinforcement learning (RL) technique for solving personalization tasks with complex reward signals. In particular, our approach is based on state space clustering with the use of a simplistic k-means algorithm as well as conventional choices of the network architectures and optimization algorithms. Numerical examples demonstrate the efficiency of different RL procedures and are used to illustrate that this technique accelerates the agent's ability to learn and does not restrict the agent's performance.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 13 of its 46 references that are in the map. First posted on arXiv 24 Dec 2021.

Builds on

13 of 46 references.

References · 13

  1. 2017Proximal Policy Optimization Algorithmscited by 14,441
  2. 2013Playing Atari with Deep Reinforcement Learningcited by 3,211
  3. 2015Trust Region Policy Optimizationcited by 2,503
  4. 2016Asynchronous Methods for Deep Reinforcement Learningcited by 2,218
  5. 2019Dota 2 with Large Scale Deep Reinforcement Learningcited by 1,084
  6. 2019Reinforcement Learning in Healthcare: A Surveycited by 308
  7. 2016#Exploration: A Study of Count-Based Exploration for Deep Reinforcement Learningcited by 307
  8. 2017Near Optimal Behavior via Approximate State Abstractioncited by 63
  9. 2013Exploration in Interactive Personalized Music Recommendation: A Reinforcement Learning Approachcited by 22
  10. 2018Learning Representations in Model-Free Hierarchical Reinforcement Learningcited by 13
  11. 2019Data-driven unsupervised clustering of online learner behaviourcited by 6
  12. 2019Clustered Reinforcement Learningcited by 5
1 more
  1. 2015A Notation for Markov Decision Processescited by 3

Built on by

Cited by year

Citing papers per year: 2022: 2; 2023: 1.

3 papers.