Reverse Experience Replay
Not on the map. Why?
Abstract (arXiv)
This paper describes an improvement in Deep Q-learning called Reverse Experience Replay (also RER) that solves the problem of sparse rewards and helps to deal with reward maximizing tasks by sampling transitions successively in reverse order. On tasks with enough experience for training and enough Experience Replay memory capacity, Deep Q-learning Network with Reverse Experience Replay shows competitive results against both Double DQN, with a standard Experience Replay, and vanilla DQN. Also, RER achieves significantly increased results in tasks with a lack of experience and Replay memory capacity.
Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). First posted on arXiv 19 Oct 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 3; 2022: 1; 2023: 2; 2024: 2.
8 papers.
- 2021Online Target Q-learning with Reverse Experience Replay: Efficiently finding the Optimal Policy for Linear MDPscited by 19
- 2021Streaming Linear System Identification with Reverse Experience Replaycited by 17
- 2021Near-optimal Offline and Streaming Algorithms for Learning Non-Linear Dynamical Systemscited by 17
- 2024Efficient Preference-based Reinforcement Learning via Aligned Experience Estimationcited by 9
- 2022Introspective Experience Replay: Look Back When Surprisedcited by 3
- 2023Can Active Sampling Reduce Causal Confusion in Offline Reinforcement Learning?cited by 2
- 2023Finite-Time Analysis of Temporal Difference Learning with Experience Replaycited by 1
- 2024A Tighter Convergence Proof of Reverse Experience Replaycited by 0
- 2024A Tighter Convergence Proof of Reverse Experience Replay30 Aug 2024
- 2024Efficient Preference-based Reinforcement Learning via Aligned Experience Estimation29 May 2024
- 2023Can Active Sampling Reduce Causal Confusion in Offline Reinforcement Learning?28 Dec 2023
- 2023Finite-Time Analysis of Temporal Difference Learning with Experience Replay16 Jun 2023
- 2022Introspective Experience Replay: Look Back When Surprised7 Jun 2022
- 2021Online Target Q-learning with Reverse Experience Replay: Efficiently finding the Optimal Policy for Linear MDPs16 Oct 2021
- 2021Near-optimal Offline and Streaming Algorithms for Learning Non-Linear Dynamical Systems24 May 2021
- 2021Streaming Linear System Identification with Reverse Experience Replay10 Mar 2021