mlsanityData to 14 Oct 2026

Soft Actor-Critic for Discrete Action Settings

arXiv 1910.07207 ↗First posted 16 Oct 2019cs.LG cs.AI stat.MLcited by 174

Not on the map. Why?

Cited by 52 in Deep reinforcement learning methods, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

Soft Actor-Critic is a state-of-the-art reinforcement learning algorithm for continuous action settings that is not applicable to discrete action settings. Many important settings involve discrete actions, however, and so here we derive an alternative version of the Soft Actor-Critic algorithm that is applicable to discrete action settings. We then show that, even without any hyperparameter tuning, it is competitive with the tuned model-free state-of-the-art on a selection of games from the Atari suite.

Key facts. Cited by 174 papers in the map (data through 14 Oct 2026). First posted on arXiv 16 Oct 2019.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2021: 23; 2022: 27; 2023: 33; 2024: 31; 2025: 37; 2026: 23.

174 papers.

Sort:

By area:

  1. 2022Trajectory balance: Improved credit assignment in GFlowNetscited by 251
  2. 2022Learning GFlowNets from partial episodes for improved convergence and stabilitycited by 132
  3. 2021Recurrent Model-Free RL Can Be a Strong Baseline for Many POMDPscited by 122
  4. 2021d3rlpy: An Offline Deep Reinforcement Learning Librarycited by 84
  5. 2021Hit and Lead Discovery with Explorative RL and Fragment-based Molecule Generationcited by 68
  6. 2023Generative Flow Networks as Entropy-Regularized RLcited by 64
  7. 2023When Do Transformers Shine in RL? Decoupling Memory from Credit Assignmentcited by 63
  8. 2022Safe Reinforcement Learning via Shielding under Partial Observabilitycited by 56
  9. 2024Discrete Probabilistic Inference as Control in Multi-path Environmentscited by 44
  10. 2023AMAGO: Scalable In-Context Reinforcement Learning for Adaptive Agentscited by 41
  11. 2023A Joint Modeling of Vision-Language-Action for Target-oriented Grasping in Cluttercited by 34
  12. 2024LLM-Empowered State Representation for Reinforcement Learningcited by 28
38 more
  1. 2021Value Function Spaces: Skill-Centric State Abstractions for Long-Horizon Reasoningcited by 26
  2. 2022Bellman Meets Hawkes: Model-Based Reinforcement Learning via Temporal Point Processescited by 23
  3. 2023Enabling AI-Generated Content (AIGC) Services in Wireless Edge Networkscited by 21
  4. 2025Behavior-Regularized Diffusion Policy Optimization for Offline Reinforcement Learningcited by 20
  5. 2022Influencing Long-Term Behavior in Multiagent Reinforcement Learningcited by 18
  6. 2022Leveraging Fully Observable Policies for Learning under Partial Observabilitycited by 18
  7. 2022Hybrid Multi-agent Deep Reinforcement Learning for Autonomous Mobility on Demand Systemscited by 18
  8. 2023A General Offline Reinforcement Learning Framework for Interactive Recommendationcited by 18
  9. 2024Deep Reinforcement Learning-based Large-scale Robot Explorationcited by 16
  10. 2024AMAGO-2: Breaking the Multi-Task Barrier in Meta-Reinforcement Learning with Transformerscited by 15
  11. 2021Neural Network Verification in Controlcited by 14
  12. 2022Revisiting Discrete Soft Actor-Criticcited by 13
  13. 2024EXTRACT: Efficient Policy Learning by Extracting Transferable Robot Skills from Offline Datacited by 13
  14. 2021Closing the Planning-Learning Loop with Application to Autonomous Drivingcited by 12
  15. 2024CIMRL: Combining IMitation and Reinforcement Learning for Safe Autonomous Drivingcited by 12
  16. 2025Blending Complementary Memory Systems in Hybrid Quadratic-Linear Transformerscited by 12
  17. 2023RTDK-BO: High Dimensional Bayesian Optimization with Reinforced Transformer Deep kernelscited by 11
  18. 2025Dream to Drive with Predictive Individual World Modelcited by 11
  19. 2021Target Entropy Annealing for Discrete Soft Actor-Criticcited by 10
  20. 2021Addressing Action Oscillations through Learning Policy Inertiacited by 9
  21. 2024Stable Hadamard Memory: Revitalizing Memory-Augmented Agents for Reinforcement Learningcited by 9
  22. 2021Hierarchical Reinforcement Learning for Air Combat at DARPA's AlphaDogfight Trialscited by 8
  23. 2023Global Rewards in Multi-Agent Deep Reinforcement Learning for Autonomous Mobility on Demand Systemscited by 8
  24. 2022Event-Triggered Model Predictive Control with Deep Reinforcement Learning for Autonomous Drivingcited by 7
  25. 2023Utilizing Reinforcement Learning for de novo Drug Designcited by 7
  26. 2023Explaining RL Decisions with Trajectoriescited by 7
  27. 2025SLAC: Safe and Efficient Real-Robot Reinforcement Learning via Unsupervised Simulation Pre-Trainingcited by 7
  28. 2025Relative Entropy Pathwise Policy Optimizationcited by 7
  29. 2021Policy Gradients Incorporating the Futurecited by 6
  30. 2021Identifying optimal cycles in quantum thermal machines with reinforcement-learningcited by 6
  31. 2024Risk-Sensitive Soft Actor-Critic for Robust Deep Reinforcement Learning under Distribution Shiftscited by 6
  32. 2024Offline Reinforcement Learning for Learning to Dispatch for Job Shop Schedulingcited by 6
  33. 2024Open-World Drone Active Tracking with Goal-Centered Rewardscited by 6
  34. 2026Android Coach: Improve Online Agentic Training Efficiency with Single State Multiple Actionscited by 6
  35. 2021Graph augmented Deep Reinforcement Learning in the GameRLand3D environmentcited by 5
  36. 2022Offline Reinforcement Learning for Road Traffic Controlcited by 5
  37. 2024Grasp, See, and Place: Efficient Unknown Object Rearrangement with Policy Structure Priorcited by 5
  38. 2024Towards Multi-agent Reinforcement Learning based Traffic Signal Control through Spatio-temporal Hypergraphscited by 5

50 most cited of 174 All 174 (JSON)