mlsanityData to 7 Oct 2026

Policy Gradient Methods for Reinforcement Learning with Function Approximation and Action-Dependent Baselines

arXiv 1706.06643 ↗First posted 20 Jun 2017cs.AI cs.LGcited by 20

Not on the map. Why?

Abstract (arXiv)

We show how an action-dependent baseline can be used by the policy gradient theorem using function approximation, originally presented with action-independent baselines by (Sutton et al. 2000).

Key facts. Cited by 20 papers in the map (data through 7 Oct 2026). First posted on arXiv 20 Jun 2017.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 9; 2022: 2; 2023: 2; 2024: 1; 2025: 3; 2026: 3.

20 papers.

Sort:

By area:

  1. 2022Risk-Sensitive Reinforcement Learning with Exponential Criteriacited by 15
  2. 2023Would I have gotten that reward? Long-term credit assignment by counterfactual contribution analysiscited by 10
  3. 2025SEM: Reinforcement Learning for Search-Efficient Large Language Modelscited by 9
  4. 2021Factored Policy Gradients: Leveraging Structure for Efficient Learning in MOMDPscited by 8
  5. 2025Reasoning BO: Enhancing Bayesian Optimization with Long-Context Reasoning Power of LLMscited by 8
  6. 2021Snowflake: Scaling GNNs to High-Dimensional Continuous Control via Parameter Freezingcited by 7
  7. 2024Doubly Optimal Policy Evaluation for Reinforcement Learningcited by 7
  8. 2021Convergence and Optimality of Policy Gradient Methods in Weakly Smooth Settingscited by 5
  9. 2021Meta-Reinforcement Learning for Reliable Communication in THz/VLC Wireless VR Networkscited by 4
  10. 2023Policy Gradient with Tree Expansioncited by 3
  11. 2021Generative deep learning for decision making in gas networkscited by 2
  12. 2025KETCHUP: K-Step Return Estimation for Sequential Knowledge Distillationcited by 2
8 more
  1. 2021Ensemble Consensus-based Representation Deep Reinforcement Learning for Hybrid FSO/RF Communication Systemscited by 1
  2. 2022SoftTreeMax: Policy Gradient with Tree Searchcited by 1
  3. 2021Tackling Variabilities in Autonomous Drivingcited by 0
  4. 2021On Solving a Stochastic Shortest-Path Markov Decision Process as Probabilistic Inferencecited by 0
  5. 2021Convergence of a Human-in-the-Loop Policy-Gradient Algorithm With Eligibility Trace Under Reward, Policy, and Advantage Feedbackcited by 0
  6. 2026OmniVLA-RL: A Vision-Language-Action Model with Spatial Understanding and Online RLcited by 0
  7. 2026Balancing Performance and Diversity in GRPO Autoregressive Text-to-Image Post-Trainingcited by 0
  8. 2026VICO: Visual Environments Co-Evolving for Vision-Language Model Reasoningcited by 0