Learning Goal-Reaching Quasimetric Geometry From Finite-Time Reachability
Not on the map. Why?
Abstract (arXiv)
In goal-conditioned reinforcement learning (GCRL), quasimetric learning models goal-reaching costs as quasimetric distances, connecting local constraints to global value geometry. Its local constraints, however, should reflect the direction- dependent effects of control composition over a finite horizon together with environmental feasibility. We propose ReQRL, which constrains the critic's value gradients through finite-horizon reachability. Drawing on state-constrained optimal control, we decouple dynamical reachability from boundary geometry, estimating both from data. On OGBench, our method outperforms or rivals existing quasimetric approaches and other offline GCRL methods.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 26 of its 49 references that are in the map. First posted on arXiv 30 Sep 2026.
Builds on
26 of 49 references.
References · 26
- 2015Continuous control with deep reinforcement learningcited by 3,279
- 2021Offline Reinforcement Learning with Implicit Q-Learningcited by 1,245
- 2019Advantage-Weighted Regression: Simple and Scalable Off-Policy Reinforcement Learningcited by 750
- 2022Contrastive Learning as Goal-Conditioned Reinforcement Learningcited by 241
- 2024OGBench: Benchmarking Offline Goal-Conditioned RLcited by 216
- 2019Search on the Replay Buffer: Bridging Planning and Reinforcement Learningcited by 188
- 2023Safety-Gymnasium: A Unified Safe Reinforcement Learning Benchmarkcited by 135
- 2023HIQL: Offline Goal-Conditioned RL with Latent States as Actionscited by 133
- 2021Actionable Models: Unsupervised Offline Reinforcement Learning of Robotic Skillscited by 125
- 2023Optimal Goal-Reaching Reinforcement Learning via Quasimetric Learningcited by 116
- 2018Temporal Difference Models: Model-Free Deep RL for Model-Based Controlcited by 89
- 2022Rethinking Goal-conditioned Supervised Learning and Its Connection to Offline RLcited by 89
14 more
- 2024Foundation Policies with Hilbert Representationscited by 89
- 2019Dynamical Distance Learning for Semi-Supervised and Unsupervised Skill Discoverycited by 65
- 2022How Far I'll Go: Offline Goal-Conditioned Reinforcement Learning via f-Advantage Regressioncited by 65
- 2024Learning Temporal Distances: Contrastive Successor Features Can Provide a Metric Structure for Decision-Makingcited by 53
- 2022Improved Representation of Asymmetrical Distances with Interval Quasimetric Embeddingscited by 22
- 2025Option-aware Temporally Abstracted Value for Offline Goal-Conditioned Reinforcement Learningcited by 22
- 2020Plan2Vec: Unsupervised Representation Learning by Latent Planscited by 21
- 2025Offline Goal-conditioned Reinforcement Learning with Quasimetric Representationscited by 20
- 2025Physics-informed Value Learner for Offline Goal-Conditioned Reinforcement Learningcited by 15
- 2025Graph-Assisted Stitching for Offline Hierarchical Reinforcement Learningcited by 12
- 2025Flattening Hierarchies with Policy Bootstrappingcited by 8
- 2023Data-driven Reachability using Christoffel Functions and Conformal Predictioncited by 6
- 2025Goal Reaching with Eikonal-Constrained Hierarchical Quasimetric Reinforcement Learningcited by 6
- 2016Inverse Problems for Matrix Exponential in System Identification: System Aliasingcited by 3
Built on by
Not cited yet.