UR-VC: Unsupervised Robotic Value Correction for Time-Derived Progress Proxies
Not on the map. Why?
Abstract (arXiv)
Modern robot learning systems increasingly rely on dense progress or value signals to evaluate intermediate states, guide policy learning, and detect task completion, making the quality of these signals critical. Since such dense labels are rarely available at scale, normalized time within a demonstration is often used as a scalable substitute: later frames are treated as higher progress. However, this time-derived label is only a noisy proxy for physical task progress. In contact-rich manipulation, a robot may make progress and then lose it through slips, failed grasps, or partial undoing, while the time-derived label continues to increase monotonically. We introduce Unsupervised Robotic Value Correction (UR-VC), an offline, training-free method for correcting time-derived progress labels. UR-VC exploits a simple regularity in demonstration data: similar states often recur across different episodes, but at different timestamps. Instead of trusting the timestamp from a single trajectory, UR-VC retrieves similar states from other episodes and aggregates their time-derived labels to obtain a corrected progress estimate. UR-VC requires no manual progress labels, reward annotations, or additional value model. We evaluate UR-VC on real bimanual cloth flatten-and-fold data, a long-horizon deformable-object manipulation task with visible intermediate progress. The corrected labels capture local regressions and non-uniform progress that normalized time cannot represent, while preserving the overall task trend. We further use the corrected signal to construct advantage labels for VLA training, following recent advantage-conditioned policy learning. UR-VC shows a positive trend in real-robot task success under matched data, model, and training settings.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 26 of its 29 references that are in the map. First posted on arXiv 14 Jul 2026.
Builds on
26 of 29 references.
References · 26
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,653
- 2021Decision Transformer: Reinforcement Learning via Sequence Modelingcited by 1,528
- 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,490
- 2025SigLIP 2: Multilingual Vision-Language Encoders with Improved Semantic Understanding, Localization, and Dense Featurescited by 1,127
- 2019Advantage-Weighted Regression: Simple and Scalable Off-Policy Reinforcement Learningcited by 750
- 2017Time-Contrastive Networks: Self-Supervised Learning from Videocited by 453
- 2022VIP: Towards Universal Visual Reward and Representation via Value-Implicit Pre-Trainingcited by 384
- 2024Mobile ALOHA: Learning Bimanual Mobile Manipulation with Low-Cost Whole-Body Teleoperationcited by 377
- 2019Label Propagation for Deep Semi-supervised Learningcited by 287
14 more
- 2025π*0.6: a VLA That Learns From Experiencecited by 280
- 2021RvS: What is Essential for Offline RL via Supervised Learning?cited by 184
- 2023LIV: Language-Image Representations and Rewards for Robotic Controlcited by 180
- 2023RoboCLIP: One Demonstration is Enough to Learn Robot Policiescited by 128
- 2020SoftGym: Benchmarking Deep Reinforcement Learning for Deformable Object Manipulationcited by 118
- 2025Gemini Robotics 1.5: Pushing the Frontier of Generalist Robots with Advanced Embodied Reasoning, Thinking, and Motion Transfercited by 86
- 2024Vision Language Models are In-Context Value Learnerscited by 84
- 2023Diffusion Reward: Learning Rewards via Conditional Video Diffusioncited by 56
- 2023Robotic Offline RL from Internet Videos via Value-Function Pre-Trainingcited by 31
- 2026TOPReward: Token Probabilities as Hidden Zero-Shot Rewards for Roboticscited by 29
- 2026chi0: Resource-Aware Robust Manipulation via Taming Distributional Inconsistenciescited by 11
- 2024Robot Policy Learning with Temporal Optimal Transport Rewardcited by 8
- 2026ViVa: A Video-Generative Value Model for Robot Reinforcement Learningcited by 8
- 2025CLASP: General-Purpose Clothes Manipulation with Semantic Keypointscited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.
- 2026ARS: Agentic Reward System for Robot Learningcited by 0
- 2026ARS: Agentic Reward System for Robot Learning28 Sep 2026
Similar, not cited
Close in wording, no citation either way
- 2026RynnValue: Scaling Robotic Value Foundation Models with Temporal Distance
- 2026ProcVLM: Learning Procedure-Grounded Progress Rewards for Robotic Manipulation
- 2026Beyond Monotonic Progress: Retry-Supervised Value Learning for Robot Imitation
- 2026ProgressVLA: Progress-Guided Diffusion Policy for Vision-Language Robotic Manipulation
- 2026WARP-RM: A Warp-Augmented Relative Progress Reward Model for Data Curation
- 2026RARM: Confidence-Gated Progress Reward Modeling for RL in Manipulation
- 2024PROGRESSOR: A Perceptually Guided Reward Estimator with Self-Supervised Online Refinement
- 2026See, Plan, Rewind: Progress-Aware Vision-Language-Action Models for Robust Robotic Manipulation