mlsanityData to 14 Oct 2026

NavCMPO: Critic-Guided MeanFlow Policy Optimization for Adaptive Navigation

arXiv 2607.14643 ↗First posted 16 Jul 2026cs.ROcited by 0

On the map: Deep reinforcement learning methods → RL with diffusion and flow models

Abstract (arXiv)

End-to-end diffusion-based policies have demonstrated strong performance in mapless visual navigation, but their iterative denoising process introduces substantial inference latency, while behavior cloning limits performance to the quality of expert demonstrations. We present NavCMPO, a two-stage adaptive navigation framework that combines few-step MeanFlow trajectory generation, critic-guided refinement, and reinforcement learning fine-tuning. During pre-training, an obstacle proximity prediction task encourages the visual representation to capture obstacle-aware spatial information. To compensate for the degradation in obstacle avoidance caused by few-step generation, Critic-Guided Trajectory Refinement (CGTR) uses gradients from a critic trained with obstacle-point-cloud supervision to refine intermediate trajectories. During adaptation, the MeanFlow policy is fine-tuned using Proximal Policy Optimization with behavior-cloning regularization, while the critic is updated to accommodate embodiment-specific observation changes. Under a matched training budget on the InternVLA-N1 benchmark, NavCMPO achieves an average success rate of 74.7%, exceeding the retrained NavDP baseline by 6.4 percentage points, while reducing inference latency from 85,ms to 60,ms. Experiments on a Unitree Go2 further demonstrate effective sim-to-real transfer.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in RL with diffusion and flow models, one of 15 directions in Deep reinforcement learning methods. Builds on 29 of its 32 references that are in the map. First posted on arXiv 16 Jul 2026.

Builds on

29 of 32 references.

Closest ancestors · 3

Same direction, newest first

  1. 2025Flow Matching Policy Gradients28 Jul
  2. 2025ReinFlow: Fine-tuning Flow Matching Policy with Online Reinforcement Learning28 May
  3. 2024Diffusion Policy Policy Optimization1 Sep

Other references · 26

  1. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
  2. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  3. 2022Flow Matching for Generative Modelingcited by 5,702
  4. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
  5. 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,838
  6. 2022Planning with Diffusion for Flexible Behavior Synthesiscited by 1,061
  7. 2025Flow-GRPO: Training Flow Matching Models via Online RLcited by 661
  8. 2025Mean Flows for One-step Generative Modelingcited by 561
  9. 2018On Evaluation of Embodied Navigation Agentscited by 547
  10. 2016Target-driven Visual Navigation in Indoor Scenes using Deep Reinforcement Learningcited by 366
  11. 2019DD-PPO: Learning Near-Perfect PointGoal Navigators from 2.5 Billion Framescited by 362
  12. 2023NoMaD: Goal Masked Diffusion Policies for Navigation and Explorationcited by 248
14 more
  1. 2020Accelerating Reinforcement Learning with Learned Skill Priorscited by 223
  2. 2017Cognitive Mapping and Planning for Visual Navigationcited by 212
  3. 2016Learning to Navigate in Complex Environmentscited by 198
  4. 2024FlowPolicy: Enabling Fast and Robust 3D Flow-based Policy via Consistency Flow Matching for Robot Manipulationcited by 104
  5. 2024One-Step Diffusion Policy: Fast Visuomotor Policies via Diffusion Distillationcited by 89
  6. 2025NavDP: Learning Sim-to-Real Navigation Diffusion Policy with Privileged Information Guidancecited by 49
  7. 2023ViPlanner: Visual Semantic Imperative Learning for Local Navigationcited by 46
  8. 2023iPlanner: Imperative Path Planningcited by 37
  9. 2025MP1: MeanFlow Tames Policy Learning in 1-step for Robotic Manipulationcited by 35
  10. 2025NaviDiffusor: Cost-Guided Diffusion Model for Visual Navigationcited by 25
  11. 2024FlowNav: Combining Flow Matching and Depth Priors for Efficient Navigationcited by 12
  12. 2025Spatially-Enhanced Recurrent Memory for Long-Range Mapless Navigation via End-to-End Reinforcement Learningcited by 11
  13. 2025Two-Steps Diffusion Policy for Robotic Manipulation via Genetic Denoisingcited by 8
  14. 2026OGPO: One-Step Generative Policy Optimization for Real-Time Robot Controlcited by 7

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Beyond Imitation: Reinforcement Learning Fine-Tuning for Adaptive Diffusion Navigation Policies
  2. 2026Trajectory-Diversity-Driven Robust Vision-and-Language Navigation
  3. 2025Exploration and Adaptation in Non-Stationary Tasks with Diffusion Policies
  4. 2026NavRL++: A System-Level Framework for Improving Sim-to-Real Transfer in Reinforcement Learning-Based Robot Navigation
  5. 2026NavWAM: A Navigation World Action Model for Goal-Conditioned Visual Navigation
  6. 2026X-NavDP: Generalizing Navigation Diffusion Policy to Novel Behavior and Embodiments with Group Q-score Reweighted Matching
  7. 2026Fisher-Preserving Guidance: Training-Free Manifold Constraints for Safe Diffusion Control
  8. 2026Score-Based One-step MeanFlow Policy Optimization