RC-NF: Robot-Conditioned Normalizing Flow for Real-Time Anomaly Detection in Robotic Manipulation
Not on the map. Why?
Abstract (arXiv)
Recent advances in Vision-Language-Action (VLA) models have enabled robots to execute increasingly complex tasks. However, VLA models trained through imitation learning struggle to operate reliably in dynamic environments and often fail under Out-of-Distribution (OOD) conditions. To address this issue, we propose Robot-Conditioned Normalizing Flow (RC-NF), a real-time monitoring model for robotic anomaly detection and intervention that ensures the robot's state and the object's motion trajectory align with the task. RC-NF decouples the processing of task-aware robot and object states within the normalizing flow. It requires only positive samples for unsupervised training and calculates accurate robotic anomaly scores during inference through the probability density function. We further present LIBERO-Anomaly-10, a benchmark comprising three categories of robotic anomalies for simulation evaluation. RC-NF achieves state-of-the-art performance across all anomaly types compared to previous methods in monitoring robotic tasks. Real-world experiments demonstrate that RC-NF operates as a plug-and-play module for VLA models (e.g., pi0), providing a real-time OOD signal that enables state-level rollback or task-level replanning when necessary, with a response latency under 100 ms. These results demonstrate that RC-NF noticeably enhances the robustness and adaptability of VLA-based robotic systems in dynamic environments.
Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Builds on 46 of its 49 references that are in the map. First posted on arXiv 11 Mar 2026.
Builds on
46 of 49 references.
References · 46
- 2023Segment Anythingcited by 8,158
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,784
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
- 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,286
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,653
- 2018Glow: Generative Flow with Invertible 1x1 Convolutionscited by 1,539
- 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,338
- 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,167
- 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Successcited by 844
34 more
- 2023CoTracker: It is Better to Track Togethercited by 516
- 2024YOLO-World: Real-Time Open-Vocabulary Object Detectioncited by 498
- 2023Vision-Language Foundation Models as Effective Robot Imitatorscited by 344
- 2024ReKep: Spatio-Temporal Reasoning of Relational Keypoint Constraints for Robotic Manipulationcited by 305
- 2023Any-point Trajectory Modeling for Policy Learningcited by 207
- 2023Tracking Everything Everywhere All at Oncecited by 190
- 2025RoboBrain: A Unified Brain Model for Robotic Manipulation from Abstract to Concretecited by 134
- 2025HAMSTER: Hierarchical Action Models For Open-World Robot Manipulationcited by 125
- 2024Consistency Flow Matching: Defining Straight Flows with Velocity Consistencycited by 101
- 2024CoPa: General Robotic Manipulation through Spatial Constraints of Parts with Foundation Modelscited by 97
- 2025Galaxea Open-World Dataset and G0 Dual-System VLA Modelcited by 90
- 2024DINO-X: A Unified Vision Model for Open-World Object Detection and Understandingcited by 85
- 2025OpenHelix: A Short Survey, Empirical Analysis, and Open-Source Dual-System VLA Model for Robotic Manipulationcited by 79
- 2024HiRT: Enhancing Robotic Control with Hierarchical Robot Transformerscited by 72
- 2024Unpacking Failure Modes of Generative Policies: Runtime Monitoring of Consistency and Progresscited by 63
- 2022Normalizing Flows for Human Pose Anomaly Detectioncited by 59
- 2025OmniManip: Towards General Robotic Manipulation via Object-Centric Interaction Primitives as Spatial Constraintscited by 58
- 2024Follow the Rules: Reasoning for Video Anomaly Detection with Large Language Modelscited by 55
- 2025LLMDet: Learning Strong Open-Vocabulary Object Detectors under the Supervision of Large Language Modelscited by 53
- 2025From Foresight to Forethought: VLM-In-the-Loop Policy Steering via Latent Alignmentcited by 51
- 2025Can We Detect Failures Without Failure Data? Uncertainty-Aware Runtime Failure Detection for Imitation Learning Policiescited by 49
- 2024A Dual Process VLA: Efficient Robotic Manipulation Leveraging VLMcited by 44
- 2023Model-Based Runtime Monitoring with Interactive Imitation Learningcited by 37
- 2025Failure Prediction at Runtime for Generative Robot Policiescited by 36
- 2025Visual Embodied Brain: Let Multimodal Large Language Models See, Think, and Control in Spacescited by 33
- 2025Uncertainty-aware Latent Safety Filters for Avoiding Out-of-Distribution Failurescited by 30
- 2023Understanding the Challenges and Opportunities of Pose-based Anomaly Detectioncited by 14
- 2025Actor-Critic for Continuous Action Chunks: A Reinforcement Learning Framework for Long-Horizon Robotic Manipulation with Sparse Rewardcited by 13
- 2025RationalVLA: A Rational Vision-Language-Action Model with Dual Systemcited by 12
- 2024DA-Flow: Dual Attention Normalizing Flow for Skeleton-based Video Anomaly Detectioncited by 7
- 2025ConditionNET: Learning Preconditions and Effects for Execution Monitoringcited by 7
- 2025Hierarchical Task Decomposition for Execution Monitoring and Error Recovery: Understanding the Rationale Behind Task Demonstrationscited by 4
- 2025Multimodal Anomaly Detection with a Mixture-of-Expertscited by 3
- 2022CLUE-AI: A Convolutional Three-stream Anomaly Identification Framework for Robot Manipulationcited by 2
Built on by
Citing papers per year: 2026: 7.
7 papers.
- 2026Vision-Language-Action Safety: Threats, Challenges, Evaluations, and Mechanismscited by 12
- 2026Hide-and-Seek in Trajectories: Discovering Failure Signals for VLA Runtime Monitoringcited by 6
- 2026Tracing Agentic Failure from the Flow of Successcited by 5
- 2026Failure Detection for Surgical Robot Imitation Policies via Flow-Matching World Modelingcited by 3
- 2026PATCH: Action-Chunk-Conditioned Latent Patch Innovation Monitoring for Robot Manipulationcited by 2
- 2026VLA-FAIL: Efficient Task Failure Detection for Finetuned Vision-Language-Action Modelscited by 2
- 2026VLAConf: Calibrated Task-Success Confidence for Vision-Language-Action Modelscited by 1
- 2026Failure Detection for Surgical Robot Imitation Policies via Flow-Matching World Modeling29 Jul 2026
- 2026Tracing Agentic Failure from the Flow of Success14 Jul 2026
- 2026VLA-FAIL: Efficient Task Failure Detection for Finetuned Vision-Language-Action Models19 Jun 2026
- 2026PATCH: Action-Chunk-Conditioned Latent Patch Innovation Monitoring for Robot Manipulation15 Jun 2026
- 2026Hide-and-Seek in Trajectories: Discovering Failure Signals for VLA Runtime Monitoring29 May 2026
- 2026VLAConf: Calibrated Task-Success Confidence for Vision-Language-Action Models28 May 2026
- 2026Vision-Language-Action Safety: Threats, Challenges, Evaluations, and Mechanisms26 Apr 2026
Similar, not cited
Close in wording, no citation either way
- 2026Failure Identification in Imitation Learning Via Statistical and Semantic Filtering
- 2025ManiFlow: A General Robot Manipulation Policy via Consistency Flow Training
- 2026RoMAN-Flow: Taming Autoregressive Normalizing Flows for Offline Reinforcement Learning in Robotic Manipulation
- 2025VFP: Variational Flow-Matching Policy for Multi-Modal Robot Manipulation
- 2026Perturbation-Based Epistemic Uncertainty for Failure Detection in Vision-Language-Action Models
- 2026Flowing With Purpose: Latent Action Guided Flow Matching Policies For Robotic Manipulation
- 2026NarrativeFlow: Flow-Based Vision-Language-Action Model Using Robot Velocity Fields
- 2026Uncertainty Quantification for Flow-Based Vision-Language-Action Models