mlsanityData to 7 Oct 2026

Deterministic World Models for Closed-loop Reachability Analysis of End-to-End Vision-based Control

arXiv 2512.08991 ↗First posted 8 Dec 2025cs.CV cs.LGcited by 2

On the map: World models → Embodied and robot world models

Abstract (arXiv)

End-to-end image controllers that map raw camera frames directly to control actions are increasingly deployed in safety-critical systems. However, formally verifying their closed-loop behavior remains an open challenge because cameras produce high-dimensional images whose generation cannot easily be described in a closed mathematical form. We propose a Deterministic World Model (DWM), a latent-free neural decoder that maps physical states (e.g., position and velocity) directly to synthetic camera images, enabling closed-loop reachability analysis without the overapproximation caused by stochastic latent variables. The DWM is trained with a novel dual loss combining saliency-map reconstruction and a control-consistent term that preserves behavioral consistency with the real controller. We integrate the DWM into closed-loop reachability analysis and apply conformal prediction to inflate the reachable sets by a distribution-free trajectory-tube deviation bound, transferring the surrogate guarantee to the real system with high probability. Experiments on a CARLA braking system and three Gym benchmarks (CartPole, MountainCar, Pendulum) show that the DWM produces substantially tighter reachable tubes than a cGAN and trajectory predictor baselines while meeting the target coverage after conformal inflation.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Embodied and robot world models, one of 11 directions in World models. Builds on 13 of its 35 references that are in the map. First posted on arXiv 8 Dec 2025.

Builds on

13 of 35 references.

References · 13

  1. 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,510
  2. 2017Toward Multimodal Image-to-Image Translationcited by 295
  3. 2019Algorithms for Verifying Deep Neural Networkscited by 221
  4. 2018Verisig: verifying safety properties of hybrid systems with neural network controllerscited by 83
  5. 2020Generative Data Augmentation for Commonsense Reasoningcited by 49
  6. 2023Conformal Prediction Regions for Time Series using Linear Complementarity Programmingcited by 33
  7. 2022NNLander-VeriF: A Neural Network Formal Verification Framework for Vision-Based Autonomous Aircraft Landingcited by 19
  8. 2021Maneuver-based Trajectory Prediction for Self-driving Cars Using Spatio-temporal Convolutional Networkscited by 14
  9. 2021Neural Network Verification in Controlcited by 14
  10. 2018Robust Conditional Generative Adversarial Networkscited by 8
  11. 2024Scalable Surrogate Verification of Image-based Neural Network Control Systems using Composition and Unrollingcited by 8
  12. 2023Bridging Dimensions: Confident Reachability for High-Dimensional Controllerscited by 5
1 more
  1. 2025State-Dependent Conformal Perception Bounds for Neuro-Symbolic Verification of Autonomous Systemscited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Pixels to Proofs: Probabilistically-Safe Latent World Model Control via Parallel Conformal Robust MPC
  2. 2026Steering Robustness into World Action Models via Mechanistic Interpretability and Optimal Control
  3. 2025Generalizing Safety Beyond Collision-Avoidance via Latent-Space Reachability Analysis
  4. 2026World Model Control by Trajectory Reachability Metrics
  5. 2026Hydra: A Navigation World Action Model with Discrete Latent Planning and Continuous Flow-Matching Execution
  6. 2026WM-VS: Progress-Aligned World Models for Closed-Loop Visual Servoing
  7. 2026Selective Cross-View Consistency for World Action Models: Held-Out Viewpoint Robustness Without Test-Time Camera Information
  8. 2025AnySafe: Adapting Latent Safety Filters at Runtime via Safety Constraint Parameterization in the Latent Space