Refining Perception Contracts: Case Studies in Vision-based Safe Auto-landing
Not on the map. Why?
Abstract (arXiv)
Perception contracts provide a method for evaluating safety of control systems that use machine learning for perception. A perception contract is a specification for testing the ML components, and it gives a method for proving end-to-end system-level safety requirements. The feasibility of contract-based testing and assurance was established earlier in the context of straight lane keeping: a 3-dimensional system with relatively simple dynamics. This paper presents the analysis of two 6 and 12-dimensional flight control systems that use multi-stage, heterogeneous, ML-enabled perception. The paper advances methodology by introducing an algorithm for constructing data and requirement guided refinement of perception contracts (DaRePC). The resulting analysis provides testable contracts which establish the state and environment conditions under which an aircraft can safety touchdown on the runway and a drone can safely pass through a sequence of gates. It can also discover conditions (e.g., low-horizon sun) that can possibly violate the safety of the vision-based control system.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 19 of its 26 references that are in the map. First posted on arXiv 15 Nov 2023.
Builds on
19 of 26 references.
References · 19
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2016Concrete Problems in AI Safetycited by 1,582
- 2023Nerfstudio: A Modular Framework for Neural Radiance Field Developmentcited by 596
- 2023Reaching the Limit in Autonomous Racing: Optimal Control versus Reinforcement Learningcited by 72
- 2022Loc-NeRF: Monte Carlo Localization using Neural Radiance Fieldscited by 69
- 2020Guaranteeing Safety of Learned Perception Modules via Measurement-Robust Control Barrier Functionscited by 32
- 2017FaSTrack: a Modular Framework for Fast and Guaranteed Safe Motion Planningcited by 21
- 2019Robust Guarantees for Perception-Based Controlcited by 20
- 2021Verifying Controllers with Convolutional Neural Network-based Perception: A Case for Intelligible, Safe, and Precise Abstractionscited by 19
- 2022NNLander-VeriF: A Neural Network Formal Verification Framework for Vision-Based Autonomous Aircraft Landingcited by 19
- 2023Closed-loop Analysis of Vision-based Autonomous Systems: A Case Studycited by 18
- 2017DRYVR:Data-driven verification and compositional reasoning for automotive systemscited by 14
7 more
- 2021Efficient Reachability Analysis of Closed-Loop Systems with Neural Network Controllerscited by 10
- 2022Discrete-Event Controller Synthesis for Autonomous Systems with Deep-Learning Perception Componentscited by 5
- 2022Assuring Safety of Vision-Based Swarm Formation Controlcited by 3
- 2023Verse: A Python library for reasoning about multi-agent hybrid system scenarioscited by 3
- 2023Learning-based Inverse Perception Contracts and Applicationscited by 2
- 2023Assumption Generation for the Verification of Learning-Enabled Autonomous Systemscited by 1
- 2023Falsification of a Vision-based Automatic Landing Systemcited by 1
Built on by
Citing papers per year: 2025: 1.
1 paper.