mPOLICE: Provable Enforcement of Multi-Region Affine Constraints in Deep Neural Networks
Not on the map. Why?
Abstract (arXiv)
Deep neural networks are increasingly used in safety-critical domains such as robotics and scientific modeling, where strict adherence to output constraints is essential. Methods like POLICE, which are tailored for single convex regions, face challenges when extended to multiple disjoint regions, often leading to constraint violations or unwanted affine behavior across regions. This paper proposes mPOLICE, a new approach that generalizes POLICE to provably enforce affine constraints over multiple disjoint convex regions. At its core, mPOLICE assigns distinct neuron activation patterns to each constrained region, enabling localized affine behavior and avoiding unintended generalization. This is implemented through a layer-wise optimization of the network parameters. Additionally, we introduce a training algorithm that incorporates mPOLICE into conventional deep learning pipelines, balancing task-specific performance with constraint enforcement using periodic sign pattern enforcement. We validate the flexibility and effectiveness of mPOLICE through experiments across various applications, including safety-critical reinforcement learning, implicit 3D shape representation with geometric constraints, and fluid dynamics simulations with boundary condition enforcement. Importantly, mPOLICE incurs no runtime overhead during inference, making it a practical and reliable solution for constraint handling in deep neural networks.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 21 of its 30 references that are in the map. First posted on arXiv 4 Feb 2025.
Builds on
21 of 30 references.
References · 21
- 2018Addressing Function Approximation Error in Actor-Critic Methodscited by 2,302
- 2021Characterizing possible failure modes in physics-informed neural networkscited by 632
- 2014On the Number of Linear Regions of Deep Neural Networkscited by 378
- 2021Transformers Can Do Bayesian Inferencecited by 338
- 2021Physics-informed neural networks with hard constraints for inverse designcited by 277
- 2021End-to-End Constrained Optimization Learning: A Surveycited by 154
- 2023Aligning Optimization Trajectories with Diffusion Models for Constrained Design Generationcited by 51
- 2021Neural Networks with Physics-Informed Architectures and Constraints for Dynamical Systems Modelingcited by 40
- 2023SplineCam: Exact Visualization and Characterization of Deep Network Geometry and Decision Boundariescited by 31
- 2023RAYEN: Imposition of Hard Convex Constraints on Neural Networkscited by 30
- 2024CGD: Constraint-Guided Diffusion Policies for UAV Trajectory Planningcited by 21
- 2021Constrained Optimization to Train Neural Networks on Critical and Under-Represented Classescited by 19
9 more
- 2022POLICE: Provably Optimal Linear Constraint Enforcement for Deep Neural Networkscited by 19
- 2024Learning Constrained Optimization with Deep Augmented Lagrangian Methodscited by 16
- 2023XLB: A differentiable massively parallel lattice Boltzmann library in Pythoncited by 11
- 2023Architecture-Preserving Provable Repair of Deep Neural Networkscited by 9
- 2023Neural Fields with Hard Constraints of Arbitrary Differential Ordercited by 5
- 2024POLICEd RL: Learning Closed-Loop Robot Control Policies with Provable Satisfaction of Hard Constraintscited by 5
- 2024Generative Optimization: A Perspective on AI-Enhanced Problem Solving in Engineeringcited by 4
- 2024Fast and Accurate Bayesian Optimization with Pre-trained Transformers for Constrained Engineering Problemscited by 2
- 2024Learning to Provably Satisfy High Relative Degree Constraints for Black-Box Systemscited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.