# User-Conditioned Neural Control Policies for Mobile Robotics

arXiv: https://arxiv.org/abs/2211.12181 · HTML: https://mlsanity.com/paper/2211.12181/

## Key facts

- Cited by 4 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 22 Nov 2022.

## Built on by (most cited first, 4 of 4)

- [NavRL: Learning Safe Flight in Dynamic Environments](https://mlsanity.com/paper/2409.15634/) (2024)
- [TACO: General Acrobatic Flight Control via Target-and-Command-Oriented Reinforcement Learning](https://mlsanity.com/paper/2503.01125/) (2025)
- [Multi-Task Reinforcement Learning of Drone Aerobatics by Exploiting Geometric Symmetries](https://mlsanity.com/paper/2602.10997/) (2026)
- [Rarity-Gated Context Conditioning for Offline Imitation Learning-Based Maritime Anomaly Detection](https://mlsanity.com/paper/2606.13311/) (2026)

## Abstract (arXiv)

Recently, learning-based controllers have been shown to push mobile robotic systems to their limits and provide the robustness needed for many real-world applications. However, only classical optimization-based control frameworks offer the inherent flexibility to be dynamically adjusted during execution by, for example, setting target speeds or actuator limits. We present a framework to overcome this shortcoming of neural controllers by conditioning them on an auxiliary input. This advance is enabled by including a feature-wise linear modulation layer (FiLM). We use model-free reinforcement-learning to train quadrotor control policies for the task of navigating through a sequence of waypoints in minimum time. By conditioning the policy on the maximum available thrust or the viewing direction relative to the next waypoint, a user can regulate the aggressiveness of the quadrotor's flight during deployment. We demonstrate in simulation and in real-world experiments that a single control policy can achieve close to time-optimal flight performance across the entire performance envelope of the robot, reaching up to 60 km/h and 4.5g in acceleration. The ability to guide a learned controller during task execution has implications beyond agile quadrotor flight, as conditioning the control policy on human intent helps safely bringing learning based systems out of the well-defined laboratory environment into the wild.
