mlsanityData to 14 Oct 2026

Transformer-Based Fault-Tolerant Control for Fixed-Wing UAVs Using Knowledge Distillation and In-Context Adaptation

arXiv 2411.02975 ↗First posted 5 Nov 2024cs.RO cs.LG cs.SYcited by 3

Not on the map. Why?

Abstract (arXiv)

This study presents a transformer-based approach for fault-tolerant control in fixed-wing Unmanned Aerial Vehicles (UAVs), designed to adapt in real time to dynamic changes caused by structural damage or actuator failures. Unlike traditional Flight Control Systems (FCSs) that rely on classical control theory and struggle under severe alterations in dynamics, our method directly maps outer-loop reference values -- altitude, heading, and airspeed -- into control commands using the in-context learning and attention mechanisms of transformers, thus bypassing inner-loop controllers and fault-detection layers. Employing a teacher-student knowledge distillation framework, the proposed approach trains a student agent with partial observations by transferring knowledge from a privileged expert agent with full observability, enabling robust performance across diverse failure scenarios. Experimental results demonstrate that our transformer-based controller outperforms industry-standard FCS and state-of-the-art reinforcement learning (RL) methods, maintaining high tracking accuracy and stability in nominal conditions and extreme failure cases, highlighting its potential for enhancing UAV operational safety and reliability.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 25 of its 44 references that are in the map. First posted on arXiv 5 Nov 2024.

Builds on

25 of 44 references.

References · 25

  1. 2017Attention Is All You Needcited by 60,361
  2. 2015Distilling the Knowledge in a Neural Networkcited by 10,324
  3. 2021Decision Transformer: Reinforcement Learning via Sequence Modelingcited by 1,546
  4. 2023Mastering Diverse Domains through World Modelscited by 1,253
  5. 2021Offline Reinforcement Learning as One Big Sequence Modeling Problemcited by 644
  6. 2019Stabilizing Transformers for Reinforcement Learningcited by 270
  7. 2020Transfer Learning in Deep Reinforcement Learning: A Surveycited by 265
  8. 2022Online Decision Transformercited by 196
  9. 2023Real-World Humanoid Locomotion with Reinforcement Learningcited by 187
  10. 2022Safe Control with Learned Certificates: A Survey of Neural Lyapunov, Barrier, and Contraction methodscited by 151
  11. 2021Recurrent Model-Free RL Can Be a Strong Baseline for Many POMDPscited by 122
  12. 2020Actor-Critic Reinforcement Learning for Control with Stability Guaranteecited by 45
13 more
  1. 2020Learning Stability Certificates from Datacited by 45
  2. 2023Barkour: Benchmarking Animal-level Agility with Quadruped Robotscited by 41
  3. 2022Neural Lyapunov Control of Unknown Nonlinear Systems with Stability Guaranteescited by 40
  4. 2020Imitation Learning with Stability and Safety Guaranteescited by 34
  5. 2024Learning Robot Soccer from Egocentric Vision with Deep Reinforcement Learningcited by 17
  6. 2020Nonlinear MPC for Collision Avoidance and Controlof UAVs With Dynamic Obstaclescited by 14
  7. 2024LyZNet: A Lightweight Python Tool for Learning and Verifying Neural Lyapunov Functions and Regions of Attractioncited by 10
  8. 2023MCUFormer: Deploying Vision Transformers on Microcontrollers with Limited Memorycited by 9
  9. 2024TraKDis: A Transformer-based Knowledge Distillation Approach for Visual Reinforcement Learning with Application to Cloth Manipulationcited by 8
  10. 2024Optimizing the Deployment of Tiny Transformers on Low-Power MCUscited by 8
  11. 2024Navigation in a simplified Urban Flow through Deep Reinforcement Learningcited by 5
  12. 2022Soft Actor-Critic Deep Reinforcement Learning for Fault Tolerant Flight Controlcited by 3
  13. 2024MCUBERT: Memory-Efficient BERT Inference on Commodity Microcontrollerscited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 2.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Learning-Based Passive Fault-Tolerant Control of a Quadrotor with Rotor Failure ↗
  2. 2025Fault Tolerant Control of a Quadcopter using Reinforcement Learning
  3. 2024Safe and Reliable Training of Learning-Based Aerospace Controllers
  4. 2026Safe Learning-Based Adaptive Augmentation Control for Fixed-Wing UAV under Uncertainty ↗
  5. 2025RoVerFly: Robust and Versatile Implicit Hybrid Control of Quadrotor-Payload Systems
  6. 2023Adaptive Control Strategy for Quadruped Robots in Actuator Degradation Scenarios
  7. 2026Meta-Adaptive Beam Search Planning for Transformer-Based Reinforcement Learning Control of UAVs with Overhead Manipulators under Flight Disturbances
  8. 2024A Learning-based Quadcopter Controller with Extreme Adaptation