mlsanityData to 7 Oct 2026

Deep deterministic policy gradient with symmetric data augmentation for lateral attitude tracking control of a fixed-wing aircraft

arXiv 2407.11077 ↗First posted 13 Jul 2024cs.LG cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

The symmetry of dynamical systems can be exploited for state-transition prediction and to facilitate control policy optimization. This paper leverages system symmetry to develop sample-efficient offline reinforcement learning (RL) approaches. Under the symmetry assumption for a Markov Decision Process (MDP), a symmetric data augmentation method is proposed. The augmented samples are integrated into the dataset of Deep Deterministic Policy Gradient (DDPG) to enhance its coverage rate of the state-action space. Furthermore, sample utilization efficiency is improved by introducing a second critic trained on the augmented samples, resulting in a dual-critic structure. The aircraft's model is verified to be symmetric, and flight control simulations demonstrate accelerated policy convergence when augmented samples are employed.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 21 of its 68 references that are in the map. First posted on arXiv 13 Jul 2024.

Builds on

21 of 68 references.

References · 21

  1. 2015Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classificationcited by 3,590
  2. 2015Continuous control with deep reinforcement learningcited by 3,279
  3. 2018Lipschitz regularity of deep neural networks: analysis and efficient estimationcited by 413
  4. 2021Uncertainty-Based Offline Reinforcement Learning with Diversified Q-Ensemblecited by 297
  5. 2020Incorporating Symmetry into Deep Dynamics Models for Improved Generalizationcited by 123
  6. 2022Lie Point Symmetry Data Augmentation for Neural PDE Solverscited by 76
  7. 2020Regularizing Action Policies for Smooth Control with Reinforcement Learningcited by 47
  8. 2021Breaking the Deadly Triad with a Target Networkcited by 47
  9. 2023Small batch deep reinforcement learningcited by 35
  10. 2021Koopman Q-learning: Offline Reinforcement Learning via Symmetries of Dynamicscited by 27
  11. 2022A Survey on Reinforcement Learning in Aviation Applicationscited by 19
  12. 2022Data Augmentation vs. Equivariant Networks: A Theory of Generalization on Dynamics Forecastingcited by 17
9 more
  1. 2017Symmetry Learning for Function Approximation in Reinforcement Learningcited by 14
  2. 2021Analytical bounds on the local Lipschitz constants of ReLU networkscited by 12
  3. 2019Augmenting learning using symmetry in a biologically-inspired domaincited by 4
  4. 2021Data-Efficient Deep Reinforcement Learning for Attitude Control of Fixed-Wing UAVs: Field Experimentscited by 4
  5. 2022Soft Actor-Critic Deep Reinforcement Learning for Fault Tolerant Flight Controlcited by 3
  6. 2023Equivariant Data Augmentation for Generalization in Offline Reinforcement Learningcited by 3
  7. 2014Theoretical and Numerical Analysis of Approximate Dynamic Programming with Approximation Errorscited by 2
  8. 2019Towards More Sample Efficiency in Reinforcement Learning with Data Augmentationcited by 2
  9. 2021Data Augmentation through Expert-guided Symmetry Detection to Improve Performance in Offline Reinforcement Learningcited by 1

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.

  1. 2025Temporally smoothed incremental model-based heuristic dynamic programming for command-filtered cascaded online learning flight controlcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2023Look Beneath the Surface: Exploiting Fundamental Symmetry for Sample-Efficient Offline RL
  2. 2025A Multi-Fidelity Control Variate Approach for Policy Gradient Estimation
  3. 2024Exploiting Symmetry in Dynamics for Model-Based Reinforcement Learning with Asymmetric Rewards
  4. 2022Truly Deterministic Policy Optimization
  5. 2024Bootstrapping Reinforcement Learning with Imitation for Vision-Based Agile Flight
  6. 2023An Integrated Imitation and Reinforcement Learning Methodology for Robust Agile Aircraft Control with Limited Pilot Demonstration Data
  7. 2026Robust Exploration in Directed Controller Synthesis via Reinforcement Learning with Soft Mixture-of-Experts
  8. 2025Symmetric Behavior Regularized Policy Optimization