mlsanityData to 14 Oct 2026

A Goal-Oriented Reinforcement Learning-Based Path Planning Algorithm for Modular Self-Reconfigurable Satellites

arXiv 2505.01966 ↗First posted 4 May 2025cs.RO cs.AI cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Modular self-reconfigurable satellites refer to satellite clusters composed of individual modular units capable of altering their configurations. The configuration changes enable the execution of diverse tasks and mission objectives. Existing path planning algorithms for reconfiguration often suffer from high computational complexity, poor generalization capability, and limited support for diverse target configurations. To address these challenges, this paper proposes a goal-oriented reinforcement learning-based path planning algorithm. This algorithm is the first to address the challenge that previous reinforcement learning methods failed to overcome, namely handling multiple target configurations. Moreover, techniques such as Hindsight Experience Replay and Invalid Action Masking are incorporated to overcome the significant obstacles posed by sparse rewards and invalid actions. Based on these designs, our model achieves a 95% and 73% success rate in reaching arbitrary target configurations in a modular satellite cluster composed of four and six units, respectively.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 6 of its 24 references that are in the map. First posted on arXiv 4 May 2025.

Builds on

6 of 24 references.

References · 6

  1. 2018Soft Actor-Critic: Off-Policy Maximum Entropy Deep Reinforcement Learning with a Stochastic Actorcited by 4,885
  2. 2017Hindsight Experience Replaycited by 1,136
  3. 2019Soft Actor-Critic for Discrete Action Settingscited by 174
  4. 2020A Closer Look at Invalid Action Masking in Policy Gradient Algorithmscited by 171
  5. 2022Goal-Conditioned Reinforcement Learning: Problems and Solutionscited by 158
  6. 2022Reinforcement Learning with Sparse Rewards using Guidance from Offline Demonstrationcited by 54

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024Self-reconfiguration Strategies for Space-distributed Spacecraft
  2. 2024Reinforcement Learning-enabled Satellite Constellation Reconfiguration and Retasking for Mission-Critical Applications
  3. 2025Multi-Modal Decentralized Reinforcement Learning for Modular Reconfigurable Lunar Robots
  4. 2025On the Role of AI in Managing Satellite Constellations: Insights from the ConstellAI Project
  5. 2024Design And Optimization Of Multi-rendezvous Manoeuvres Based On Reinforcement Learning And Convex Optimization
  6. 2025Deep Reinforcement Learning Policies for Underactuated Satellite Attitude Control
  7. 2025OrbitZoo: Real Orbital Systems Challenges for Reinforcement Learning
  8. 2025Optimization of Link Configuration for Satellite Communication Using Reinforcement Learning