mlsanityData to 14 Oct 2026

RL-Ballast: Ship Ballast Water Path Planning and Clog Prediction via Reinforcement Learning

arXiv 2607.04906 ↗First posted 6 Jul 2026cs.LGcited by 0

On the map: Deep reinforcement learning methods → RL for robot navigation and UAV control

Abstract (arXiv)

Under the Shipping 4.0 paradigm, autonomous and reduced-crew vessels require intelligent internal systems to maintain operational safety and structural stability. Ballast-water control is essential for ship trim and integrity, but conventional rule-based or manual approaches have limited adaptability to hydraulic anomalies such as valve failures and pipe blockages, and often depend on dense pressure or flow sensors for diagnosis. To address these limitations, this paper proposes RL-Ballast, a graph-based deep reinforcement learning framework for adaptive ballast-water path planning and sensor-frugal blockage candidate scoring. The valve-permutation problem is transformed into 54 feasible fluid-transfer routes generated using graph theory and depth-first search. The partially observable ballast environment is approximated with frame-stacked tank levels and action outcomes, allowing the agent to infer hidden blockage effects without explicitly modeling a high-dimensional POMDP. During deterministic inference, episode-level failed-action memory and dynamic action masking prevent repeated ineffective actions and support immediate rerouting. Failed transfer histories are further accumulated to rank suspicious valves or pipe segments without dense instrumentation. Monte Carlo simulations show that RL-Ballast completes all unexpected single-blockage scenarios and reduces average decision steps from 61.0 to 41.5 compared with a Dijkstra rule-based baseline. For diagnostic support, the failure-history scoring scheme achieves a 100% Top-3 hit rate, a 66.7% strict Top-1 hit rate, and an 83.3% Top-1 tie-hit rate under serially indistinguishable blockage conditions. These results suggest that RL-Ballast enables adaptive rerouting and maintenance-oriented blockage diagnosis under limited sensing conditions.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in RL for robot navigation and UAV control, one of 15 directions in Deep reinforcement learning methods. Builds on 6 of its 19 references that are in the map. First posted on arXiv 6 Jul 2026.

Builds on

6 of 19 references.

References · 6

  1. 2015Deep Reinforcement Learning with Double Q-learningcited by 1,745
  2. 2018QT-Opt: Scalable Deep Reinforcement Learning for Vision-Based Robotic Manipulationcited by 743
  3. 2020Automatic Curriculum Learning For Deep RL: A Short Surveycited by 150
  4. 2016Model-Free Episodic Controlcited by 102
  5. 2020Deep Reinforcement Learning Based Dynamic Route Planning for Minimizing Travel Timecited by 8
  6. 2023Deep Reinforcement Learning Based Tracking Control of an Autonomous Surface Vessel in Natural Waterscited by 6

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024Evaluating Robustness of Reinforcement Learning Algorithms for Autonomous Shipping
  2. 2025Goal-Conditioned Reinforcement Learning for Data-Driven Maritime Navigation
  3. 2026SMaRT-Tug: Structured Multi-Agent Reinforcement Learning for Physics-Based Tugboat-Barge Collaborative Manipulation ↗
  4. 2025Falsification-driven reinforcement learning for maritime motion planning
  5. 2026Critic-Free Deep Reinforcement Learning for Maritime Coverage Path Planning on Irregular Hexagonal Grids
  6. 2024MarineGym: Accelerated Training for Underwater Vehicles with High-Fidelity RL Simulation
  7. 2026Towards Long-Horizon Vessel Trajectory and Destination Forecasting with Reasoning Large Language Models
  8. 2026Realistic Curriculum Reinforcement Learning for Autonomous and Sustainable Marine Vessel Navigation