mlsanityData to 14 Oct 2026

Real-time respiratory motion forecasting with online learning of recurrent neural networks for accurate targeting in externally guided radiotherapy

arXiv 2403.01607 ↗First posted 3 Mar 2024cs.LG cs.NE eess.IVcited by 1

Not on the map. Why?

Abstract (arXiv)

In lung radiotherapy, infrared cameras can track reflective objects on the chest to estimate tumor motion due to breathing, but treatment system latencies hinder radiation beam precision. Real-time recurrent learning (RTRL) is a potential solution that can learn patterns within non-stationary respiratory data but has high complexity. This study assesses the capabilities of resource-efficient online RNN algorithms, namely unbiased online recurrent optimization (UORO), sparse-1 step approximation (SnAp-1), and decoupled neural interfaces (DNI) to forecast respiratory motion during radiotherapy treatment accurately. We use time series containing the 3D positions of external markers on the chest of healthy subjects. We propose efficient implementations for SnAp-1 and DNI that compress the influence and immediate Jacobian matrices and accurately update the linear coefficients used in credit assignment estimation, respectively. Data was originally sampled at 10Hz; we resampled it at 3.33Hz and 30Hz to analyze the effect of the sampling rate on performance. We use UORO, SnAp-1, and DNI to forecast each marker's 3D position with horizons h<=2.1s (the time interval in advance for which the prediction is made) and compare them with RTRL, least mean squares, kernel support vector regression, and linear regression. RNNs trained online achieved similar or better accuracy than most previous works using larger training databases and deep learning, even though we used only the first minute of each sequence to predict motion within that exact sequence. SnAp-1 had the lowest normalized root mean square errors (nRMSEs) averaged over the horizon values considered, equal to 0.335 and 0.157, at 3.33Hz and 10.0Hz, respectively. Similarly, UORO had the lowest nRMSE at 30Hz, equal to 0.086. DNI's inference time (6.8ms per time step at 30Hz, Intel Core i7-13700 CPU) was the lowest among the RNN methods.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 18 of its 78 references that are in the map. First posted on arXiv 3 Mar 2024.

Builds on

18 of 78 references.

References · 18

  1. 2022FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenesscited by 3,673
  2. 2019Enhancing the Locality and Breaking the Memory Bottleneck of Transformer on Time Series Forecastingcited by 607
  3. 2016Decoupled Neural Interfaces using Synthetic Gradientscited by 137
  4. 2017Unbiased Online Recurrent Optimizationcited by 47
  5. 2019A Unified Framework of Online Learning Algorithms for Training Recurrent Neural Networkscited by 38
  6. 2018Approximating Real-Time Recurrent Learning with Random Kronecker Factorscited by 29
  7. 2023Online learning of long-range dependenciescited by 25
  8. 2021Source-free unsupervised domain adaptation for cross-modality abdominal multi-organ segmentationcited by 23
  9. 2019Optimal Kronecker-Sum Approximation of Real Time Recurrent Learningcited by 22
  10. 2020A Practical Sparse Approximation for Real Time Recurrent Learningcited by 18
  11. 2021Unsupervised domain adaptation for cross-modality liver segmentation via joint adversarial learning and self-learningcited by 13
  12. 2023Scalable Real-Time Recurrent Learning Using Columnar-Constructive Networkscited by 11
6 more
  1. 2021Deep Time Series Forecasting with Shape and Temporal Criteriacited by 10
  2. 2020Convergence of Online Adaptive and Recurrent Optimization Algorithmscited by 5
  3. 2015Predicting respiratory motion for real-time tumour tracking in radiotherapycited by 4
  4. 2021Prediction of the Position of External Markers Using a Recurrent Neural Network Trained With Unbiased Online Recurrent Optimization for Safe Lung Cancer Radiotherapycited by 4
  5. 2022Prediction of the motion of chest internal points using a recurrent neural network trained with real-time recurrent learning for latency compensation in lung cancer radiotherapycited by 3
  6. 2023Efficient Real Time Recurrent Learning through combined activity and parameter sparsitycited by 3

Built on by

Cited by year

Citing papers per year: 2024: 1.

1 paper.