mlsanityData to 7 Oct 2026

Novel Dynamic Batch-Sensitive Adam Optimiser for Vehicular Accident Injury Severity Prediction

arXiv 2605.15083 ↗First posted 14 May 2026cs.LG cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

The choice of optimiser is important in deep learning, as it strongly influences model efficiency and speed of convergence. However, many commonly used optimisers encounter difficulties when applied to imbalanced and sequential datasets, limiting their ability to capture patterns of minority classes. In this study, we propose Dynamic Batch-Sensitive Adam (DBS-Adam), an optimiser that dynamically scales the learning rate using a batch difficulty score derived from exponential moving averages of gradient norms and batch loss. DBS-Adam improves training stability and accelerates convergence by increasing updates for difficult batches and reducing them for easier ones. We evaluate DBS-Adam by integrating it with Bi-Directional LSTM networks for accident injury severity prediction, addressing class imbalance through SMOTE-ENN resampling and Focal Loss. Four experimental configurations compare baseline Bi-LSTM models and alternative architectures to assess optimiser impact. Rigorous comparison against state-of-the-art optimisers (AMSGrad, AdamW, AdaBound) across five random seeds demonstrated DBS-Adam's competitive performance with statistically significant precision improvements (p=0.020). Results indicate that DBS-Adam outperforms standard optimisation approaches, achieving 95.22% test accuracy, 96.11% precision, 95.28% recall, 95.39% F1-score, and a test loss of 0.0086. The proposed framework enables effective real-time accident severity classification for targeted emergency response and road safety interventions, demonstrating the value of DBS-Adam for learning from imbalanced sequential data.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 14 of its 72 references that are in the map. First posted on arXiv 14 May 2026.

Builds on

14 of 72 references.

References · 14

  1. 2019Class-Balanced Loss Based on Effective Number of Samplescited by 1,239
  2. 2017GradNorm: Gradient Normalization for Adaptive Loss Balancing in Deep Multitask Networkscited by 816
  3. 2019Decoupling Representation and Classifier for Long-Tailed Recognitioncited by 806
  4. 2017MentorNet: Learning Data-Driven Curriculum for Very Deep Neural Networks on Corrupted Labelscited by 652
  5. 2018Not All Samples Are Created Equal: Deep Learning with Importance Samplingcited by 323
  6. 2021Unified Focal loss: Generalising Dice and cross entropy-based losses to handle class imbalanced medical image segmentationcited by 88
  7. 2018Convergence and Dynamical Behavior of the ADAM Algorithm for Non-Convex Stochastic Optimizationcited by 47
  8. 2021Active label cleaning for improved dataset quality under resource constraintscited by 44
  9. 2020A Comparison of Optimization Algorithms for Deep Learningcited by 23
  10. 2019On the Convergence Proof of AMSGrad and a New Versioncited by 21
  11. 2022Classification of datasets with imputed missing values: does imputation quality matter?cited by 21
  12. 2023Automatic Curriculum Learning with Gradient Reward Signalscited by 3
2 more
  1. 2018An Exploration of Dropout with RNNs for Natural Language Inferencecited by 2
  2. 2023Predicting Accident Severity: An Analysis Of Factors Affecting Accident Severity Using Random Forest Modelcited by 2

Built on by

Not cited yet.