Dynaformer: A Deep Learning Model for Ageing-aware Battery Discharge Prediction
Not on the map. Why?
Abstract (arXiv)
Electrochemical batteries are ubiquitous devices in our society. When they are employed in mission-critical applications, the ability to precisely predict the end of discharge under highly variable environmental and operating conditions is of paramount importance in order to support operational decision-making. While there are accurate predictive models of the processes underlying the charge and discharge phases of batteries, the modelling of ageing and its effect on performance remains poorly understood. Such a lack of understanding often leads to inaccurate models or the need for time-consuming calibration procedures whenever the battery ages or its conditions change significantly. This represents a major obstacle to the real-world deployment of efficient and robust battery management systems. In this paper, we propose for the first time an approach that can predict the voltage discharge curve for batteries of any degradation level without the need for calibration. In particular, we introduce Dynaformer, a novel Transformer-based deep learning architecture which is able to simultaneously infer the ageing state from a limited number of voltage/current samples and predict the full voltage discharge curve for real batteries with high precision. Our experiments show that the trained model is effective for input current profiles of different complexities and is robust to a wide range of degradation levels. In addition to evaluating the performance of the proposed framework on simulated data, we demonstrate that a minimal amount of fine-tuning allows the model to bridge the simulation-to-real gap between simulations and real data collected from a set of batteries. The proposed methodology enables the utilization of battery-powered systems until the end of discharge in a controlled and predictable way, thereby significantly prolonging the operating cycles and reducing costs.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 17 of its 42 references that are in the map. First posted on arXiv 1 Jun 2022.
Builds on
17 of 42 references.
References · 17
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2020Scaling Laws for Neural Language Modelscited by 6,411
- 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,416
- 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,016
- 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,853
- 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,141
- 2020A Transformer-based Framework for Multivariate Time Series Representation Learningcited by 449
- 2019How to Fine-Tune BERT for Text Classification?cited by 409
5 more
- 2019Deep Learning for Symbolic Mathematicscited by 266
- 2019Causality for Machine Learningcited by 242
- 2018Music Transformercited by 207
- 2021Neural Symbolic Regression that Scalescited by 185
- 2021Machine learning pipeline for battery state of health estimationcited by 28
Built on by
Citing papers per year: 2023: 3; 2024: 0; 2025: 0; 2026: 1.
4 papers.
- 2023CyFormer: Accurate State-of-Health Prediction of Lithium-Ion Batteries via Cyclic Attentioncited by 0
- 2023Smart filter aided domain adversarial neural network for fault diagnosis in noisy industrial scenarioscited by 0
- 2023Prognosis of Multivariate Battery State of Performance and Health via Transformerscited by 0
- 2026Excluding the Target Domain Improves Extrapolation: Deconfounded Hierarchical Physics Constraintscited by 0
- 2026Excluding the Target Domain Improves Extrapolation: Deconfounded Hierarchical Physics Constraints8 May 2026
- 2023Prognosis of Multivariate Battery State of Performance and Health via Transformers18 Sep 2023
- 2023Smart filter aided domain adversarial neural network for fault diagnosis in noisy industrial scenarios4 Jul 2023
- 2023CyFormer: Accurate State-of-Health Prediction of Lithium-Ion Batteries via Cyclic Attention17 Apr 2023