Can Transformers Predict Vibrations?
Not on the map. Why?
Abstract (arXiv)
Highly accurate time-series vibration prediction is an important research issue for electric vehicles (EVs). EVs often experience vibrations when driving on rough terrains, known as torsional resonance. This resonance, caused by the interaction between motor and tire vibrations, puts excessive loads on the vehicle's drive shaft. However, current damping technologies only detect resonance after the vibration amplitude of the drive shaft torque reaches a certain threshold, leading to significant loads on the shaft at the time of detection. In this study, we propose a novel approach to address this issue by introducing Resoformer, a transformer-based model for predicting torsional resonance. Resoformer utilizes time-series of the motor rotation speed as input and predicts the amplitude of torsional vibration at a specified quantile occurring in the shaft after the input series. By calculating the attention between recursive and convolutional features extracted from the measured data points, Resoformer improves the accuracy of vibration forecasting. To evaluate the model, we use a vibration dataset called VIBES (Dataset for Forecasting Vibration Transition in EVs), consisting of 2,600 simulator-generated vibration sequences. Our experiments, conducted on strong baselines built on the VIBES dataset, demonstrate that Resoformer achieves state-of-the-art results. In conclusion, our study answers the question "Can Transformers Forecast Vibrations?" While traditional transformer architectures show low performance in forecasting torsional resonance waves, our findings indicate that combining recurrent neural network and temporal convolutional network using the transformer architecture improves the accuracy of long-term vibration forecasting.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 30 of its 62 references that are in the map. First posted on arXiv 16 Feb 2024.
Builds on
30 of 62 references.
References · 30
- 2017Attention Is All You Needcited by 59,932
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 4,993
- 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,530
- 2014Sequence to Sequence Learning with Neural Networkscited by 2,974
- 2015Character-level Convolutional Networks for Text Classificationcited by 2,293
- 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 1,981
- 2016WaveNet: A Generative Model for Raw Audiocited by 1,710
- 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,654
- 2018An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modelingcited by 1,447
- 2022Are Transformers Effective for Time Series Forecasting?cited by 1,400
- 2022TimesNet: Temporal 2D-Variation Modeling for General Time Series Analysiscited by 1,030
18 more
- 2017DeepAR: Probabilistic Forecasting with Autoregressive Recurrent Networkscited by 1,004
- 2023iTransformer: Inverted Transformers Are Effective for Time Series Forecastingcited by 906
- 2017Modeling Long- and Short-Term Temporal Patterns with Deep Neural Networkscited by 869
- 2019Temporal Fusion Transformers for Interpretable Multi-horizon Time Series Forecastingcited by 748
- 2016Language Modeling with Gated Convolutional Networkscited by 688
- 2017Convolutional Sequence to Sequence Learningcited by 550
- 2015Bidirectional LSTM-CRF Models for Sequence Taggingcited by 544
- 2022Non-stationary Transformers: Exploring the Stationarity in Time Series Forecastingcited by 385
- 2017A Multi-Horizon Quantile Recurrent Forecastercited by 211
- 2019Recurrent Neural Networks for Time Series Forecasting: Current Status and Future Directionscited by 172
- 2020Deep Transformer Models for Time Series Forecasting: The Influenza Prevalence Casecited by 129
- 2019Shape and Time Distortion Loss for Training Deep Time Series Forecasting Modelscited by 66
- 2019R-Transformer: Recurrent Neural Network Enhanced Transformercited by 39
- 2019Hierarchical Temporal Convolutional Networks for Dynamic Recommender Systemscited by 28
- 2022Multivariate Quantile Function Forecastercited by 19
- 2020Highway Transformer: Self-Gating Enhanced Self-Attentive Networkscited by 18
- 2020Data-Driven Permanent Magnet Temperature Estimation in Synchronous Motors with Supervised Machine Learningcited by 4
- 2022LiFe-net: Data-driven Modelling of Time-dependent Temperatures and Charging Statistics Of Tesla's LiFePo4 EV Batterycited by 1
Built on by
Not cited yet.