Assessing the Potential of Masked Autoencoder Foundation Models in Predicting Downhole Metrics from Surface Drilling Data
Not on the map. Why?
Abstract (arXiv)
Oil and gas drilling operations generate extensive time-series data from surface sensors, yet accurate real-time prediction of critical downhole metrics remains challenging due to the scarcity of labelled downhole measurements. This systematic mapping study reviews thirteen papers published between 2015 and 2025 to assess the potential of Masked Autoencoder Foundation Models (MAEFMs) for predicting downhole metrics from surface drilling data. The review identifies eight commonly collected surface metrics and seven target downhole metrics. Current approaches predominantly employ neural network architectures such as artificial neural networks (ANNs) and long short-term memory (LSTM) networks, yet no studies have explored MAEFMs despite their demonstrated effectiveness in time-series modeling. MAEFMs offer distinct advantages through self-supervised pre-training on abundant unlabeled data, enabling multi-task prediction and improved generalization across wells. This research establishes that MAEFMs represent a technically feasible but unexplored opportunity for drilling analytics, recommending future empirical validation of their performance against existing models and exploration of their broader applicability in oil and gas operations.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 5 of its 33 references that are in the map. First posted on arXiv 16 Apr 2026.
Builds on
5 of 33 references.
References · 5
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
- 2019Parameter-Efficient Transfer Learning for NLPcited by 4,236
- 2022MultiMAE: Multi-modal Multi-task Masked Autoencoderscited by 291
- 2023Ti-MAE: Self-Supervised Masked Time Series Autoencoderscited by 63
- 2022MTSMAE: Masked Autoencoders for Multivariate Time-Series Forecastingcited by 9
Built on by
Not cited yet.