Application of Graph Based Vision Transformers Architectures for Accurate Temperature Prediction in Fiber Specklegram Sensors
Not on the map. Why?
Abstract (arXiv)
Fiber Specklegram Sensors (FSS) are highly effective for environmental monitoring, particularly for detecting temperature variations. However, the nonlinear nature of specklegram data presents significant challenges for accurate temperature prediction. This study investigates the use of transformer-based architectures, including Vision Transformers (ViTs), Swin Transformers, and emerging models such as Learnable Importance Non-Symmetric Attention Vision Transformers (LINA-ViT) and Multi-Adaptive Proximity Vision Graph Attention Transformers (MAP-ViGAT), to predict temperature from specklegram data over a range of 0 to 120 Celsius. The results show that ViTs achieved a Mean Absolute Error (MAE) of 1.15, outperforming traditional models such as CNNs. GAT-ViT and MAP-ViGAT variants also demonstrated competitive accuracy, highlighting the importance of adaptive attention mechanisms and graph-based structures in capturing complex modal interactions and phase shifts in specklegram data. Additionally, this study incorporates Explainable AI (XAI) techniques, including attention maps and saliency maps, to provide insights into the decision-making processes of the transformer models, improving interpretability and transparency. These findings establish transformer architectures as strong benchmarks for optical fiber-based temperature sensing and offer promising directions for industrial monitoring and structural health assessment applications.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 12 of its 32 references that are in the map. First posted on arXiv 15 Nov 2025.
Builds on
12 of 32 references.
References · 12
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2020Transformer Interpretability Beyond Attention Visualizationcited by 620
- 2022How Do Vision Transformers Work?cited by 305
- 2023Patch n' Pack: NaViT, a Vision Transformer for any Aspect Ratio and Resolutioncited by 226
- 2024MambaVision: A Hybrid Mamba-Transformer Vision Backbonecited by 222
- 2024ViT-CoMer: Vision Transformer with Convolutional Multi-scale Feature Interaction for Dense Predictionscited by 65
- 2024SHViT: Single-Head Vision Transformer with Memory Efficient Macro Designcited by 55
- 2024LeGrad: An Explainability Method for Vision Transformers via Feature Formation Sensitivitycited by 32
- 2023ViTO: Vision Transformer-Operatorcited by 29
- 2024Attention Guided CAM: Visual Explanations of Vision Transformer Guided by Self-Attentioncited by 17
- 2021An explainable Transformer-based deep learning model for the prediction of incident heart failurecited by 12
Built on by
Not cited yet.