Prion-ViT: Prions-Inspired Vision Transformers for Temperature prediction with Specklegrams
Not on the map. Why?
Abstract (arXiv)
Fiber Specklegram Sensors (FSS) are vital for environmental monitoring due to their high temperature sensitivity, but their complex data poses challenges for predictive models. This study introduces Prion-ViT, a prion-inspired Vision Transformer model, inspired by biological prion memory mechanisms, to improve long-term dependency modeling and temperature prediction accuracy using FSS data. Prion-ViT leverages a persistent memory state to retain and propagate key features across layers, reducing mean absolute error (MAE) to 0.71^circC and outperforming models like ResNet, Inception Net V2, and Standard Vision Transformers. This paper also discusses Explainable AI (XAI) techniques, providing a perspective on specklegrams through attention and saliency maps, which highlight key regions contributing to predictions
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 9 of its 28 references that are in the map. First posted on arXiv 6 Nov 2024.
Builds on
9 of 28 references.
References · 9
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
- 2023Patch n' Pack: NaViT, a Vision Transformer for any Aspect Ratio and Resolutioncited by 229
- 2022MeMViT: Memory-Augmented Multiscale Vision Transformer for Efficient Long-Term Video Recognitioncited by 189
- 2023EfficientViT: Memory Efficient Vision Transformer with Cascaded Group Attentioncited by 172
- 2024ViT-CoMer: Vision Transformer with Convolutional Multi-scale Feature Interaction for Dense Predictionscited by 66
- 2023ViTO: Vision Transformer-Operatorcited by 29
- 2024Attention Guided CAM: Visual Explanations of Vision Transformer Guided by Self-Attentioncited by 17
- 2024ViTaL: An Advanced Framework for Automated Plant Disease Identification in Leaf Images Using Vision Transformers and Linear Projection For Feature Reductioncited by 2
Built on by
Not cited yet.