Heuristic Style Transfer for Real-Time, Efficient Weather Attribute Detection
Not on the map. Why?
Abstract (arXiv)
We present lightweight and efficient architectures to detect weather conditions from RGB images, predicting the weather type (sunny, rain, snow, fog) and 11 complementary attributes such as intensity, visibility, and ground condition, for a total of 53 classes across the tasks. This work examines to what extent weather conditions manifest as variations in visual style. We investigate style-inspired techniques, including Gram matrices, a truncated ResNet-50 targeting lower and intermediate layers, and PatchGAN-style architectures, within a multi-task framework with attention mechanisms. Two families are introduced: RTM (ResNet50-Truncated-MultiTasks) and PMG (PatchGAN-MultiTasks-Gram), together with their variants. Our contributions include automation of Gram-matrix computation, integration of PatchGAN into supervised multi-task learning, and local style capture through local Gram for improved spatial coherence. We also release a dataset of 503,875 images annotated with 12 weather attributes under a Creative Commons Attribution (CC-BY) license. The models achieve F1 scores above 96 percent on our internal test set and above 78 percent in zero-shot evaluation on several external datasets, confirming their generalization ability. The PMG architecture, with fewer than 5 million parameters, runs in real time with a small memory footprint, making it suitable for embedded systems. The modular design of the models also allows style-related or weather-related tasks to be added or removed as needed.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 25 of its 60 references that are in the map. First posted on arXiv 15 Apr 2026.
Builds on
25 of 60 references.
References · 25
- 2017Attention Is All You Needcited by 60,361
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,733
- 2022Generative Adversarial Networkscited by 5,627
- 2017Squeeze-and-Excitation Networkscited by 4,789
- 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,527
- 2017Non-local Neural Networkscited by 2,293
- 2021An Empirical Study of Training Self-Supervised Vision Transformerscited by 1,616
- 2015Show, Attend and Tell: Neural Image Caption Generation with Visual Attentioncited by 1,423
- 2023A Multitask, Multilingual, Multimodal Evaluation of ChatGPT on Reasoning, Hallucination, and Interactivitycited by 894
13 more
- 2020Contrastive Learning for Unpaired Image-to-Image Translationcited by 639
- 2021Theoretical Foundations of t-SNE for Visualizing High-Dimensional Clustered Datacited by 55
- 2021Weather and Light Level Classification for Autonomous Driving: Dataset, Baseline and Active Learningcited by 20
- 2019WeatherNet: Recognising weather and visual conditions from street-level images using deep residual learningcited by 12
- 2023ChatGPT: Vision and Challengescited by 11
- 2018Weather Classification: A new multi-class dataset, data augmentation approach and comprehensive evaluations of Convolutional Neural Networkscited by 6
- 2021DMRVisNet: Deep Multi-head Regression Network for Pixel-wise Visibility Estimation Under Foggy Weathercited by 5
- 2024Real-Time Environment Condition Classification for Autonomous Vehiclescited by 5
- 2023Beyond Text: Unveiling Multimodal Proficiency of Large Language Models with MultiAPI Benchmarkcited by 3
- 2020Low-latency Perception in Off-Road Dynamical Low Visibility Environmentscited by 2
- 2024SemanticSpray++: A Multimodal Dataset for Autonomous Driving in Wet Surface Conditionscited by 2
- 2024Robust ADAS: Enhancing Robustness of Machine Learning-based Advanced Driver Assistance Systems for Adverse Weathercited by 2
- 2024Real-Time Weather Image Classification with SVMcited by 2
Built on by
Not cited yet.