Weather-Robust Scene Semantics with Vision-Aligned 4D Radar
Not on the map. Why?
Abstract (arXiv)
Cameras and LiDAR degrade in rain, fog, and snow, while millimeter-wave radar remains largely unaffected. We align a radar encoder to frozen SigLIP vision embeddings and decode structured scene captions through a frozen vision-language model (VLM) with approximately 7M trainable parameters. On K-RADAR with held-out fog, light snow, and heavy snow sequences, all radar configurations outperform a camera baseline that collapses to over 90% hallucination. We identify a token-norm mismatch as the dominant failure mode when bridging radar to a frozen VLM and show that projector-output LayerNorm resolves it. Analysis of encoder complexity, caption format, and pooling strategy reveals tradeoffs that inform future radar-VLM pipeline design.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 17 of its 17 references that are in the map. First posted on arXiv 8 May 2026.
Builds on
17 of 17 references.
References · 17
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2023Visual Instruction Tuningcited by 7,792
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,048
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
- 2022PETR: Position Embedding Transformation for Multi-View 3D Object Detectioncited by 550
- 2023PointLLM: Empowering Large Language Models to Understand Point Cloudscited by 326
- 2023LAMM: Language-Assisted Multi-Modal Instruction-Tuning Dataset, Framework, and Benchmarkcited by 169
- 2022K-Radar: 4D Radar Object Detection for Autonomous Driving in Various Weather Conditionscited by 107
- 2021RADDet: Range-Azimuth-Doppler based Radar Object Detection for Dynamic Road Userscited by 52
- 2024L4DR: LiDAR-4DRadar Fusion for Weather-Robust 3D Object Detectioncited by 32
5 more
- 2021ColoRadar: The Direct 3D Millimeter Wave Radar Datasetcited by 21
- 2024Talk2Radar: Bridging Natural Language with 4D mmWave Radar for 3D Referring Expression Comprehensioncited by 17
- 2023Enhanced K-Radar: Optimal Density Reduction to Improve Detection Performance and Accessibility of 4D Radar Tensor-based Object Detectioncited by 15
- 2024Radar Spectra-Language Model for Automotive Scene Parsingcited by 6
- 2025RLM: A Vision-Language Model Approach for Radar Scene Understandingcited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026A Semantic Decoupling-Based Two-Stage Rainy-Day Attack for Revealing Weather Robustness Deficiencies in Vision-Language Models
- 2025VLM-Augmented Degradation Modeling for Image Restoration Under Adverse Weather Conditions
- 2026WeatherOcc3D: VLM-Assisted Adverse Weather Aware 3D Semantic Occupancy Prediction
- 2026Open-Weather Robust 3D Detection via Dual-Critic Diffusion Alignment
- 2026RCVLA: 4D Radar-Grounded Semantic Reasoning and Trajectory Arbitration for Autonomous Driving
- 2025TRIDE: A Text-assisted Radar-Image weather-aware fusion network for Depth Estimation
- 2026WeatherReasonSeg: A Benchmark for Weather-Aware Reasoning Segmentation in Visual Language Models
- 2025CaRaFFusion: Improving 2D Semantic Segmentation with Camera-Radar Point Cloud Fusion and Zero-Shot Image Inpainting