mlsanityData to 7 Oct 2026

Weather-Robust Scene Semantics with Vision-Aligned 4D Radar

arXiv 2605.07367 ↗First posted 8 May 2026cs.RO cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

Cameras and LiDAR degrade in rain, fog, and snow, while millimeter-wave radar remains largely unaffected. We align a radar encoder to frozen SigLIP vision embeddings and decode structured scene captions through a frozen vision-language model (VLM) with approximately 7M trainable parameters. On K-RADAR with held-out fog, light snow, and heavy snow sequences, all radar configurations outperform a camera baseline that collapses to over 90% hallucination. We identify a token-norm mismatch as the dominant failure mode when bridging radar to a frozen VLM and show that projector-output LayerNorm resolves it. Analysis of encoder complexity, caption format, and pooling strategy reveals tradeoffs that inform future radar-VLM pipeline design.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 17 of its 17 references that are in the map. First posted on arXiv 8 May 2026.

Builds on

17 of 17 references.

References · 17

  1. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  2. 2023Visual Instruction Tuningcited by 7,792
  3. 2025Qwen2.5-VL Technical Reportcited by 5,418
  4. 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,048
  5. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
  6. 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
  7. 2022PETR: Position Embedding Transformation for Multi-View 3D Object Detectioncited by 550
  8. 2023PointLLM: Empowering Large Language Models to Understand Point Cloudscited by 326
  9. 2023LAMM: Language-Assisted Multi-Modal Instruction-Tuning Dataset, Framework, and Benchmarkcited by 169
  10. 2022K-Radar: 4D Radar Object Detection for Autonomous Driving in Various Weather Conditionscited by 107
  11. 2021RADDet: Range-Azimuth-Doppler based Radar Object Detection for Dynamic Road Userscited by 52
  12. 2024L4DR: LiDAR-4DRadar Fusion for Weather-Robust 3D Object Detectioncited by 32
5 more
  1. 2021ColoRadar: The Direct 3D Millimeter Wave Radar Datasetcited by 21
  2. 2024Talk2Radar: Bridging Natural Language with 4D mmWave Radar for 3D Referring Expression Comprehensioncited by 17
  3. 2023Enhanced K-Radar: Optimal Density Reduction to Improve Detection Performance and Accessibility of 4D Radar Tensor-based Object Detectioncited by 15
  4. 2024Radar Spectra-Language Model for Automotive Scene Parsingcited by 6
  5. 2025RLM: A Vision-Language Model Approach for Radar Scene Understandingcited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026A Semantic Decoupling-Based Two-Stage Rainy-Day Attack for Revealing Weather Robustness Deficiencies in Vision-Language Models
  2. 2025VLM-Augmented Degradation Modeling for Image Restoration Under Adverse Weather Conditions
  3. 2026WeatherOcc3D: VLM-Assisted Adverse Weather Aware 3D Semantic Occupancy Prediction
  4. 2026Open-Weather Robust 3D Detection via Dual-Critic Diffusion Alignment
  5. 2026RCVLA: 4D Radar-Grounded Semantic Reasoning and Trajectory Arbitration for Autonomous Driving
  6. 2025TRIDE: A Text-assisted Radar-Image weather-aware fusion network for Depth Estimation
  7. 2026WeatherReasonSeg: A Benchmark for Weather-Aware Reasoning Segmentation in Visual Language Models
  8. 2025CaRaFFusion: Improving 2D Semantic Segmentation with Camera-Radar Point Cloud Fusion and Zero-Shot Image Inpainting