mlsanityData to 7 Oct 2026

muSync-GS: Physics-Synchronized Driving Video Synthesis for Weather and Geometric Road Hazards

arXiv 2608.04412 ↗First posted 5 Aug 2026cs.CVcited by 0

On the map: World models → World models for autonomous driving

also in 1 more
Abstract (arXiv)

High-quality driving data are essential for autonomous-driving systems and generative world models. However, rare and safety-critical scenarios involving adverse weather, braking under low tire--road friction, and uneven road geometry are costly and risky to collect at scale. Existing video-generation and 3D Gaussian editing methods can modify weather appearance or road geometry, but typically do not couple these edits with tire--road interaction and vehicle dynamics. As a result, an edited video may retain its original trajectory even when the modified road condition should alter braking, wheel slip, load transfer, and ego-camera motion. We present muSync-GS, a physics-synchronized framework for driving video synthesis under adverse-weather and road-elevation hazards. A precipitation-derived road-surface condition jointly controls road appearance and tire friction, while a shared road-elevation profile drives both visible road-geometry editing and axle excitation. A calibrated vehicle model predicts speed, slip ratio, normal loads, and pitch for constructing the ego-camera trajectory and synchronized physical annotations. On 12 held-out CarSim cases spanning precipitation levels, brake inputs, and road-profile parameters, the model achieves mean case-wise RMSEs of 0.0273 m/s for speed, 0.0590 degrees for pitch, 0.0101 for slip ratio, and 26.61 N for per-wheel normal load. Together with the reconstructed-scene experiments, these results show that muSync-GS accurately reproduces vehicle responses under held-out controls while synchronizing them with controllable scene edits and ego-camera motion.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in World models for autonomous driving, one of 11 directions in World models. Builds on 33 of its 68 references that are in the map. First posted on arXiv 5 Aug 2026.

Builds on

33 of 68 references.

Closest ancestors · 7

Same direction, newest first

  1. 2026CARLA-GS: Decoupling Representation, Reasoning, and Physics Simulation for Autonomous Driving Corner-Case Synthesis8 Jul
  2. 2026Point as Skeleton: Accumulated Point Cloud Enhanced Autoregressive Generation for Closed-Loop Autonomous Driving Simulation7 Jul
  3. 2025GenieDrive: Towards Physics-Aware Driving World Model with 4D Occupancy Guided Video Generation14 Dec
  4. 2025GAIA-2: A Controllable Multi-View Generative World Model for Autonomous Driving26 Mar
  5. 2024DreamDrive: Generative 4D Scene Modeling from Street View Images31 Dec
  6. 2024HUGSIM: A Real-Time, Photo-Realistic and Closed-Loop Simulator for Autonomous Driving2 Dec
  7. 2024DriveDreamer4D: World Models Are Effective Data Machines for 4D Driving Scene Representation17 Oct

Other references · 26

  1. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  2. 2022Exploring Video Quality Assessment on User Generated Contents from Aesthetic and Technical Perspectivescited by 314
  3. 2023MagicDrive: Street View Generation with Diverse 3D Geometry Controlcited by 250
  4. 2022FAST-VQA: Efficient End-to-end Video Quality Assessment with Fragment Samplingcited by 179
  5. 2024PhysGen: Rigid-Body Physics-Grounded Image-to-Video Generationcited by 169
  6. 2025Cosmos-Transfer1: Conditional World Generation with Adaptive Multimodal Controlcited by 95
  7. 2025WISA: World Simulator Assistant for Physics-Aware Text-to-Video Generationcited by 87
  8. 2024Physics3D: Learning Physical Properties of 3D Gaussians via Video Diffusioncited by 76
  9. 2025VLIPP: Towards Physically Plausible Video Generation with Vision and Language Informed Physical Priorcited by 49
  10. 2024Feature Splatting: Language-Driven Physics-Based Scene Synthesis and Editingcited by 44
  11. 2024DreamPhysics: Learning Physics-Based 3D Dynamics with Video Diffusion Priorscited by 40
  12. 2024Efficient Physics Simulation for 3D Scenes via MLLM-Guided Gaussian Splattingcited by 30
14 more
  1. 2025Challenger: Affordable Adversarial Driving Video Generationcited by 16
  2. 2024WeatherGS: 3D Scene Reconstruction in Adverse Weather Conditions via Gaussian Splattingcited by 13
  3. 2025WeatherEdit: Controllable Weather Editing with 4D Gaussian Fieldcited by 11
  4. 2025WorldSplat: Gaussian-Centric Feed-Forward 4D Scene Generation for Autonomous Drivingcited by 11
  5. 2025SafeMVDrive: Multi-view Safety-Critical Driving Video Synthesis in the Real World Domaincited by 6
  6. 2026Learning Physics-Grounded 4D Dynamics with Neural Gaussian Force Fieldscited by 5
  7. 2026PhysVid: Physics Aware Local Conditioning for Generative Video Modelscited by 5
  8. 20243D StreetUnveiler with Semantic-aware 2DGS -- a simple baselinecited by 4
  9. 2025Weather-Magician: Reconstruction and Rendering Framework for 4D Weather Synthesis In Real Timecited by 3
  10. 2026HorizonForge: Driving Scene Editing with Any Trajectories and Any Vehiclescited by 3
  11. 2026AutoWeather4D: Autonomous Driving Video Weather Conversion via G-Buffer Dual-Pass Editingcited by 3
  12. 2026SceneFactory: GPU-Accelerated Multi-Agent Driving Simulation with Physics-Based Vehicle Dynamicscited by 2
  13. 2026Real2Sim: A Physics-driven and Editable Gaussian Splatting Framework for Autonomous Driving Scenescited by 2
  14. 2026Physics-Aware 3D Gaussian Editing for Driving Scene Generationcited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026VehDyn: A Driving World Model Benchmark for Vehicle Dynamics
  2. 2026Cyclone: Diffusion Model for Cycle-Consistent Weather Editing from Unpaired Driving Data
  3. 2026RealWeather: Realistic and Scene-Faithful Weather Translation with Driving World Models
  4. 2026Toward Physically Consistent Driving Video World Models under Challenging Trajectories
  5. 2025SceneCrafter: Controllable Multi-View Driving Scene Editing
  6. 2026GSRAIN: Physically Calibrated High-/Low-Frequency Rainfall Synthesis for 3D Gaussian Driving Scenes
  7. 2024XLD: A Cross-Lane Dataset for Benchmarking Novel Driving View Synthesis
  8. 2026DriveReferee: Geometric Safety Verdicts Need Not Be Learned for Driving World-Action Models