mlsanityData to 14 Oct 2026

Vision Meets WiFi: Physics-Grounded Estimation of Volumetric Mechanical Properties

arXiv 2608.07726 ↗First posted 7 Aug 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Estimating volumetric mechanical properties, including Young's modulus, Poisson's ratio, and density at each voxel, is intrinsically ambiguous from vision alone, as visually similar objects may have substantially different material compositions and physical behavior. Existing approaches predict these properties independently across voxels, overlooking the piecewise-constant material structure of real objects and producing noisy or inconsistent estimates for voxels that share the same material, while lacking an explicit mechanism to resolve visual ambiguity. We introduce ViWi (Vision Meets WiFi), an object-centric framework for volumetric mechanical-property estimation. ViWi represents each object using a compact set of material slots that aggregate evidence from voxels with a shared material identity and produce coherent slot-level property predictions. To complement visual appearance, ViWi incorporates a compact RF descriptor generated through WiFi-band electromagnetic simulation using permittivity and conductivity. The RF descriptor conditions the material slots with global composition cues that may be unavailable from images, while visual features preserve voxel-level spatial localization. On GVM, ViWi improves over the prior state of the art on four of six per-voxel metrics, while its vision-only variant improves all reported mass-estimation metrics on ABO-500. These results demonstrate that combining object-centric material structure with complementary RF evidence enables more accurate and physically coherent volumetric property estimation beyond what is possible from visual appearance alone.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 22 of its 24 references that are in the map. First posted on arXiv 7 Aug 2026.

Builds on

22 of 24 references.

References · 22

  1. 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,333
  2. 2020Object-Centric Learning with Slot Attentioncited by 876
  3. 2023PhysGaussian: Physics-Integrated 3D Gaussians for Generative Dynamicscited by 377
  4. 2021ABO: Dataset and Benchmarks for Real-World 3D Object Understandingcited by 366
  5. 2024PhysDreamer: Physics-Based Interaction with 3D Objects via Video Generationcited by 191
  6. 2024PhysGen: Rigid-Body Physics-Grounded Image-to-Video Generationcited by 174
  7. 2024Physics3D: Learning Physical Properties of 3D Gaussians via Video Diffusioncited by 80
  8. 2025PhysGen3D: Crafting a Miniature Interactive World from a Single Imagecited by 66
  9. 2024Physical Property Understanding from Language-Embedded Feature Fieldscited by 48
  10. 2025PhysX-3D: Physical-Grounded 3D Asset Generationcited by 42
  11. 2024DreamPhysics: Learning Physics-Based 3D Dynamics with Video Diffusion Priorscited by 41
  12. 2024Efficient Physics Simulation for 3D Scenes via MLLM-Guided Gaussian Splattingcited by 32
10 more
  1. 2022HuPR: A Benchmark for Human Pose Estimation Using Millimeter Wave Radarcited by 31
  2. 2025PUGS: Zero-shot Physical Understanding with Gaussian Splattingcited by 24
  3. 2025Pixie: Fast and Generalizable Supervised Learning of 3D Physics from Pixelscited by 24
  4. 2024Phys4DGen: Physics-Compliant 4D Generation with Multi-Material Composition Perceptioncited by 23
  5. 2024Diffusion Model is a Good Pose Estimator from 3D RF-Visioncited by 22
  6. 2025VoMP: Predicting Volumetric Mechanical Property Fieldscited by 13
  7. 2022RFPose-OT: RF-Based 3D Human Pose Estimation via Optimal Transport Theorycited by 2
  8. 2024Improving Real-Time Omnidirectional 3D Multi-Person Human Pose Estimation with People Matching and Unsupervised 2D-3D Liftingcited by 2
  9. 2024The Field-based Model: A New Perspective on RF-based Material Sensingcited by 1
  10. 2026Adaptive Volumetric Mechanical Property Fields Invariant to Resolutioncited by 1

Built on by

Not cited yet.