What Physics do Data-Driven MoCap-to-Radar Models Learn?
Not on the map. Why?
Abstract (arXiv)
Data-driven MoCap-to-radar models generate plausible micro-Doppler spectrograms, but do they actually learn the underlying physics? We introduce a physics-based interpretability framework to answer this question via two proposed complementary metrics: one measures alignment between model predictions and the physics-derived Doppler frequency, while the other tests whether predictions preserve the velocity-frequency relationship under velocity intervention. Both metrics require only MoCap input and model predictions, without access to measured radar data. Experiments across several model architectures reveal that low reconstruction error does not guarantee physical consistency: some, but not all, models achieve low error yet perform poorly on the two physics-based metrics. Further analysis shows that temporal attention is critical for transformer-based models to learn the underlying physics.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 8 of its 23 references that are in the map. First posted on arXiv 19 Apr 2026.
Builds on
8 of 23 references.
References · 8
- 2016The Mythos of Model Interpretabilitycited by 721
- 2024Mechanistic Interpretability for AI Safety -- A Reviewcited by 422
- 2020Interpretable Machine Learning -- A Brief History, State-of-the-Art and Challengescited by 120
- 2018Discovering physical concepts with neural networkscited by 117
- 2022ComPhy: Compositional Physical Reasoning of Objects and Events from Videoscited by 63
- 2022Filtered-CoPhy: Unsupervised Learning of Counterfactual Physics in Pixel Spacecited by 14
- 2019One Size Does Not Fit All: Multi-Scale, Cascaded RNNs for Radar Classificationcited by 5
- 2025MoCap2Radar: A Spatiotemporal Transformer for Synthesizing Micro-Doppler Radar Signatures from Motion Capturecited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.
- 2026LAWFUL: Law-Aligned Witness for Faithful Use of Latentscited by 0
- 2026LAWFUL: Law-Aligned Witness for Faithful Use of Latents26 Jul 2026