mlsanityData to 14 Oct 2026

Physic-HM: Restoring Physical Generative Logic in Multimodal Anomaly Detection via Hierarchical Modulation

arXiv 2512.21650 ↗First posted 25 Dec 2025cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Multimodal Unsupervised Anomaly Detection (UAD) is critical for quality assurance in smart manufacturing, particularly in complex processes like robotic welding. However, existing methods often suffer from process-logic blindness, treating process modalities (e.g., real-time video, audio, and sensors) and result modalities (e.g., post-weld images) as symmetric feature sources, thereby ignoring the inherent unidirectional physical generative logic. Furthermore, the heterogeneity gap between high-dimensional visual data and low-dimensional sensor signals frequently leads to critical process context being drowned out. In this paper, we propose Physic-HM, a multimodal UAD framework that explicitly incorporates physical inductive bias to model the process-to-result dependency. Specifically, our framework incorporates two key innovations: a Sensor-Guided PHM Modulation mechanism that utilizes low-dimensional sensor signals as context to guide high-dimensional audio-visual feature extraction, and a Physic-Hierarchical architecture that enforces a unidirectional generative mapping to identify anomalies that violate physical consistency. Extensive experiments on Weld-4M benchmark demonstrate that Physic-HM achieves a SOTA I-AUROC of 90.7%. The source code of Physic-HM will be released after the paper is accepted.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 37 of its 48 references that are in the map. First posted on arXiv 25 Dec 2025.

Builds on

37 of 48 references.

References · 37

  1. 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
  2. 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,333
  3. 2025V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planningcited by 809
  4. 2021Towards Total Recall in Industrial Anomaly Detectioncited by 776
  5. 2021AST: Audio Spectrogram Transformercited by 643
  6. 2023AnomalyCLIP: Object-agnostic Prompt Learning for Zero-shot Anomaly Detectioncited by 271
  7. 2022A Unified Model for Multi-class Anomaly Detectioncited by 268
  8. 2023SimpleNet: A Simple Network for Image Anomaly Detection and Localizationcited by 256
  9. 2023Multimodal Foundation Models: From Specialists to General-Purpose Assistantscited by 247
  10. 2023Deep Industrial Image Anomaly Detection: A Surveycited by 148
  11. 2023Multimodal Industrial Anomaly Detection via Hybrid Fusioncited by 139
  12. 2022Asymmetric Student-Teacher Networks for Industrial Anomaly Detectioncited by 117
25 more
  1. 2024RealNet: A Feature Selection Network with Realistic Synthetic Anomaly for Anomaly Detectioncited by 116
  2. 2022Back to the Feature: Classical 3D Features are (Almost) All You Need for 3D Anomaly Detectioncited by 93
  3. 2024Dinomaly: The Less Is More Philosophy in Multi-Class Unsupervised Anomaly Detectioncited by 93
  4. 2024Toward Generalist Anomaly Detection via In-context Residual Learning with Few-shot Sample Promptscited by 89
  5. 2024ZeroG: Investigating Cross-dataset Zero-shot Transferability in Graphscited by 85
  6. 2022Omni-frequency Channel-selection Representations for Unsupervised Anomaly Detectioncited by 80
  7. 2024A Survey on Visual Anomaly Detection: Challenge, Approach, and Prospectcited by 69
  8. 2023IM-IAD: Industrial Image Anomaly Detection Benchmark in Manufacturingcited by 64
  9. 2023ReContrast: Domain-Specific Anomaly Detection via Contrastive Reconstructioncited by 63
  10. 2024ARC: A Generalist Graph Anomaly Detector with In-Context Learningcited by 48
  11. 2023Multimodal Industrial Anomaly Detection by Crossmodal Feature Mappingcited by 42
  12. 2023ReConPatch : Contrastive Patch Representation Learning for Industrial Anomaly Detectioncited by 30
  13. 2024Zero-shot Generalist Graph Anomaly Detection with Unified Neighborhood Promptscited by 28
  14. 2024Multi-Sensor Object Anomaly Detection: Unifying Appearance, Geometry, and Internal Propertiescited by 26
  15. 2024M3DM-NR: RGB-3D Noisy-Resistant Industrial Anomaly Detection via Multimodal Denoisingcited by 24
  16. 2025MC3D-AD: A Unified Geometry-aware Reconstruction Model for Multi-category 3D Anomaly Detectioncited by 23
  17. 2025One-for-More: Continual Diffusion Model for Anomaly Detectioncited by 19
  18. 2023Contextual Affinity Distillation for Image Anomaly Detectioncited by 18
  19. 2023Intelligent Multi-Modal Sensing-Communication Integration: Synesthesia of Machinescited by 15
  20. 2024Rethinking Reconstruction-based Graph-Level Anomaly Detection: Limitations and a Simple Remedycited by 13
  21. 2024Revisiting Multimodal Fusion for 3D Anomaly Detection from an Architectural Perspectivecited by 12
  22. 2024Cross-Modal Learning for Anomaly Detection in Complex Industrial Process: Methodology and Benchmarkcited by 8
  23. 2025Dinomaly2: A Unified Framework for Unsupervised Image Anomaly Detectioncited by 6
  24. 2025SiM3D: Single-instance Multiview Multimodal and Multisetup 3D Anomaly Detection Benchmarkcited by 5
  25. 2024Unsupervised Welding Defect Detection Using Audio And Videocited by 3

Built on by

Not cited yet.