mlsanityData to 7 Oct 2026

MSEG-VCUQ: Multimodal SEGmentation with Enhanced Vision Foundation Models, Convolutional Neural Networks, and Uncertainty Quantification for High-Speed Video Phase Detection Data

arXiv 2411.07463 ↗First posted 12 Nov 2024cs.CV cs.LG eess.IVcited by 0

Not on the map. Why?

Abstract (arXiv)

High-speed video (HSV) phase detection (PD) segmentation is crucial for monitoring vapor, liquid, and microlayer phases in industrial processes. While CNN-based models like U-Net have shown success in simplified shadowgraphy-based two-phase flow (TPF) analysis, their application to complex HSV PD tasks remains unexplored, and vision foundation models (VFMs) have yet to address the complexities of either shadowgraphy-based or PD TPF video segmentation. Existing uncertainty quantification (UQ) methods lack pixel-level reliability for critical metrics like contact line density and dry area fraction, and the absence of large-scale, multimodal experimental datasets tailored to PD segmentation further impedes progress. To address these gaps, we propose MSEG-VCUQ. This hybrid framework integrates U-Net CNNs with the transformer-based Segment Anything Model (SAM) to achieve enhanced segmentation accuracy and cross-modality generalization. Our approach incorporates systematic UQ for robust error assessment and introduces the first open-source multimodal HSV PD datasets. Empirical results demonstrate that MSEG-VCUQ outperforms baseline CNNs and VFMs, enabling scalable and reliable PD segmentation for real-world boiling dynamics.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 14 of its 54 references that are in the map. First posted on arXiv 12 Nov 2024.

Builds on

14 of 54 references.

References · 14

  1. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  2. 2014Microsoft COCO: Common Objects in Contextcited by 17,498
  3. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
  4. 2023Segment Anythingcited by 8,158
  5. 2017Mask R-CNNcited by 7,259
  6. 2021Masked-attention Mask Transformer for Universal Image Segmentationcited by 2,338
  7. 2019Deep High-Resolution Representation Learning for Visual Recognitioncited by 1,417
  8. 2023Segment Everything Everywhere All at Oncecited by 546
  9. 2023Segment Anything Model for Medical Image Analysis: an Experimental Studycited by 291
  10. 2023Segment Anything Is Not Always Perfect: An Investigation of SAM on Different Real-world Applicationscited by 121
  11. 2023The Segment Anything Model (SAM) for Remote Sensing Applications: From Zero to One Shotcited by 83
  12. 2023Follow Anything: Open-set detection, tracking, and following in real-timecited by 28
2 more
  1. 2020Uncertainty quantification in medical image segmentation with normalizing flowscited by 23
  2. 2024VideoSAM: A Large Vision Foundation Model for High-Speed Video Segmentationcited by 1

Built on by

Not cited yet.