Vox-UDA: Voxel-wise Unsupervised Domain Adaptation for Cryo-Electron Subtomogram Segmentation with Denoised Pseudo Labeling
Not on the map. Why?
Abstract (arXiv)
Cryo-Electron Tomography (cryo-ET) is a 3D imaging technology facilitating the study of macromolecular structures at near-atomic resolution. Recent volumetric segmentation approaches on cryo-ET images have drawn widespread interest in biological sector. However, existing methods heavily rely on manually labeled data, which requires highly professional skills, thereby hindering the adoption of fully-supervised approaches for cryo-ET images. Some unsupervised domain adaptation (UDA) approaches have been designed to enhance the segmentation network performance using unlabeled data. However, applying these methods directly to cryo-ET images segmentation tasks remains challenging due to two main issues: 1) the source data, usually obtained through simulation, contain a certain level of noise, while the target data, directly collected from raw-data from real-world scenario, have unpredictable noise levels. 2) the source data used for training typically consists of known macromoleculars, while the target domain data are often unknown, causing the model's segmenter to be biased towards these known macromolecules, leading to a domain shift problem. To address these challenges, in this work, we introduce the first voxel-wise unsupervised domain adaptation approach, termed Vox-UDA, specifically for cryo-ET subtomogram segmentation. Vox-UDA incorporates a noise generation module to simulate target-like noises in the source dataset for cross-noise level adaptation. Additionally, we propose a denoised pseudo-labeling strategy based on improved Bilateral Filter to alleviate the domain shift problem. Experimental results on both simulated and real cryo-ET subtomogram datasets demonstrate the superiority of our proposed approach compared to state-of-the-art UDA methods.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 25 of its 68 references that are in the map. First posted on arXiv 25 Jun 2024.
Builds on
25 of 68 references.
References · 25
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,736
- 2016DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFscited by 3,239
- 2015Domain-Adversarial Training of Neural Networkscited by 3,023
- 2020FixMatch: Simplifying Semi-Supervised Learning with Consistency and Confidencecited by 2,080
- 2018Noise2Noise: Learning Image Restoration without Clean Datacited by 526
- 2021TVT: Transferable Vision Transformer for Unsupervised Domain Adaptationcited by 81
- 2021Uncertainty-Aware Unsupervised Domain Adaptation in Object Detectioncited by 59
- 2021Dynamic Weighted Learning for Unsupervised Domain Adaptationcited by 53
- 2023Both Style and Distortion Matter: Dual-Path Unsupervised Domain Adaptation for Panoramic Semantic Segmentationcited by 46
- 2019Iteratively-Refined Interactive 3D Medical Image Segmentation with Multi-Agent Reinforcement Learningcited by 41
- 2021Spectral Unsupervised Domain Adaptation for Visual Recognitioncited by 40
13 more
- 2022ConfMix: Unsupervised Domain Adaptation for Object Detection via Confidence-based Mixingcited by 28
- 2022LE-UDA: Label-efficient unsupervised domain adaptation for medical image segmentationcited by 27
- 2020Unsupervised Domain Adaptation for Semantic Segmentation by Content Transfercited by 24
- 2021Instance Level Affinity-Based Transfer for Unsupervised Domain Adaptationcited by 21
- 2022Domain Adaptive Nuclei Instance Segmentation and Classification via Category-aware Feature Alignment and Pseudo-labellingcited by 16
- 2023Unsupervised Domain Adaptation for Semantic Segmentation with Pseudo Label Self-Refinementcited by 16
- 2022Unsupervised domain adaptation semantic segmentation of high-resolution remote sensing imagery with invariant domain-level prototype memorycited by 15
- 2023SDC-UDA: Volumetric Unsupervised Domain Adaptation Framework for Slice-Direction Continuous Cross-Modality Medical Image Segmentationcited by 10
- 2023Spectral Adversarial MixUp for Few-Shot Unsupervised Domain Adaptationcited by 8
- 2023ASC: Appearance and Structure Consistency for Unsupervised Domain Adaptation in Fetal Brain MRI Segmentationcited by 7
- 2021Cryo-shift: Reducing domain shift in cryo-electron subtomograms with unsupervised domain adaptation and randomizationcited by 3
- 2021Active Learning to Classify Macromolecular Structures in situ for Less Supervision in Cryo-Electron Tomographycited by 2
- 2023FakET: Simulating Cryo-Electron Tomograms with Neural Style Transfercited by 2
Built on by
Not cited yet.