mlsanityData to 7 Oct 2026

AuricularWorld: Hierarchical Action-Guided World Modeling for Fine-Grained Auricular Structure Segmentation from CT Scans

arXiv 2607.28487 ↗First posted 30 Jul 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Fine-grained segmentation of auricular structures in CT is challenging because the ear occupies a small image region, cartilage boundaries are highly irregular, and interfaces between cartilage and surrounding soft tissues are often ambiguous. Clinical annotations may also include both composite structures containing cartilage and adjacent skin and their corresponding cartilage-only regions, producing nested and overlapping labels. We propose a world-model-based segmentation framework that enables iterative anatomical reasoning beyond conventional feed-forward prediction. Built on an encoder-decoder architecture, the framework introduces a deterministic recurrent state-space model into the intermediate latent space. Multi-scale encoder features and partially decoded representations are fused to form a structural observation that initializes the latent dynamics. During inference, the model performs a three-step latent rollout without ground-truth guidance. Hierarchical anatomical actions update the recurrent state and progressively refine the latent representation. The resulting latent trajectory is projected back into the decoder and combined with high-resolution features to produce the final segmentation. To learn reliable latent transitions, we introduce a balanced hierarchical action objective that addresses foreground sparsity, missing anatomical groups, and imbalance between add and remove operations. Extensive experiments show that the proposed framework consistently improves segmentation accuracy and reduces HD95 by more than 43% for small, irregular, and overlapping auricular structures in CT. These results demonstrate the effectiveness of latent world-model reasoning for challenging medical image segmentation.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 24 of its 52 references that are in the map. First posted on arXiv 30 Jul 2026.

Builds on

24 of 52 references.

References · 24

  1. 2017Attention Is All You Needcited by 59,932
  2. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  3. 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,616
  4. 2019Dream to Control: Learning Behaviors by Latent Imaginationcited by 1,598
  5. 2021TransUNet: Transformers Make Strong Encoders for Medical Image Segmentationcited by 1,552
  6. 2018World Modelscited by 1,444
  7. 2024Transformers are SSMs: Generalized Models and Efficient Algorithms Through Structured State Space Dualitycited by 1,283
  8. 2018Learning Latent Dynamics for Planning from Pixelscited by 1,221
  9. 2021UNETR: Transformers for 3D Medical Image Segmentationcited by 954
  10. 2022Swin UNETR: Swin Transformers for Semantic Segmentation of Brain Tumors in MRI Imagescited by 823
  11. 2022TotalSegmentator: robust segmentation of 104 anatomical structures in CT imagescited by 597
  12. 2022MONAI: An open-source framework for deep learning in healthcarecited by 438
12 more
  1. 2021nnFormer: Interleaved Transformer for Volumetric Segmentationcited by 179
  2. 2018AnatomyNet: Deep Learning for Fast and Fully Automated Whole-volume Segmentation of Head and Neck Anatomycited by 54
  3. 2024nnMamba: 3D Biomedical Image Segmentation, Classification and Landmark Detection with State Space Modelcited by 45
  4. 2025CheXWorld: Exploring Image World Modeling for Radiograph Representation Learningcited by 18
  5. 2024SliceMamba with Neural Architecture Search for Medical Image Segmentationcited by 11
  6. 2023ASC: Appearance and Structure Consistency for Unsupervised Domain Adaptation in Fetal Brain MRI Segmentationcited by 7
  7. 2024Intensity Confusion Matters: An Intensity-Distance Guided Loss for Bronchus Segmentationcited by 6
  8. 2022BCNet: Bronchus Classification via Structure Guided Representation Learningcited by 5
  9. 2025A Comprehensive Analysis of Mamba for 3D Volumetric Medical Image Segmentationcited by 4
  10. 2026DreamReg: Belief-Driven World Model for 2D-3D Ultrasound Registrationcited by 4
  11. 2026Medical world models in healthcare: foundations, applications, and challenges for trustworthy clinical translationcited by 3
  12. 2024Costal Cartilage Segmentation with Topology Guided Deformable Mamba: Method and Benchmarkcited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Concept-to-Pixel: Prompt-Free Universal Medical Image Segmentation
  2. 2026CheXanatomy: Anatomy-Aware Vision-Language Modeling for Chest Radiographs
  3. 2024MASSM: An End-to-End Deep Learning Framework for Multi-Anatomy Statistical Shape Modeling Directly From Images
  4. 2026Segmentation, Detection and Explanation: A Unified Framework for CT Appearance Reasoning
  5. 2024GuideGen: A Text-Guided Framework for Paired Full-torso Anatomy and CT Volume Generation
  6. 2025RAU: Reference-based Anatomical Understanding with Vision Language Models
  7. 2026SpectralMamba-UNet: Frequency-Disentangled State Space Modeling for Texture-Structure Consistent Medical Image Segmentation
  8. 2026High-Fidelity Medical Shape Generation via Skeletal Latent Diffusion