RI-Mamba: Rotation-Invariant Mamba for Robust Text-to-Shape Retrieval
On the map: State-space sequence models (S4, Mamba) → Point clouds, detection and remote sensing
Abstract (arXiv)
3D assets have rapidly expanded in quantity and diversity due to the growing popularity of virtual reality and gaming. As a result, text-to-shape retrieval has become essential in facilitating intuitive search within large repositories. However, existing methods require canonical poses and support few object categories, limiting their real-world applicability where objects can belong to diverse classes and appear in random orientations. To address this challenge, we propose RI-Mamba, the first rotation-invariant state-space model for point clouds. RI-Mamba defines global and local reference frames to disentangle pose from geometry and uses Hilbert sorting to construct token sequences with meaningful geometric structure while maintaining rotation invariance. We further introduce a novel strategy to compute orientational embeddings and reintegrate them via feature-wise linear modulation, effectively recovering spatial context and enhancing model expressiveness. Our strategy is inherently compatible with state-space models and operates in linear time. To scale up retrieval, we adopt cross-modal contrastive learning with automated triplet generation, allowing training on diverse datasets without manual annotation. Extensive experiments demonstrate RI-Mamba's superior representational capacity and robustness, achieving state-of-the-art performance on the OmniObject3D benchmark across more than 200 object categories under arbitrary orientations. Our code will be made available at https://github.com/ndkhanh360/RI-Mamba.git.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Point clouds, detection and remote sensing, one of 10 directions in State-space sequence models (S4, Mamba). Builds on 40 of its 50 references that are in the map. First posted on arXiv 12 Feb 2026.
Builds on
40 of 50 references.
Closest ancestors · 1
Same direction, newest first
Other references · 39
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2023Visual Instruction Tuningcited by 7,792
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,223
- 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,616
- 2016Gaussian Error Linear Units (GELUs)cited by 3,431
- 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,880
- 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,286
- 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,522
- 2022Reproducible scaling laws for contrastive language-image learningcited by 1,163
- 2023Objaverse-XL: A Universe of 10M+ 3D Objectscited by 767
27 more
- 2018Tensor field networks: Rotation- and translation-equivariant neural networks for 3D point cloudscited by 735
- 2021Point-BERT: Pre-training 3D Point Cloud Transformers with Masked Point Modelingcited by 647
- 2021ABO: Dataset and Benchmarks for Real-World 3D Object Understandingcited by 360
- 2023OmniObject3D: Large-Vocabulary 3D Object Dataset for Realistic Perception, Reconstruction and Generationcited by 324
- 20203D-FUTURE: 3D Furniture shape with TextUREcited by 306
- 2021Vector Neurons: A General Framework for SO(3)-Equivariant Networkscited by 304
- 2022ULIP: Learning a Unified Representation of Language, Images, and Point Clouds for 3D Understandingcited by 262
- 2017Learning SO(3) Equivariant Representations with Spherical CNNscited by 244
- 2023Uni3D: Exploring Unified 3D Representation at Scalecited by 231
- 2021Scene Representation Transformer: Geometry-Free Novel View Synthesis Through Set-Latent Scene Representationscited by 222
- 2023OpenShape: Scaling Up 3D Shape Representation Towards Open-World Understandingcited by 183
- 2018Text2Shape: Generating Shapes from Natural Language by Learning Joint Embeddingscited by 169
- 2020A Rotation-Invariant Framework for Deep Point Cloud Analysiscited by 62
- 2022RIConv++: Effective Rotation Invariant Convolutions for 3D Point Clouds Deep Learningcited by 29
- 2018Y^2Seq2Seq: Cross-Modal Representation Learning for 3D Shape and Text by Joint Reconstruction and Prediction of View and Word Sequencescited by 26
- 2024TAMM: TriAdapter Multi-Modal Learning for 3D Shape Understandingcited by 26
- 2022TriCoLo: Trimodal Contrastive Loss for Text to Shape Retrievalcited by 18
- 2022The Devil is in the Pose: Ambiguity-free 3D Rotation-invariant Learning via Pose-aware Convolutioncited by 18
- 2024RI-MAE: Rotation-Invariant Masked AutoEncoders for Self-Supervised Point Cloud Representation Learningcited by 15
- 2021Parts2Words: Learning Joint Embedding of Point Clouds and Texts by Bidirectional Matching between Parts and Wordscited by 14
- 2025Skip Mamba Diffusion for Monocular 3D Semantic Scene Completioncited by 9
- 2025SCA3D: Enhancing Cross-modal 3D Retrieval via 3D Shape and Caption Paired Data Augmentationcited by 9
- 2024Local-consistent Transformation Learning for Rotation-invariant Point Cloud Analysiscited by 6
- 2024COM3D: Leveraging Cross-View Correspondence and Cross-Modal Mining for 3D Retrievalcited by 6
- 2025CymbaDiff: Structured Spatial Diffusion for Sketch-based 3D Semantic Urban Scene Generationcited by 3
- 2025Occlusion-aware Text-Image-Point Cloud Pretraining for Open-World 3D Object Recognitioncited by 2
- 2025Retrieving Objects from 3D Scenes with Box-Guided Open-Vocabulary Instance Segmentationcited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025DM3D: Dynamic Mamba via Offset-Guided Feature Resampling for Point Cloud Understanding
- 2025MetaFind: Scene-Aware 3D Asset Retrieval for Coherent Metaverse Scene Generation
- 2024NIMBA: Towards Robust and Principled Processing of Point Clouds With SSMs
- 2025Spectral Informed Mamba for Robust Point Cloud Processing
- 2025MambaTron: Efficient Cross-Modal Point Cloud Enhancement using Aggregate Selective State Space Modeling
- 2025DAPointMamba: Domain Adaptive Point Mamba for Point Cloud Completion
- 2025StruMamba3D: Exploring Structural Mamba for Self-supervised Point Cloud Representation Learning
- 2026Rotation Equivariant Mamba for Vision Tasks