Deformation-based In-Context Learning for Point Cloud Understanding
Not on the map. Why?
Abstract (arXiv)
Recent advances in point cloud In-Context Learning (ICL) have demonstrated strong multitask capabilities. Existing approaches typically adopt a Masked Point Modeling (MPM)-based paradigm for point cloud ICL. However, MPM-based methods directly predict the target point cloud from masked tokens without leveraging geometric priors, requiring the model to infer spatial structure and geometric details solely from token-level correlations via transformers. Additionally, these methods suffer from a training-inference objective mismatch, as the model learns to predict the target point cloud using target-side information that is unavailable at inference time. To address these challenges, we propose DeformPIC, a deformation-based framework for point cloud ICL. Unlike existing approaches that rely on masked reconstruction, DeformPIC learns to deform the query point cloud under task-specific guidance from prompts, enabling explicit geometric reasoning and consistent objectives. Extensive experiments demonstrate that DeformPIC consistently outperforms previous state-of-the-art methods, achieving reductions of 1.6, 1.8, and 4.7 points in average Chamfer Distance on reconstruction, denoising, and registration tasks, respectively. Furthermore, we introduce a new out-of-domain benchmark to evaluate generalization across unseen data distributions, where DeformPIC achieves state-of-the-art performance.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 47 of its 54 references that are in the map. First posted on arXiv 3 Apr 2026.
Builds on
47 of 54 references.
References · 47
- 2017Attention Is All You Needcited by 59,932
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
- 2025Qwen3 Technical Reportcited by 8,195
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
- 2022Scalable Diffusion Models with Transformerscited by 5,931
- 2016Layer Normalizationcited by 5,579
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,223
- 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,880
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
35 more
- 2018Dynamic Graph CNN for Learning on Point Cloudscited by 2,220
- 2017Decoupled Weight Decay Regularizationcited by 1,722
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,653
- 2021SimMIM: A Simple Framework for Masked Image Modelingcited by 1,147
- 2022Planning-oriented Autonomous Drivingcited by 1,068
- 2016A Point Set Generation Network for 3D Object Reconstruction from a Single Imagecited by 972
- 2020PCT: Point cloud transformercited by 730
- 2018Pixel2Mesh: Generating 3D Mesh Models from Single RGB Imagescited by 649
- 2021Point-BERT: Pre-training 3D Point Cloud Transformers with Masked Point Modelingcited by 647
- 2019Revisiting Point Cloud Classification: A New Benchmark Dataset and Classification Model on Real-World Datacited by 532
- 2023End-to-end Autonomous Driving: Challenges and Frontierscited by 485
- 2022Masked Autoencoders for Point Cloud Self-supervised Learningcited by 456
- 2022Images Speak in Images: A Generalist Painter for In-Context Visual Learningcited by 317
- 2023In-Context Learning Creates Task Vectorscited by 302
- 2024A Survey on Vision-Language-Action Models for Embodied AIcited by 274
- 2019What Do Single-view 3D Reconstruction Networks Learn?cited by 259
- 2022Visual Prompting via Image Inpaintingcited by 248
- 2018FlowNet3D: Learning Scene Flow in 3D Point Cloudscited by 241
- 2023In-context Vectors: Making In Context Learning More Effective and Controllable Through Latent Space Steeringcited by 240
- 2023Contrast with Reconstruct: Contrastive 3D Representation Learning Guided by Generative Pretrainingcited by 162
- 20183D-CODED : 3D Correspondences by Deep Deformationcited by 160
- 2022Learning 3D Representations from 2D Pre-trained Models via Image-to-Point Masked Autoencoderscited by 143
- 2022Autoencoders as Cross-Modal Teachers: Can Pretrained 2D Image Transformers Help 3D Representation Learning?cited by 121
- 2019Pixel2Mesh++: Multi-View 3D Mesh Generation via Deformationcited by 103
- 2023In-Context Learning Unlocked for Diffusion Modelscited by 103
- 2023Explore In-Context Learning for 3D Point Cloud Understandingcited by 40
- 2022Neural Shape Deformation Priorscited by 26
- 2023Skeleton-in-Context: Unified Skeleton Sequence Modeling with In-Context Learningcited by 26
- 2024PCP-MAE: Learning to Predict Centers for Point Masked Autoencoderscited by 23
- 2024DG-PIC: Domain Generalized Point-In-Context Learning for Point Cloud Understandingcited by 13
- 2024PCoTTA: Continual Test-Time Adaptation for Multi-Task Point Cloud Understandingcited by 11
- 2025UniPre3D: Unified Pre-training of 3D Point Cloud Models with Cross-Modal Gaussian Splattingcited by 6
- 2024MICAS: Multi-grained In-Context Adaptive Sampling for 3D Point Cloud Processingcited by 5
- 2024Point-In-Context: Understanding Point Cloud via In-Context Learningcited by 4
- 2025Human-in-Context: Unified Cross-Domain 3D Human Motion Modeling via In-Context Learningcited by 3
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Learning Point Cloud Geometry as a Statistical Manifold: Theory and Practice ↗
- 20243DMambaComplete: Exploring Structured State Space Model for Point Cloud Completion
- 2024LCM: Locally Constrained Compact Point Cloud Model for Masked Point Modeling
- 2025DAPointMamba: Domain Adaptive Point Mamba for Point Cloud Completion
- 2025ZigzagPointMamba: Spatial-Semantic Mamba for Point Cloud Understanding
- 2026PointLLM-R: Enhancing 3D Point Cloud Reasoning via Chain-of-Thought
- 2024Point Cloud Mamba: Point Cloud Learning via State Space Model
- 2023DiffPMAE: Diffusion Masked Autoencoders for Point Cloud Reconstruction