mlsanityData to 7 Oct 2026

Deformation-based In-Context Learning for Point Cloud Understanding

arXiv 2604.02845 ↗First posted 3 Apr 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Recent advances in point cloud In-Context Learning (ICL) have demonstrated strong multitask capabilities. Existing approaches typically adopt a Masked Point Modeling (MPM)-based paradigm for point cloud ICL. However, MPM-based methods directly predict the target point cloud from masked tokens without leveraging geometric priors, requiring the model to infer spatial structure and geometric details solely from token-level correlations via transformers. Additionally, these methods suffer from a training-inference objective mismatch, as the model learns to predict the target point cloud using target-side information that is unavailable at inference time. To address these challenges, we propose DeformPIC, a deformation-based framework for point cloud ICL. Unlike existing approaches that rely on masked reconstruction, DeformPIC learns to deform the query point cloud under task-specific guidance from prompts, enabling explicit geometric reasoning and consistent objectives. Extensive experiments demonstrate that DeformPIC consistently outperforms previous state-of-the-art methods, achieving reductions of 1.6, 1.8, and 4.7 points in average Chamfer Distance on reconstruction, denoising, and registration tasks, respectively. Furthermore, we introduce a new out-of-domain benchmark to evaluate generalization across unseen data distributions, where DeformPIC achieves state-of-the-art performance.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 47 of its 54 references that are in the map. First posted on arXiv 3 Apr 2026.

Builds on

47 of 54 references.

References · 47

  1. 2017Attention Is All You Needcited by 59,932
  2. 2020Language Models are Few-Shot Learnerscited by 32,199
  3. 2024The Llama 3 Herd of Modelscited by 14,192
  4. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  5. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
  6. 2025Qwen3 Technical Reportcited by 8,195
  7. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
  8. 2022Scalable Diffusion Models with Transformerscited by 5,931
  9. 2016Layer Normalizationcited by 5,579
  10. 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,223
  11. 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,880
  12. 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
35 more
  1. 2018Dynamic Graph CNN for Learning on Point Cloudscited by 2,220
  2. 2017Decoupled Weight Decay Regularizationcited by 1,722
  3. 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,653
  4. 2021SimMIM: A Simple Framework for Masked Image Modelingcited by 1,147
  5. 2022Planning-oriented Autonomous Drivingcited by 1,068
  6. 2016A Point Set Generation Network for 3D Object Reconstruction from a Single Imagecited by 972
  7. 2020PCT: Point cloud transformercited by 730
  8. 2018Pixel2Mesh: Generating 3D Mesh Models from Single RGB Imagescited by 649
  9. 2021Point-BERT: Pre-training 3D Point Cloud Transformers with Masked Point Modelingcited by 647
  10. 2019Revisiting Point Cloud Classification: A New Benchmark Dataset and Classification Model on Real-World Datacited by 532
  11. 2023End-to-end Autonomous Driving: Challenges and Frontierscited by 485
  12. 2022Masked Autoencoders for Point Cloud Self-supervised Learningcited by 456
  13. 2022Images Speak in Images: A Generalist Painter for In-Context Visual Learningcited by 317
  14. 2023In-Context Learning Creates Task Vectorscited by 302
  15. 2024A Survey on Vision-Language-Action Models for Embodied AIcited by 274
  16. 2019What Do Single-view 3D Reconstruction Networks Learn?cited by 259
  17. 2022Visual Prompting via Image Inpaintingcited by 248
  18. 2018FlowNet3D: Learning Scene Flow in 3D Point Cloudscited by 241
  19. 2023In-context Vectors: Making In Context Learning More Effective and Controllable Through Latent Space Steeringcited by 240
  20. 2023Contrast with Reconstruct: Contrastive 3D Representation Learning Guided by Generative Pretrainingcited by 162
  21. 20183D-CODED : 3D Correspondences by Deep Deformationcited by 160
  22. 2022Learning 3D Representations from 2D Pre-trained Models via Image-to-Point Masked Autoencoderscited by 143
  23. 2022Autoencoders as Cross-Modal Teachers: Can Pretrained 2D Image Transformers Help 3D Representation Learning?cited by 121
  24. 2019Pixel2Mesh++: Multi-View 3D Mesh Generation via Deformationcited by 103
  25. 2023In-Context Learning Unlocked for Diffusion Modelscited by 103
  26. 2023Explore In-Context Learning for 3D Point Cloud Understandingcited by 40
  27. 2022Neural Shape Deformation Priorscited by 26
  28. 2023Skeleton-in-Context: Unified Skeleton Sequence Modeling with In-Context Learningcited by 26
  29. 2024PCP-MAE: Learning to Predict Centers for Point Masked Autoencoderscited by 23
  30. 2024DG-PIC: Domain Generalized Point-In-Context Learning for Point Cloud Understandingcited by 13
  31. 2024PCoTTA: Continual Test-Time Adaptation for Multi-Task Point Cloud Understandingcited by 11
  32. 2025UniPre3D: Unified Pre-training of 3D Point Cloud Models with Cross-Modal Gaussian Splattingcited by 6
  33. 2024MICAS: Multi-grained In-Context Adaptive Sampling for 3D Point Cloud Processingcited by 5
  34. 2024Point-In-Context: Understanding Point Cloud via In-Context Learningcited by 4
  35. 2025Human-in-Context: Unified Cross-Domain 3D Human Motion Modeling via In-Context Learningcited by 3

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Learning Point Cloud Geometry as a Statistical Manifold: Theory and Practice ↗
  2. 20243DMambaComplete: Exploring Structured State Space Model for Point Cloud Completion
  3. 2024LCM: Locally Constrained Compact Point Cloud Model for Masked Point Modeling
  4. 2025DAPointMamba: Domain Adaptive Point Mamba for Point Cloud Completion
  5. 2025ZigzagPointMamba: Spatial-Semantic Mamba for Point Cloud Understanding
  6. 2026PointLLM-R: Enhancing 3D Point Cloud Reasoning via Chain-of-Thought
  7. 2024Point Cloud Mamba: Point Cloud Learning via State Space Model
  8. 2023DiffPMAE: Diffusion Masked Autoencoders for Point Cloud Reconstruction