mlsanityData to 7 Oct 2026

ChangingGrounding: 3D Visual Grounding in Changing Scenes

arXiv 2510.14965 ↗First posted 16 Oct 2025cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

Real-world robots localize objects from natural-language instructions while scenes around them keep changing. Yet most of the existing 3D visual grounding (3DVG) method still assumes a reconstructed and up-to-date point cloud, an assumption that forces costly re-scans and hinders deployment. We argue that 3DVG should be formulated as an active, memory-driven problem, and we introduce ChangingGrounding, the first benchmark that explicitly measures how well an agent can exploit past observations, explore only where needed, and still deliver precise 3D boxes in changing scenes. To set a strong reference point, we also propose Mem-ChangingGrounder, a zero-shot method for this task that marries cross-modal retrieval with lightweight multi-view fusion: it identifies the object type implied by the query, retrieves relevant memories to guide actions, then explores the target efficiently in the scene, falls back when previous operations are invalid, performs multi-view scanning of the target, and projects the fused evidence from multi-view scans to get accurate object bounding boxes. We evaluate different baselines on ChangingGrounding, and our Mem-ChangingGrounder achieves the highest localization accuracy while greatly reducing exploration cost. We hope this benchmark and method catalyze a shift toward practical, memory-centric 3DVG research for real-world applications. Project page: https://hm123450.github.io/CGB/ .

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 36 of its 50 references that are in the map. First posted on arXiv 16 Oct 2025.

Builds on

36 of 50 references.

References · 36

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  3. 2020Language Models are Few-Shot Learnerscited by 32,199
  4. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  5. 2023Segment Anythingcited by 8,158
  6. 2023Visual Instruction Tuningcited by 7,792
  7. 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,384
  8. 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,274
  9. 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,088
  10. 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,534
  11. 2019ScanRefer: 3D Object Localization in RGB-D Scans using Natural Languagecited by 446
  12. 2023PointLLM: Empowering Large Language Models to Understand Point Cloudscited by 326
24 more
  1. 20233D-VisTA: Pre-trained Transformer for 3D Vision and Text Alignmentcited by 201
  2. 2019RIO: 3D Object Instance Re-Localization in Changing Indoor Environmentscited by 187
  3. 2023Multi3DRefer: Grounding Text Description to Multiple 3D Objectscited by 142
  4. 2023LLM-Grounder: Open-Vocabulary 3D Visual Grounding with Large Language Model as an Agentcited by 134
  5. 2021Bottom Up Top Down Detection Transformers for Language Grounding in Images and Point Cloudscited by 128
  6. 20223D-SPS: Single-Stage 3D Visual Grounding via Referred Point Progressive Selectioncited by 109
  7. 2022EDA: Explicit Text-Decoupling and Dense Alignment for 3D Visual Groundingcited by 98
  8. 2020Detailed 2D-3D Joint Representation for Human-Object Interactioncited by 93
  9. 2018InteriorNet: Mega-scale Multi-sensor Photo-realistic Indoor Scenes Datasetcited by 87
  10. 2021Computer-Aided Design as Languagecited by 82
  11. 2024FastVLM: Efficient Vision Encoding for Vision Language Modelscited by 76
  12. 2024SeeGround: See and Ground for Zero-Shot Open-Vocabulary 3D Visual Groundingcited by 66
  13. 2023Visual Programming for Zero-shot Open-Vocabulary 3D Visual Groundingcited by 64
  14. 2024VLM-Grounder: A VLM Agent for Zero-Shot 3D Visual Groundingcited by 56
  15. 2019ShapeGlot: Learning Language for Shape Differentiationcited by 54
  16. 2024ScanReason: Empowering 3D Visual Grounding with Reasoning Capabilitiescited by 47
  17. 2023PATS: Patch Area Transportation with Subdivision for Local Feature Matchingcited by 33
  18. 2020Beyond Controlled Environments: 3D Camera Re-Localization in Changing Indoor Scenescited by 31
  19. 20223D VSG: Long-term Semantic Scene Change Prediction through 3D Variable Scene Graphscited by 24
  20. 2025TSP3D: Text-guided Sparse Voxel Pruning for Efficient 3D Visual Groundingcited by 17
  21. 2023Living Scenes: Multi-object Relocalization and Reconstruction in Changing 3D Environmentscited by 15
  22. 2022Objects Can Move: 3D Change Detection by Geometric Transformation Constistencycited by 13
  23. 2025ViGiL3D: A Linguistically Diverse Dataset for 3D Visual Groundingcited by 7
  24. 2025Hypo3D: Exploring Hypothetical Reasoning in 3Dcited by 5

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.