mlsanityData to 14 Oct 2026

SlotLifter: Slot-guided Feature Lifting for Learning Object-centric Radiance Fields

arXiv 2408.06697 ↗First posted 13 Aug 2024cs.CV cs.AI cs.LGcited by 12

Not on the map. Why?

Abstract (arXiv)

The ability to distill object-centric abstractions from intricate visual scenes underpins human-level generalization. Despite the significant progress in object-centric learning methods, learning object-centric representations in the 3D physical world remains a crucial challenge. In this work, we propose SlotLifter, a novel object-centric radiance model addressing scene reconstruction and decomposition jointly via slot-guided feature lifting. Such a design unites object-centric learning representations and image-based rendering methods, offering state-of-the-art performance in scene decomposition and novel-view synthesis on four challenging synthetic and four complex real-world datasets, outperforming existing 3D object-centric learning methods by a large margin. Through extensive ablative studies, we showcase the efficacy of designs in SlotLifter, revealing key insights for potential future directions.

Key facts. Cited by 12 papers in the map (data through 14 Oct 2026). Builds on 56 of its 64 references that are in the map. First posted on arXiv 13 Aug 2024.

Builds on

56 of 64 references.

References · 56

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  3. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  4. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  5. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
  6. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
  7. 2016Layer Normalizationcited by 5,669
  8. 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,057
  9. 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,117
  10. 2023PaLM-E: An Embodied Multimodal Language Modelcited by 2,071
  11. 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,032
  12. 2021Plenoxels: Radiance Fields without Neural Networkscited by 1,613
38 more
  1. 2020pixelNeRF: Neural Radiance Fields from One or Few Imagescited by 1,584
  2. 2020Object-Centric Learning with Slot Attentioncited by 876
  3. 2021MVSNeRF: Fast Generalizable Radiance Field Reconstruction from Multi-View Stereocited by 740
  4. 2022Block-NeRF: Scalable Large Scene Neural View Synthesiscited by 724
  5. 2021IBRNet: Learning Multi-View Image-Based Renderingcited by 703
  6. 2022Point-NeRF: Point-based Neural Radiance Fieldscited by 503
  7. 2023Symbolic Discovery of Optimization Algorithmscited by 434
  8. 2019MONet: Unsupervised Scene Decomposition and Representationcited by 392
  9. 2021ABO: Dataset and Benchmarks for Real-World 3D Object Understandingcited by 366
  10. 2019Multi-Object Representation Learning with Iterative Variational Inferencecited by 360
  11. 2023FreeNeRF: Improving Few-shot Neural Rendering with Free Frequency Regularizationcited by 311
  12. 2021Conditional Object-Centric Learning from Videocited by 248
  13. 2020On the Binding Problem in Artificial Neural Networkscited by 233
  14. 2019GENESIS: Generative Scene Inference and Sampling with Object-Centric Latent Representationscited by 227
  15. 2022Bridging the Gap to Real-World Object-Centric Learningcited by 220
  16. 2016Attend, Infer, Repeat: Fast Scene Understanding with Generative Modelscited by 209
  17. 2021NerfingMVS: Guided Optimization of Neural Radiance Fields for Indoor Multi-view Stereocited by 192
  18. 2020SPACE: Unsupervised Object-Oriented Scene Representation via Spatial Attention and Decompositioncited by 190
  19. 2023GPS-Gaussian: Generalizable Pixel-wise 3D Gaussian Splatting for Real-time Human Novel View Synthesiscited by 170
  20. 2022Self-Supervised Transformers for Unsupervised Object Discovery using Normalized Cutcited by 167
  21. 2022SAVi++: Towards End-to-End Object-Centric Learning from Real-World Videoscited by 166
  22. 2021Illiterate DALL-E Learns to Composecited by 147
  23. 2022Simple Unsupervised Object-Centric Learning for Complex and Naturalistic Videoscited by 139
  24. 2017Neural Expectation Maximizationcited by 123
  25. 2022Is Attention All That NeRF Needs?cited by 113
  26. 2021Unsupervised Discovery of Object Radiance Fieldscited by 101
  27. 2022NeRFusion: Fusing Radiance Fields for Large-Scale Scene Reconstructioncited by 100
  28. 2022Object Scene Representation Transformercited by 90
  29. 2021Decomposing 3D Scenes into Objects via Unsupervised Volume Segmentationcited by 88
  30. 2022Object discovery and representation networkscited by 80
  31. 2023Object-Centric Learning for Real-World Videos by Predicting Temporal Feature Similaritiescited by 78
  32. 2021Unsupervised Learning of Compositional Energy Conceptscited by 71
  33. 2016Tagger: Deep Unsupervised Perceptual Groupingcited by 69
  34. 2022Improving Object-centric Learning with Query Optimizationcited by 60
  35. 2021Unsupervised Part Discovery from Contrastive Reconstructioncited by 57
  36. 2020Learning Physical Graph Representations from Visual Scenescited by 50
  37. 2023Single-view 3D Scene Reconstruction with High-fidelity Shape and Texturecited by 37
  38. 2023SurfelNeRF: Neural Surfel Radiance Fields for Online Photorealistic Reconstruction of Indoor Scenescited by 30

50 most cited of 56 All 56 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 1; 2025: 6; 2026: 5.

12 papers.

  1. 2025ArtGS: Building Interactable Replicas of Complex Articulated Objects via Gaussian Splattingcited by 67
  2. 2025Decompositional Neural Scene Reconstruction with Generative Diffusion Priorcited by 31
  3. 2025DreamArt: Generating Interactable Articulated Objects from a Single Imagecited by 25
  4. 2025Unveiling the Mist over 3D Vision-Language Understanding: Object-centric Evaluation with Chain-of-Analysiscited by 23
  5. 2024MOVIS: Enhancing Multi-Object Novel View Synthesis for Indoor Scenescited by 10
  6. 2025TACO: Taming Diffusion for in-the-wild Video Amodal Completioncited by 10
  7. 2026Rethinking Object-Centric Representations for Video Dynamics Modelingcited by 2
  8. 2026A Hyperbolic Perspective on Hierarchical Structure in Object-Centric Scene Representationscited by 1
  9. 2026Rethinking Temporal Consistency in Video Object-Centric Learning: From Prediction to Correspondencecited by 1
  10. 2026Scenes as Objects, Not Primitives: Instance-Structured 3D Tokenization from Unposed Viewscited by 1
  11. 2025Identifiable Object Representations under Spatial Ambiguitiescited by 0
  12. 2026HSA: Hierarchical Slot Attention for Multi-granularity Scene-Decompositioncited by 0