mlsanityData to 7 Oct 2026

XDen-1K: A Density Field Dataset of Real-World Objects

arXiv 2512.10668 ↗First posted 11 Dec 2025cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

A deep understanding of the physical world is essential for robotic manipulation and physically realistic simulation. While current methods, including VLM-based and other learning-based approaches, have shown promise in physical property inference, their evaluation is often hindered by the lack of physically grounded reference data. To address this gap, we introduce XDen-1K, the first large-scale multimodal dataset that provides physically grounded density field for real-world objects. XDen-1K comprises 1,000 real-world objects spanning 137 categories, with comprehensive data for each object, including a high-resolution, carefully curated 3D geometric model with part-level annotations and paired real-world biplanar X-ray scans. In addition, XDen-1K includes high-fidelity volumetric density field reconstructed from sparse biplanar X-ray views via a novel optimization framework. XDen-1K also provides a benchmark for density estimation and enables X-ray-conditioned volumetric segmentation. Experiments further demonstrate that the center-of-mass prior derived by XDen-1K can improve robotic manipulation performance. By providing real-world X-ray scans and physics-consistent density field, XDen-1K establishes a foundation for advancing physical property inference and embodied AI.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 52 of its 72 references that are in the map. First posted on arXiv 11 Dec 2025.

Builds on

52 of 72 references.

References · 52

  1. 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,384
  2. 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,088
  3. 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,286
  4. 2025VGGT: Visual Geometry Grounded Transformercited by 1,475
  5. 2020Point Transformercited by 1,462
  6. 20194D Spatio-Temporal ConvNets: Minkowski Convolutional Neural Networkscited by 1,201
  7. 20173D Semantic Segmentation with Submanifold Sparse Convolutional Networkscited by 746
  8. 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 742
  9. 2019CLEVRER: CoLlision Events for Video REpresentation and Reasoningcited by 475
  10. 2024CLAY: A Controllable Large-scale Generative Model for Creating High-quality 3D Assetscited by 444
  11. 2023Gaussian Grouping: Segment and Edit Anything in 3D Scenescited by 387
  12. 2019Point-Voxel CNN for Efficient 3D Deep Learningcited by 343
38 more
  1. 2022AnyGrasp: Robust and Efficient Grasp Perception in Spatial and Temporal Domainscited by 205
  2. 2019CvxNet: Learnable Convex Decompositioncited by 173
  3. 2023Segment Any 3D Gaussianscited by 158
  4. 2023PAC-NeRF: Physics Augmented Continuum Neural Radiance Fields for Geometry-Agnostic System Identificationcited by 145
  5. 2019PHYRE: A New Benchmark for Physical Reasoningcited by 137
  6. 2024GARField: Group Anything with Radiance Fieldscited by 108
  7. 2025CAST: Component-Aligned 3D Scene Reconstruction from an RGB Imagecited by 101
  8. 2024SAMPart3D: Segment Any Part in 3D Objectscited by 95
  9. 2025PARTFIELD: Learning 3D Feature Fields for Part Segmentation and Beyondcited by 91
  10. 2019X2CT-GAN: Reconstructing CT from Biplanar X-Rays with Generative Adversarial Networkscited by 85
  11. 2025PhysTwin: Physics-Informed Reconstruction and Simulation of Deformable Objects from Videoscited by 78
  12. 2023OmniSeg3D: Omniversal 3D Segmentation via Hierarchical Contrastive Learningcited by 75
  13. 2023Structure-Aware Sparse-View X-ray 3D Reconstructioncited by 70
  14. 2019DensePhysNet: Learning Dense Physical Object Representations via Multi-step Dynamic Interactionscited by 61
  15. 2025OmniPart: Part-Aware 3D Generation with Semantic Decoupling and Structural Cohesioncited by 60
  16. 2023Physion++: Evaluating Physical Scene Understanding that Requires Online Inference of Different Physical Propertiescited by 53
  17. 2024Point-SAM: Promptable 3D Segmentation Model for Point Cloudscited by 49
  18. 2024Physical Property Understanding from Language-Embedded Feature Fieldscited by 45
  19. 2025PhysX-3D: Physical-Grounded 3D Asset Generationcited by 40
  20. 2025P3-SAM: Native 3D Part Segmentationcited by 39
  21. 2024Physically Compatible 3D Object Modeling from a Single Imagecited by 38
  22. 2024Segment Any Meshcited by 37
  23. 2025BANG: Dividing 3D Assets via Generative Exploded Dynamicscited by 35
  24. 2025PhysX-Anything: Simulation-Ready Physical 3D Assets from Single Imagecited by 32
  25. 2022Self-Supervised Coordinate Projection Network for Sparse-View Computed Tomographycited by 31
  26. 2024Material Anything: Generating Materials for Any 3D Object via Diffusioncited by 31
  27. 2024Find Any Part in 3Dcited by 30
  28. 2025Vid2Sim: Realistic and Interactive Simulation from Video for Urban Navigationcited by 30
  29. 2025PartNeXt: A Next-Generation Dataset for Fine-Grained and Hierarchical 3D Part Understandingcited by 24
  30. 2024MeshSegmenter: Zero-Shot Mesh Semantic Segmentation via Texture Synthesiscited by 22
  31. 2025Pixie: Fast and Generalizable Supervised Learning of 3D Physics from Pixelscited by 22
  32. 2024GaussianProperty: Integrating Physical Properties to 3D Gaussians with LMMscited by 20
  33. 2025PUGS: Zero-shot Physical Understanding with Gaussian Splattingcited by 20
  34. 2023Perspective Projection-Based 3D CT Reconstruction from Biplanar X-rayscited by 18
  35. 2023I-PHYRE: Interactive Physical Reasoningcited by 15
  36. 2019Scalable and modular material point method for large-scale simulationscited by 9
  37. 2024DX2CT: Diffusion Model for 3D CT Reconstruction from Bi or Mono-planar 2D X-ray(s)cited by 8
  38. 2025Inferring Dynamic Physical Properties from Video Foundation Modelscited by 5

50 most cited of 52 All 52 (JSON)

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025High-Fidelity Simulated Data Generation for Real-World Zero-Shot Robotic Manipulation Learning with Gaussian Splatting
  2. 2026PhysVGGT: Feed-Forward Dense Physical Property Estimation from A Single Image
  3. 2023Robo360: A 3D Omnispective Multi-Material Robotic Manipulation Dataset
  4. 2026Deform360: A Massive Multi-view Visuotactile Dataset for Deformable World Models
  5. 2026Toward Visually Realistic Simulation: A Benchmark for Evaluating Robot Manipulation in Simulation ↗
  6. 2026Robo3R: Enhancing Robotic Manipulation with Accurate Feed-Forward 3D Reconstruction
  7. 2026PhysCoRe: Physics-Corrected Residual World Models for Material-Aware Deformable Dynamics
  8. 2025Scan, Materialize, Simulate: A Generalizable Framework for Physically Grounded Robot Planning