XDen-1K: A Density Field Dataset of Real-World Objects
Not on the map. Why?
Abstract (arXiv)
A deep understanding of the physical world is essential for robotic manipulation and physically realistic simulation. While current methods, including VLM-based and other learning-based approaches, have shown promise in physical property inference, their evaluation is often hindered by the lack of physically grounded reference data. To address this gap, we introduce XDen-1K, the first large-scale multimodal dataset that provides physically grounded density field for real-world objects. XDen-1K comprises 1,000 real-world objects spanning 137 categories, with comprehensive data for each object, including a high-resolution, carefully curated 3D geometric model with part-level annotations and paired real-world biplanar X-ray scans. In addition, XDen-1K includes high-fidelity volumetric density field reconstructed from sparse biplanar X-ray views via a novel optimization framework. XDen-1K also provides a benchmark for density estimation and enables X-ray-conditioned volumetric segmentation. Experiments further demonstrate that the center-of-mass prior derived by XDen-1K can improve robotic manipulation performance. By providing real-world X-ray scans and physics-consistent density field, XDen-1K establishes a foundation for advancing physical property inference and embodied AI.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 52 of its 72 references that are in the map. First posted on arXiv 11 Dec 2025.
Builds on
52 of 72 references.
References · 52
- 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,384
- 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,088
- 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,286
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,475
- 2020Point Transformercited by 1,462
- 20194D Spatio-Temporal ConvNets: Minkowski Convolutional Neural Networkscited by 1,201
- 20173D Semantic Segmentation with Submanifold Sparse Convolutional Networkscited by 746
- 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 742
- 2019CLEVRER: CoLlision Events for Video REpresentation and Reasoningcited by 475
- 2024CLAY: A Controllable Large-scale Generative Model for Creating High-quality 3D Assetscited by 444
- 2023Gaussian Grouping: Segment and Edit Anything in 3D Scenescited by 387
- 2019Point-Voxel CNN for Efficient 3D Deep Learningcited by 343
38 more
- 2022AnyGrasp: Robust and Efficient Grasp Perception in Spatial and Temporal Domainscited by 205
- 2019CvxNet: Learnable Convex Decompositioncited by 173
- 2023Segment Any 3D Gaussianscited by 158
- 2023PAC-NeRF: Physics Augmented Continuum Neural Radiance Fields for Geometry-Agnostic System Identificationcited by 145
- 2019PHYRE: A New Benchmark for Physical Reasoningcited by 137
- 2024GARField: Group Anything with Radiance Fieldscited by 108
- 2025CAST: Component-Aligned 3D Scene Reconstruction from an RGB Imagecited by 101
- 2024SAMPart3D: Segment Any Part in 3D Objectscited by 95
- 2025PARTFIELD: Learning 3D Feature Fields for Part Segmentation and Beyondcited by 91
- 2019X2CT-GAN: Reconstructing CT from Biplanar X-Rays with Generative Adversarial Networkscited by 85
- 2025PhysTwin: Physics-Informed Reconstruction and Simulation of Deformable Objects from Videoscited by 78
- 2023OmniSeg3D: Omniversal 3D Segmentation via Hierarchical Contrastive Learningcited by 75
- 2023Structure-Aware Sparse-View X-ray 3D Reconstructioncited by 70
- 2019DensePhysNet: Learning Dense Physical Object Representations via Multi-step Dynamic Interactionscited by 61
- 2025OmniPart: Part-Aware 3D Generation with Semantic Decoupling and Structural Cohesioncited by 60
- 2023Physion++: Evaluating Physical Scene Understanding that Requires Online Inference of Different Physical Propertiescited by 53
- 2024Point-SAM: Promptable 3D Segmentation Model for Point Cloudscited by 49
- 2024Physical Property Understanding from Language-Embedded Feature Fieldscited by 45
- 2025PhysX-3D: Physical-Grounded 3D Asset Generationcited by 40
- 2025P3-SAM: Native 3D Part Segmentationcited by 39
- 2024Physically Compatible 3D Object Modeling from a Single Imagecited by 38
- 2024Segment Any Meshcited by 37
- 2025BANG: Dividing 3D Assets via Generative Exploded Dynamicscited by 35
- 2025PhysX-Anything: Simulation-Ready Physical 3D Assets from Single Imagecited by 32
- 2022Self-Supervised Coordinate Projection Network for Sparse-View Computed Tomographycited by 31
- 2024Material Anything: Generating Materials for Any 3D Object via Diffusioncited by 31
- 2024Find Any Part in 3Dcited by 30
- 2025Vid2Sim: Realistic and Interactive Simulation from Video for Urban Navigationcited by 30
- 2025PartNeXt: A Next-Generation Dataset for Fine-Grained and Hierarchical 3D Part Understandingcited by 24
- 2024MeshSegmenter: Zero-Shot Mesh Semantic Segmentation via Texture Synthesiscited by 22
- 2025Pixie: Fast and Generalizable Supervised Learning of 3D Physics from Pixelscited by 22
- 2024GaussianProperty: Integrating Physical Properties to 3D Gaussians with LMMscited by 20
- 2025PUGS: Zero-shot Physical Understanding with Gaussian Splattingcited by 20
- 2023Perspective Projection-Based 3D CT Reconstruction from Biplanar X-rayscited by 18
- 2023I-PHYRE: Interactive Physical Reasoningcited by 15
- 2019Scalable and modular material point method for large-scale simulationscited by 9
- 2024DX2CT: Diffusion Model for 3D CT Reconstruction from Bi or Mono-planar 2D X-ray(s)cited by 8
- 2025Inferring Dynamic Physical Properties from Video Foundation Modelscited by 5
50 most cited of 52 All 52 (JSON)
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025High-Fidelity Simulated Data Generation for Real-World Zero-Shot Robotic Manipulation Learning with Gaussian Splatting
- 2026PhysVGGT: Feed-Forward Dense Physical Property Estimation from A Single Image
- 2023Robo360: A 3D Omnispective Multi-Material Robotic Manipulation Dataset
- 2026Deform360: A Massive Multi-view Visuotactile Dataset for Deformable World Models
- 2026Toward Visually Realistic Simulation: A Benchmark for Evaluating Robot Manipulation in Simulation ↗
- 2026Robo3R: Enhancing Robotic Manipulation with Accurate Feed-Forward 3D Reconstruction
- 2026PhysCoRe: Physics-Corrected Residual World Models for Material-Aware Deformable Dynamics
- 2025Scan, Materialize, Simulate: A Generalizable Framework for Physically Grounded Robot Planning