PixARMesh: Autoregressive Mesh-Native Single-View Scene Reconstruction
Not on the map. Why?
Abstract (arXiv)
We introduce PixARMesh, a method to autoregressively reconstruct complete 3D indoor scene meshes directly from a single RGB image. Unlike prior methods that rely on implicit signed distance fields and post-hoc layout optimization, PixARMesh jointly predicts object layout and geometry within a unified model, producing coherent and artist-ready meshes in a single forward pass. Building on recent advances in mesh generative models, we augment a point-cloud encoder with pixel-aligned image features and global scene context via cross-attention, enabling accurate spatial reasoning from a single image. Scenes are generated autoregressively from a unified token stream containing context, pose, and mesh, yielding compact meshes with high-fidelity geometry. Experiments on synthetic and real-world datasets show that PixARMesh achieves state-of-the-art reconstruction quality while producing lightweight, high-quality meshes ready for downstream applications.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 46 of its 52 references that are in the map. First posted on arXiv 6 Mar 2026.
Builds on
46 of 52 references.
References · 46
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,117
- 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,489
- 2017Matterport3D: Learning from RGB-D Data in Indoor Environmentscited by 1,376
- 2024Grounded SAM: Assembling Open-World Models for Diverse Visual Taskscited by 929
- 2023Vision Transformers Need Registerscited by 871
- 2023LRM: Large Reconstruction Model for Single Image to 3Dcited by 849
- 2018Pixel2Mesh: Generating 3D Mesh Models from Single RGB Imagescited by 651
- 2023One-2-3-45: Any Single Image to 3D Mesh in 45 Seconds without Per-Shape Optimizationcited by 560
- 2018AtlasNet: A Papier-Mach'e Approach to Learning 3D Surface Generationcited by 539
- 2024CLAY: A Controllable Large-scale Generative Model for Creating High-quality 3D Assetscited by 455
- 2024Depth Pro: Sharp Monocular Metric Depth in Less Than a Secondcited by 404
34 more
- 20203D-FRONT: 3D Furnished Rooms with layOuts and semaNTicscited by 380
- 20203D-FUTURE: 3D Furniture shape with TextUREcited by 311
- 2023One-2-3-45++: Fast Single Image to 3D Objects with Consistent Multi-View Generation and 3D Diffusioncited by 283
- 2020PolyGen: An Autoregressive Generative Model of 3D Meshescited by 269
- 2023MeshGPT: Generating Triangle Meshes with Decoder-Only Transformerscited by 259
- 2018Pix3D: Dataset and Methods for Single-Image 3D Shape Modelingcited by 218
- 2019BSP-Net: Generating Compact Meshes via Binary Space Partitioningcited by 206
- 2024MeshAnything: Artist-Created Mesh Generation with Autoregressive Transformerscited by 144
- 2024MIDI: Multi-Instance Diffusion for Single Image to 3D Scene Generationcited by 117
- 2024MeshAnything V2: Artist-Created Mesh Generation With Adjacent Mesh Tokenizationcited by 104
- 2024MeshXL: Neural Coordinate Field for Generative 3D Foundation Modelscited by 103
- 2021Hierarchical Transformers Are More Efficient Language Modelscited by 102
- 2024Meshtron: High-Fidelity, Artist-Like 3D Mesh Generation at Scalecited by 89
- 2024EdgeRunner: Auto-regressive Auto-encoder for Artistic Mesh Generationcited by 87
- 2022Perspective Fields for Single Image Camera Calibrationcited by 75
- 2024Scaling Mesh Generation via Compressive Tokenizationcited by 73
- 2021Panoptic 3D Scene Reconstruction From a Single RGB Imagecited by 70
- 2023PolyDiff: Generating 3D Polygonal Meshes with Diffusion Modelscited by 66
- 2020Mask2CAD: 3D Shape Prediction by Learning to Segment and Retrievecited by 65
- 2025DeepMesh: Auto-Regressive Artist-mesh Creation with Reinforcement Learningcited by 65
- 2024Gen3DSR: Generalizable 3D Scene Reconstruction via Divide and Conquer from a Single Viewcited by 61
- 2018Scan2Mesh: From Unstructured Range Scans to 3D Meshescited by 51
- 2024PivotMesh: Generic 3D Mesh Generation via Pivot Vertices Guidancecited by 50
- 2022Towards High-Fidelity Single-view Holistic Reconstruction of Indoor Scenescited by 44
- 2024Cubify Anything: Scaling Indoor 3D Object Detectioncited by 39
- 2025TreeMeshGPT: Artistic Mesh Generation with Autoregressive Tree Sequencingcited by 39
- 2024Zero-Shot Scene Reconstruction from Single Images with Deep Prior Assemblycited by 35
- 2025DepR: Depth Guided Single-view Scene Reconstruction with Instance-level Diffusioncited by 23
- 2025Mesh-RFT: Enhancing Mesh Generation via Fine-grained Reinforcement Fine-Tuningcited by 22
- 2025LiteReality: Graphics-Ready 3D Scene Reconstruction from RGB-D Scanscited by 21
- 2023BUOL: A Bottom-Up Framework with Occupancy-aware Lifting for Panoptic 3D Scene Reconstruction From A Single Imagecited by 20
- 2025VertexRegen: Mesh Generation with Continuous Level of Detailcited by 16
- 2025ARMesh: Autoregressive Mesh Generation via Next-Level-of-Detail Predictioncited by 11
- 2021Towards Panoptic 3D Parsing for Single Image in the Wildcited by 3
Built on by
Citing papers per year: 2026: 3.
3 papers.
Similar, not cited
Close in wording, no citation either way
- 2026PixWorld: Unifying 3D Scene Generation and Reconstruction in Pixel Space
- 2026FACE: A Face-based Autoregressive Representation for High-Fidelity and Efficient Mesh Generation
- 2025Mesh RAG: Retrieval Augmentation for Autoregressive Mesh Generation
- 2024Coherent 3D Scene Diffusion From a Single RGB Image
- 2025PartDiffuser: Part-wise 3D Mesh Generation via Discrete Diffusion
- 2026ArticuTable: Generating Instance-Level Interactive Rigid-Articulated 3D Tabletop Scenes from a Single Image
- 2026LEGO-Anything: Coding Agents for 3D Scene Reconstruction
- 2026Training-Free Instance-Aware 3D Scene Reconstruction and Diffusion-Based View Synthesis from Sparse Images