mlsanityData to 14 Oct 2026

PixARMesh: Autoregressive Mesh-Native Single-View Scene Reconstruction

arXiv 2603.05888 ↗First posted 6 Mar 2026cs.CV cs.GR cs.LGcited by 3

Not on the map. Why?

Abstract (arXiv)

We introduce PixARMesh, a method to autoregressively reconstruct complete 3D indoor scene meshes directly from a single RGB image. Unlike prior methods that rely on implicit signed distance fields and post-hoc layout optimization, PixARMesh jointly predicts object layout and geometry within a unified model, producing coherent and artist-ready meshes in a single forward pass. Building on recent advances in mesh generative models, we augment a point-cloud encoder with pixel-aligned image features and global scene context via cross-attention, enabling accurate spatial reasoning from a single image. Scenes are generated autoregressively from a unified token stream containing context, pose, and mesh, yielding compact meshes with high-fidelity geometry. Experiments on synthetic and real-world datasets show that PixARMesh achieves state-of-the-art reconstruction quality while producing lightweight, high-quality meshes ready for downstream applications.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 46 of its 52 references that are in the map. First posted on arXiv 6 Mar 2026.

Builds on

46 of 52 references.

References · 46

  1. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  2. 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,117
  3. 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,489
  4. 2017Matterport3D: Learning from RGB-D Data in Indoor Environmentscited by 1,376
  5. 2024Grounded SAM: Assembling Open-World Models for Diverse Visual Taskscited by 929
  6. 2023Vision Transformers Need Registerscited by 871
  7. 2023LRM: Large Reconstruction Model for Single Image to 3Dcited by 849
  8. 2018Pixel2Mesh: Generating 3D Mesh Models from Single RGB Imagescited by 651
  9. 2023One-2-3-45: Any Single Image to 3D Mesh in 45 Seconds without Per-Shape Optimizationcited by 560
  10. 2018AtlasNet: A Papier-Mach'e Approach to Learning 3D Surface Generationcited by 539
  11. 2024CLAY: A Controllable Large-scale Generative Model for Creating High-quality 3D Assetscited by 455
  12. 2024Depth Pro: Sharp Monocular Metric Depth in Less Than a Secondcited by 404
34 more
  1. 20203D-FRONT: 3D Furnished Rooms with layOuts and semaNTicscited by 380
  2. 20203D-FUTURE: 3D Furniture shape with TextUREcited by 311
  3. 2023One-2-3-45++: Fast Single Image to 3D Objects with Consistent Multi-View Generation and 3D Diffusioncited by 283
  4. 2020PolyGen: An Autoregressive Generative Model of 3D Meshescited by 269
  5. 2023MeshGPT: Generating Triangle Meshes with Decoder-Only Transformerscited by 259
  6. 2018Pix3D: Dataset and Methods for Single-Image 3D Shape Modelingcited by 218
  7. 2019BSP-Net: Generating Compact Meshes via Binary Space Partitioningcited by 206
  8. 2024MeshAnything: Artist-Created Mesh Generation with Autoregressive Transformerscited by 144
  9. 2024MIDI: Multi-Instance Diffusion for Single Image to 3D Scene Generationcited by 117
  10. 2024MeshAnything V2: Artist-Created Mesh Generation With Adjacent Mesh Tokenizationcited by 104
  11. 2024MeshXL: Neural Coordinate Field for Generative 3D Foundation Modelscited by 103
  12. 2021Hierarchical Transformers Are More Efficient Language Modelscited by 102
  13. 2024Meshtron: High-Fidelity, Artist-Like 3D Mesh Generation at Scalecited by 89
  14. 2024EdgeRunner: Auto-regressive Auto-encoder for Artistic Mesh Generationcited by 87
  15. 2022Perspective Fields for Single Image Camera Calibrationcited by 75
  16. 2024Scaling Mesh Generation via Compressive Tokenizationcited by 73
  17. 2021Panoptic 3D Scene Reconstruction From a Single RGB Imagecited by 70
  18. 2023PolyDiff: Generating 3D Polygonal Meshes with Diffusion Modelscited by 66
  19. 2020Mask2CAD: 3D Shape Prediction by Learning to Segment and Retrievecited by 65
  20. 2025DeepMesh: Auto-Regressive Artist-mesh Creation with Reinforcement Learningcited by 65
  21. 2024Gen3DSR: Generalizable 3D Scene Reconstruction via Divide and Conquer from a Single Viewcited by 61
  22. 2018Scan2Mesh: From Unstructured Range Scans to 3D Meshescited by 51
  23. 2024PivotMesh: Generic 3D Mesh Generation via Pivot Vertices Guidancecited by 50
  24. 2022Towards High-Fidelity Single-view Holistic Reconstruction of Indoor Scenescited by 44
  25. 2024Cubify Anything: Scaling Indoor 3D Object Detectioncited by 39
  26. 2025TreeMeshGPT: Artistic Mesh Generation with Autoregressive Tree Sequencingcited by 39
  27. 2024Zero-Shot Scene Reconstruction from Single Images with Deep Prior Assemblycited by 35
  28. 2025DepR: Depth Guided Single-view Scene Reconstruction with Instance-level Diffusioncited by 23
  29. 2025Mesh-RFT: Enhancing Mesh Generation via Fine-grained Reinforcement Fine-Tuningcited by 22
  30. 2025LiteReality: Graphics-Ready 3D Scene Reconstruction from RGB-D Scanscited by 21
  31. 2023BUOL: A Bottom-Up Framework with Occupancy-aware Lifting for Panoptic 3D Scene Reconstruction From A Single Imagecited by 20
  32. 2025VertexRegen: Mesh Generation with Continuous Level of Detailcited by 16
  33. 2025ARMesh: Autoregressive Mesh Generation via Next-Level-of-Detail Predictioncited by 11
  34. 2021Towards Panoptic 3D Parsing for Single Image in the Wildcited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026PixWorld: Unifying 3D Scene Generation and Reconstruction in Pixel Space
  2. 2026FACE: A Face-based Autoregressive Representation for High-Fidelity and Efficient Mesh Generation
  3. 2025Mesh RAG: Retrieval Augmentation for Autoregressive Mesh Generation
  4. 2024Coherent 3D Scene Diffusion From a Single RGB Image
  5. 2025PartDiffuser: Part-wise 3D Mesh Generation via Discrete Diffusion
  6. 2026ArticuTable: Generating Instance-Level Interactive Rigid-Articulated 3D Tabletop Scenes from a Single Image
  7. 2026LEGO-Anything: Coding Agents for 3D Scene Reconstruction
  8. 2026Training-Free Instance-Aware 3D Scene Reconstruction and Diffusion-Based View Synthesis from Sparse Images