NOVA3R: Non-pixel-aligned Visual Transformer for Amodal 3D Reconstruction
Not on the map. Why?
Abstract (arXiv)
We present NOVA3R, an effective approach for non-pixel-aligned 3D reconstruction from a set of unposed images in a feed-forward manner. Unlike pixel-aligned methods that tie geometry to per-ray predictions, our formulation learns a global, view-agnostic scene representation that decouples reconstruction from pixel alignment. This addresses two key limitations in pixel-aligned 3D: (1) it recovers both visible and invisible points with a complete scene representation, and (2) it produces physically plausible geometry with fewer duplicated structures in overlapping regions. To achieve this, we introduce a scene-token mechanism that aggregates information across unposed images and a diffusion-based 3D decoder that reconstructs complete, non-pixel-aligned point clouds. Extensive experiments on both scene-level and object-level datasets demonstrate that NOVA3R outperforms state-of-the-art methods in terms of reconstruction accuracy and completeness.
Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Builds on 67 of its 72 references that are in the map. First posted on arXiv 4 Mar 2026.
Builds on
67 of 72 references.
References · 67
- 2017Attention Is All You Needcited by 60,361
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2022Flow Matching for Generative Modelingcited by 5,702
- 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,897
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
- 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,567
- 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,540
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,539
- 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,489
- 2024Grounding Image Matching in 3D with MASt3Rcited by 983
- 2016A Point Set Generation Network for 3D Object Reconstruction from a Single Imagecited by 979
38 more
- 2023MVDream: Multi-view Diffusion for 3D Generationcited by 938
- 2023LRM: Large Reconstruction Model for Single Image to 3Dcited by 849
- 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 770
- 2023ScanNet++: A High-Fidelity Dataset of 3D Indoor Scenescited by 764
- 2024LGM: Large Multi-View Gaussian Model for High-Resolution 3D Content Creationcited by 739
- 2023Wonder3D: Single Image to 3D using Cross-Domain Diffusioncited by 689
- 2018Pixel2Mesh: Generating 3D Mesh Models from Single RGB Imagescited by 651
- 2022Google Scanned Objects: A High-Quality Dataset of 3D Scanned Household Itemscited by 612
- 20163D-R2N2: A Unified Approach for Single and Multi-view 3D Object Reconstructioncited by 588
- 2023MotionCtrl: A Unified and Flexible Motion Controller for Video Generationcited by 580
- 2023One-2-3-45: Any Single Image to 3D Mesh in 45 Seconds without Per-Shape Optimizationcited by 560
- 2022LION: Latent Point Diffusion Models for 3D Shape Generationcited by 553
- 2025Continuous 3D Perception Model with Persistent Statecited by 548
- 2014Predicting Depth, Surface Normals and Semantic Labels with a Common Multi-Scale Convolutional Architecturecited by 483
- 20233DShape2VecSet: A 3D Shape Representation for Neural Fields and Generative Diffusion Modelscited by 458
- 2024CLAY: A Controllable Large-scale Generative Model for Creating High-quality 3D Assetscited by 455
- 2021ARKitScenes: A Diverse Real-World Dataset For 3D Indoor Scene Understanding Using Mobile RGB-D Datacited by 454
- 2024CAT3D: Create Anything in 3D with Multi-View Diffusion Modelscited by 432
- 2024Depth Pro: Sharp Monocular Metric Depth in Less Than a Secondcited by 404
- 2024ViewCrafter: Taming Video Diffusion Models for High-fidelity Novel View Synthesiscited by 403
- 2024Metric3Dv2: A Versatile Monocular Geometric Foundation Model for Zero-shot Metric Depth and Surface Normal Estimationcited by 395
- 20203D-FRONT: 3D Furnished Rooms with layOuts and semaNTicscited by 380
- 2023Instant3D: Fast Text-to-3D with Sparse-View Generation and Large Reconstruction Modelcited by 378
- 2025Fast3R: Towards 3D Reconstruction of 1000+ Images in One Forward Passcited by 367
- 2024SV3D: Novel Multi-view Synthesis and 3D Generation from a Single Image using Latent Video Diffusioncited by 364
- 2024GS-LRM: Large Reconstruction Model for 3D Gaussian Splattingcited by 349
- 2023ReconFusion: 3D Reconstruction with Diffusion Priorscited by 318
- 2021Neural RGB-D Surface Reconstructioncited by 313
- 2024MoGe: Unlocking Accurate Monocular Geometry Estimation for Open-Domain Images with Optimal Training Supervisioncited by 299
- 2024TripoSR: Fast 3D Object Reconstruction from a Single Imagecited by 232
- 2023Michelangelo: Conditional 3D Shape Generation based on Shape-Image-Text Aligned Latent Representationcited by 228
- 2025TripoSG: High-Fidelity 3D Shape Synthesis using Large-Scale Rectified Flow Modelscited by 213
- 2024WonderWorld: Interactive 3D Scene Generation from a Single Imagecited by 202
- 2023XCube: Large-Scale 3D Generative Modeling using Sparse Voxel Hierarchiescited by 189
- 2025Stable Virtual Camera: Generative View Synthesis with Diffusion Modelscited by 182
- 2025FLARE: Feed-forward Geometry, Appearance and Camera Estimation from Uncalibrated Sparse Viewscited by 180
- 2024ReconX: Reconstruct Any Scene from Sparse Views with Video Diffusion Modelcited by 143
- 2024MV-DUSt3R+: Single-Stage Scene Reconstruction from Sparse Views In 2 Secondscited by 141
50 most cited of 67 All 67 (JSON)
Built on by
Citing papers per year: 2026: 7.
7 papers.
- 2026Surflo: Consistent 3D Surface Flow Model with Global Statecited by 1
- 2026Artic-O: End-to-End Articulated Object Reconstruction via Latent Geometry Learningcited by 1
- 2026VolFill: Single-View Amodal 3D Scene Reconstruction with Volumetric Flow Matchingcited by 0
- 2026DynaTok: Token-Based 4D Reconstruction from Partial Point Cloudscited by 0
- 2026M3GD: Multi-Modal Multi-View Geometric Diffusion for Camera--LiDAR Novel View Synthesiscited by 0
- 2026Building Rome from a Single Imagecited by 0
- 2026CoTL: Compact Token Learning for 3D Scene Representationcited by 0
- 2026CoTL: Compact Token Learning for 3D Scene Representation13 Oct 2026
- 2026Building Rome from a Single Image6 Oct 2026
- 2026M3GD: Multi-Modal Multi-View Geometric Diffusion for Camera--LiDAR Novel View Synthesis24 Sep 2026
- 2026Artic-O: End-to-End Articulated Object Reconstruction via Latent Geometry Learning20 Jun 2026
- 2026Surflo: Consistent 3D Surface Flow Model with Global State11 Jun 2026
- 2026DynaTok: Token-Based 4D Reconstruction from Partial Point Clouds10 Jun 2026
- 2026VolFill: Single-View Amodal 3D Scene Reconstruction with Volumetric Flow Matching29 May 2026