WorldMirror: Universal 3D World Reconstruction with Any-Prior Prompting
Not on the map. Why?
Abstract (arXiv)
We present WorldMirror, a unified feed-forward model for comprehensive 3D geometric prediction tasks. Unlike existing methods constrained to image-only inputs or customized for a specific task, our framework flexibly integrates diverse geometric priors, including camera poses, intrinsics, and depth maps, while simultaneously generating multiple 3D representations: dense point clouds, multi-view depth maps, camera parameters, surface normals, and 3D Gaussians. Remarkably, prior injection yields universal gains across all tasks, suggesting that input flexibility and multi-task prediction are mutually reinforcing. WorldMirror achieves state-of-the-art performance across diverse benchmarks from camera, point map, depth, and surface normal estimation to novel view synthesis, while maintaining the efficiency of feed-forward inference.
Key facts. Cited by 67 papers in the map (data through 14 Oct 2026). Builds on 65 of its 83 references that are in the map. First posted on arXiv 12 Oct 2025.
Builds on
65 of 83 references.
References · 65
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,117
- 2021Vision Transformers for Dense Predictioncited by 1,803
- 2020pixelNeRF: Neural Radiance Fields from One or Few Imagescited by 1,584
- 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,567
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,539
- 2017Matterport3D: Learning from RGB-D Data in Indoor Environmentscited by 1,376
- 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,360
- 2017Multi-Task Learning Using Uncertainty to Weigh Losses for Scene Geometry and Semanticscited by 1,358
- 2019Habitat: A Platform for Embodied AI Researchcited by 1,191
- 2024Grounding Image Matching in 3D with MASt3Rcited by 983
- 2023ScanNet++: A High-Fidelity Dataset of 3D Indoor Scenescited by 764
38 more
- 2018MegaDepth: Learning Single-View Depth Prediction from Internet Photoscited by 737
- 2023pixelSplat: 3D Gaussian Splats from Image Pairs for Scalable Generalizable 3D Reconstructioncited by 684
- 2023Mip-Splatting: Alias-free 3D Gaussian Splattingcited by 667
- 2021Common Objects in 3D: Large-Scale Learning and Evaluation of Real-life 3D Category Reconstructioncited by 652
- 2018Taskonomy: Disentangling Task Transfer Learningcited by 634
- 2020Hypersim: A Photorealistic Synthetic Dataset for Holistic Indoor Scene Understandingcited by 604
- 2024MVSplat: Efficient 3D Gaussian Splatting from Sparse Multi-View Imagescited by 566
- 2025Continuous 3D Perception Model with Persistent Statecited by 548
- 2023DL3DV-10K: A Large-Scale Scene Dataset for Deep Learning-based 3D Visioncited by 537
- 2023CoTracker: It is Better to Track Togethercited by 522
- 2020TartanAir: A Dataset to Push the Limits of Visual SLAMcited by 506
- 2019BlendedMVS: A Large-scale Dataset for Generalized Multi-view Stereo Networkscited by 490
- 2024CameraCtrl: Enabling Camera Control for Text-to-Video Generationcited by 460
- 2021ARKitScenes: A Diverse Real-World Dataset For 3D Indoor Scene Understanding Using Mobile RGB-D Datacited by 454
- 2024MonST3R: A Simple Approach for Estimating Geometry in the Presence of Motioncited by 442
- 2024UniDepth: Universal Monocular Metric Depth Estimationcited by 382
- 2025Fast3R: Towards 3D Reconstruction of 1000+ Images in One Forward Passcited by 367
- 2021Omnidata: A Scalable Pipeline for Making Multi-Task Mid-Level Vision Datasets from 3D Scanscited by 336
- 2025MapAnything: Universal Feed-Forward Metric 3D Reconstructioncited by 314
- 2021Neural RGB-D Surface Reconstructioncited by 313
- 2024GeoWizard: Unleashing the Diffusion Priors for 3D Geometry Estimation from a Single Imagecited by 286
- 2024DepthSplat: Connecting Gaussian Splatting and Depthcited by 286
- 2024gsplat: An Open-Source Library for Gaussian Splattingcited by 285
- 2018DeepMVS: Learning Multi-view Stereopsiscited by 277
- 2024No Pose, No Problem: Surprisingly Simple 3D Gaussian Splats from Sparse Unposed Imagescited by 248
- 2025AnySplat: Feed-forward 3D Gaussian Splatting from Unconstrained Viewscited by 243
- 2023MatrixCity: A Large-scale City Dataset for City-scale Neural Rendering and Beyondcited by 185
- 2025FLARE: Feed-forward Geometry, Appearance and Camera Estimation from Uncalibrated Sparse Viewscited by 180
- 2024Splatt3R: Zero-shot Gaussian Splatting from Uncalibrated Image Pairscited by 178
- 2023Aria Digital Twin: A New Benchmark Dataset for Egocentric 3D Machine Perceptioncited by 167
- 2023PF-LRM: Pose-Free Large Reconstruction Model for Joint Pose and Shape Predictioncited by 165
- 2024StableNormal: Reducing Diffusion Variance for Stable and Sharp Normalcited by 154
- 2023PoseDiffusion: Solving Pose Estimation via Diffusion-aided Bundle Adjustmentcited by 147
- 2018Evaluation of CNN-based Single-Image Depth Estimation Methodscited by 138
- 2024Rethinking Inductive Biases for Surface Normal Estimationcited by 124
- 2021SMD-Nets: Stereo Mixture Density Networkscited by 120
- 20223D Common Corruptions and Data Augmentationcited by 119
- 2021Estimating and Exploiting the Aleatoric Uncertainty in Surface Normal Estimationcited by 116
50 most cited of 65 All 65 (JSON)
Built on by
Citing papers per year: 2025: 11; 2026: 56.
67 papers.
Sort:
By area:
- 2025WorldPlay: Towards Long-Term Geometric Consistency for Real-Time Interactive World Modelingcited by 170
- 2025Hunyuan-GameCraft-2: Instruction-following Interactive Game World Modelcited by 61
- 2026NeoVerse: Enhancing 4D World Model with in-the-wild Monocular Videoscited by 46
- 2026HY-World 2.0: A Multi-Modal World Model for Reconstructing, Generating, and Simulating 3D Worldscited by 44
- 2026Latent-WAM: Latent World Action Modeling for End-to-End Autonomous Drivingcited by 33
- 2026VerseCrafter: Dynamic Realistic Video World Model with 4D Geometric Controlcited by 28
- 2026WorldCompass: Reinforcement Learning for Long-Horizon World Modelscited by 24
- 2026WorldStereo: Bridging Camera-Guided Video Generation and Scene Reconstruction via 3D Geometric Memoriescited by 18
- 2025EcoSplat: Efficiency-controllable Feed-forward 3D Gaussian Splatting from Multi-view Imagescited by 10
- 2026UCM: Unified Modeling of Camera Control and Memory with Time-aware Positional Encoding Warping for World Modelscited by 9
- 2025Unified Semantic Transformer for 3D Scene Understandingcited by 8
- 2026AnchorSplat: Feed-Forward 3D Gaussian Splatting with 3D Geometric Priorscited by 8
38 more
- 2026WorldClaw: Agentic 3D Open-World Generation at Scalecited by 8
- 2025The World is Your Canvas: Painting Promptable Events with Reference Images, Trajectories, and Textcited by 7
- 2025MVInverse: Feed-forward Multi-view Inverse Rendering in Secondscited by 6
- 2026Feed-Forward 3D Scene Modeling: A Problem-Driven Perspectivecited by 6
- 2026From Rays to Projections: Better Inputs for Feed-Forward View Synthesiscited by 5
- 2025Selfi: Self Improving Reconstruction Engine via 3D Geometric Feature Alignmentcited by 4
- 2026SoMA: A Real-to-Sim Neural Simulator for Robotic Soft-body Manipulationcited by 4
- 2026Large Depth Completion Model from Sparse Observationscited by 4
- 2026OmniX: Any-view and Any-time 4D Reconstruction via Feed-forward Trajectory Fieldscited by 4
- 2025GeoWorld: Providing Full-frame Geometry Features to Facilitate 3D Scene Generationcited by 3
- 2025Self-Evolving 3D Scene Generation from a Single Imagecited by 3
- 2026Efficient Camera-Controlled Video Generation of Static Scenes via Sparse Diffusion and 3D Renderingcited by 3
- 2026Research on World Models Is Not Merely Injecting World Knowledge into Specific Taskscited by 3
- 2026HD-VGGT: High-Resolution Visual Geometry Transformercited by 3
- 2026OpenWorldLib: A Unified Codebase and Definition of Advanced World Modelscited by 3
- 2026Holo-World: Unified Camera, Object and Weather Control for Video World Modelcited by 3
- 2026Real-Time Human Frontal View Synthesis from a Single Imagecited by 2
- 2026SplatWeaver: Learning to Allocate Gaussian Primitives for Generalizable Novel View Synthesiscited by 2
- 2026OnlineWM: Causality-Aware Active Online Learning for Effective World Modelingcited by 2
- 2025CustomX: Unified Character, Action, and Scene Customization in Video World Modelscited by 1
- 2026AirSplat: Alignment and Rating for Robust Feed-Forward 3D Gaussian Splattingcited by 1
- 2026Learn2Splat: Extending the Horizon of Learned 3DGS Optimizationcited by 1
- 2026IVGT: Implicit Visual Geometry Transformer for Neural Scene Representationcited by 1
- 2026SceneAligner: 3D-Grounded Floorplan Localization in the Wildcited by 1
- 2026OF3GS: On-the-Fly Feed-Forward 3D Gaussian Splatting from Unposed Imagescited by 1
- 2026Argus: Metric Panoramic 3D Reconstruction for Indoor Scenescited by 1
- 2026Beyond 2D Matching: A Unified Single-Stage Framework for Geometry-Aware Cross-View Object Geo-Localizationcited by 1
- 2026InvSplat: Inverse Feed-Forward Scene Splattingcited by 1
- 2026ABot-3DWorld 0: A Universal World Model to Explore Any 3D Spacecited by 1
- 2026R2S-EGO: Dual-Proxy Refinement for Sparse-Capture Real-to-Simcited by 1
- 2026GeoFF3D: Coordinate-Anchored Feed-Forward Reconstruction for Large-Scale UAV Mappingcited by 1
- 2026G-ray: Ray-Level Relative Geometric Position Encoding in Multi-View Vision Transformers under Camera Heterogeneitycited by 1
- 2025Quantile Rendering: Efficiently Embedding High-dimensional Feature on 3D Gaussian Splattingcited by 0
- 2026MV-SAM: Multi-view Promptable Segmentation using Pointmap Guidancecited by 0
- 2026SceneExpander: Text-Guided 3D Scene Expansion via Free-Form View Insertioncited by 0
- 2026ConFixGS: Learning to Fix Feedforward 3D Gaussian Splatting with Confidence-Aware Diffusion Priors in Driving Scenescited by 0
- 2026Cross-View Splatter: Feed-Forward View Synthesis with Georeferenced Imagescited by 0
- 2026UniT: Unified Geometry Learning with Group Autoregressive Transformercited by 0
50 most cited of 67 All 67 (JSON)
- 2026InfiniSplat v2: Analyzing and Improving Feed-Forward 3DGS from Any Views14 Oct 2026
- 2026SceneAE: Scene Generation and Reconstruction in Queryable 3D-Anchored Latent Space14 Oct 2026
- 2026Zebra3D: Efficient Hybrid Foundation Models For Scalable 3D Reconstruction8 Oct 2026
- 2026DensiTok: Making Feed-Forward 3D Gaussian Splatting See More Views Than It Is Given6 Oct 2026
- 2026LoCoSplat: Real-Time Feed-Forward 3D Gaussian Splatting with Minimal 3D Reasoning3 Oct 2026
- 2026StereoGaussians: Feed-Forward 3D Gaussian Splatting from Stereo Images29 Sep 2026
- 2026GeoVerse: World-Consistent Novel View Synthesis in Geometric Latent Space28 Sep 2026
- 2026GenNVS: Geometry-enhanced Novel View Synthesis via Disentangled 3D Prior28 Sep 2026
- 2026OnlineWM: Causality-Aware Active Online Learning for Effective World Modeling20 Sep 2026
- 2026PhGS: Post-Hoc Pruning and Refinement of Single-View Feed-Forward 3D Gaussian Reconstructions17 Sep 2026
- 2026G-ray: Ray-Level Relative Geometric Position Encoding in Multi-View Vision Transformers under Camera Heterogeneity14 Sep 2026
- 2026Zero-Shot Novel Depth Synthesis Using 3D Foundation Models Scene Representations3 Sep 2026
38 more
- 2026WorldReward: Reward Modeling for Camera-Conditioned World Models3 Sep 2026
- 2026RoGe: Novel View Synthesis via End-to-End Implicit Reconstruction and Generation2 Sep 2026
- 2026GeoFF3D: Coordinate-Anchored Feed-Forward Reconstruction for Large-Scale UAV Mapping28 Aug 2026
- 2026SplatGuide: Geometric Priors from 3D Gaussians for Pose-Free Novel View Synthesis17 Aug 2026
- 2026Advantage-Guided Gate: Reshaping Open-Ended Reasoning for Vision-Based Spatial Intelligence8 Aug 2026
- 2026FlexSplat: Flexible Feed-Forward 3D Gaussian Splatting without Point Cloud Correspondence8 Aug 2026
- 2026R2S-EGO: Dual-Proxy Refinement for Sparse-Capture Real-to-Sim7 Aug 2026
- 2026WorldClaw: Agentic 3D Open-World Generation at Scale5 Aug 2026
- 2026ABot-3DWorld 0: A Universal World Model to Explore Any 3D Space13 Jul 2026
- 2026OmniX: Any-view and Any-time 4D Reconstruction via Feed-forward Trajectory Fields12 Jul 2026
- 2026Beyond Isolated Objects: Relationship-aware Open Vocabulary Scene Understanding via 3D Scene Graph Analysis6 Jul 2026
- 2026InvSplat: Inverse Feed-Forward Scene Splatting2 Jul 2026
- 2026Beyond 2D Matching: A Unified Single-Stage Framework for Geometry-Aware Cross-View Object Geo-Localization29 Jun 2026
- 2026Argus: Metric Panoramic 3D Reconstruction for Indoor Scenes29 Jun 2026
- 2026Holo-World: Unified Camera, Object and Weather Control for Video World Model18 Jun 2026
- 2026OF3GS: On-the-Fly Feed-Forward 3D Gaussian Splatting from Unposed Images2 Jun 2026
- 2026Large Depth Completion Model from Sparse Observations28 May 2026
- 2026SpatialBench: Is Your Spatial Foundation Model an All-Round Player?26 May 2026
- 2026SceneAligner: 3D-Grounded Floorplan Localization in the Wild21 May 2026
- 2026UniT: Unified Geometry Learning with Group Autoregressive Transformer20 May 2026
- 2026Cross-View Splatter: Feed-Forward View Synthesis with Georeferenced Images19 May 2026
- 2026IVGT: Implicit Visual Geometry Transformer for Neural Scene Representation15 May 2026
- 2026Learn2Splat: Extending the Horizon of Learned 3DGS Optimization15 May 2026
- 2026ConFixGS: Learning to Fix Feedforward 3D Gaussian Splatting with Confidence-Aware Diffusion Priors in Driving Scenes10 May 2026
- 2026SplatWeaver: Learning to Allocate Gaussian Primitives for Generalizable Novel View Synthesis8 May 2026
- 2026HY-World 2.0: A Multi-Modal World Model for Reconstructing, Generating, and Simulating 3D Worlds15 Apr 2026
- 2026Feed-Forward 3D Scene Modeling: A Problem-Driven Perspective15 Apr 2026
- 2026AnchorSplat: Feed-Forward 3D Gaussian Splatting with 3D Geometric Priors8 Apr 2026
- 2026OpenWorldLib: A Unified Codebase and Definition of Advanced World Models6 Apr 2026
- 2026HD-VGGT: High-Resolution Visual Geometry Transformer28 Mar 2026
- 2026SceneExpander: Text-Guided 3D Scene Expansion via Free-Form View Insertion28 Mar 2026
- 2026AirSplat: Alignment and Rating for Robust Feed-Forward 3D Gaussian Splatting26 Mar 2026
- 2026Latent-WAM: Latent World Action Modeling for End-to-End Autonomous Driving25 Mar 2026
- 2026Real-Time Human Frontal View Synthesis from a Single Image16 Mar 2026
- 2026WorldStereo: Bridging Camera-Guided Video Generation and Scene Reconstruction via 3D Geometric Memories2 Mar 2026
- 2026UCM: Unified Modeling of Camera Control and Memory with Time-aware Positional Encoding Warping for World Models26 Feb 2026
- 2026WorldCompass: Reinforcement Learning for Long-Horizon World Models9 Feb 2026
- 2026SoMA: A Real-to-Sim Neural Simulator for Robotic Soft-body Manipulation2 Feb 2026
50 newest of 67 All 67 (JSON)
- 2025WorldPlay: Towards Long-Term Geometric Consistency for Real-Time Interactive World Modelingcited by 170
- 2025Hunyuan-GameCraft-2: Instruction-following Interactive Game World Modelcited by 61
- 2026NeoVerse: Enhancing 4D World Model with in-the-wild Monocular Videoscited by 46
- 2026HY-World 2.0: A Multi-Modal World Model for Reconstructing, Generating, and Simulating 3D Worldscited by 44
- 2026Latent-WAM: Latent World Action Modeling for End-to-End Autonomous Drivingcited by 33
- 2026VerseCrafter: Dynamic Realistic Video World Model with 4D Geometric Controlcited by 28
- 2026WorldCompass: Reinforcement Learning for Long-Horizon World Modelscited by 24
- 2026UCM: Unified Modeling of Camera Control and Memory with Time-aware Positional Encoding Warping for World Modelscited by 9
- 2026OmniX: Any-view and Any-time 4D Reconstruction via Feed-forward Trajectory Fieldscited by 4
- 2026Research on World Models Is Not Merely Injecting World Knowledge into Specific Taskscited by 3
- 2026OpenWorldLib: A Unified Codebase and Definition of Advanced World Modelscited by 3
- 2026Holo-World: Unified Camera, Object and Weather Control for Video World Modelcited by 3
12 most cited of 17 All 17 (JSON)
- 2026SceneAE: Scene Generation and Reconstruction in Queryable 3D-Anchored Latent Space14 Oct 2026
- 2026OnlineWM: Causality-Aware Active Online Learning for Effective World Modeling20 Sep 2026
- 2026WorldReward: Reward Modeling for Camera-Conditioned World Models3 Sep 2026
- 2026ABot-3DWorld 0: A Universal World Model to Explore Any 3D Space13 Jul 2026
- 2026OmniX: Any-view and Any-time 4D Reconstruction via Feed-forward Trajectory Fields12 Jul 2026
- 2026Holo-World: Unified Camera, Object and Weather Control for Video World Model18 Jun 2026
- 2026HY-World 2.0: A Multi-Modal World Model for Reconstructing, Generating, and Simulating 3D Worlds15 Apr 2026
- 2026OpenWorldLib: A Unified Codebase and Definition of Advanced World Models6 Apr 2026
- 2026Latent-WAM: Latent World Action Modeling for End-to-End Autonomous Driving25 Mar 2026
- 2026UCM: Unified Modeling of Camera Control and Memory with Time-aware Positional Encoding Warping for World Models26 Feb 2026
- 2026WorldCompass: Reinforcement Learning for Long-Horizon World Models9 Feb 2026
- 2026Research on World Models Is Not Merely Injecting World Knowledge into Specific Tasks2 Feb 2026
12 newest of 17 All 17 (JSON)
- 2026WorldStereo: Bridging Camera-Guided Video Generation and Scene Reconstruction via 3D Geometric Memoriescited by 18
- 2026Efficient Camera-Controlled Video Generation of Static Scenes via Sparse Diffusion and 3D Renderingcited by 3
- 2026ConFixGS: Learning to Fix Feedforward 3D Gaussian Splatting with Confidence-Aware Diffusion Priors in Driving Scenescited by 0
- 2026ConFixGS: Learning to Fix Feedforward 3D Gaussian Splatting with Confidence-Aware Diffusion Priors in Driving Scenes10 May 2026
- 2026WorldStereo: Bridging Camera-Guided Video Generation and Scene Reconstruction via 3D Geometric Memories2 Mar 2026
- 2026Efficient Camera-Controlled Video Generation of Static Scenes via Sparse Diffusion and 3D Rendering14 Jan 2026
- 2026WorldClaw: Agentic 3D Open-World Generation at Scalecited by 8
- 2026WorldClaw: Agentic 3D Open-World Generation at Scale5 Aug 2026
- 2025EcoSplat: Efficiency-controllable Feed-forward 3D Gaussian Splatting from Multi-view Imagescited by 10
- 2025Unified Semantic Transformer for 3D Scene Understandingcited by 8
- 2026AnchorSplat: Feed-Forward 3D Gaussian Splatting with 3D Geometric Priorscited by 8
- 2025The World is Your Canvas: Painting Promptable Events with Reference Images, Trajectories, and Textcited by 7
- 2025MVInverse: Feed-forward Multi-view Inverse Rendering in Secondscited by 6
- 2026Feed-Forward 3D Scene Modeling: A Problem-Driven Perspectivecited by 6
- 2026From Rays to Projections: Better Inputs for Feed-Forward View Synthesiscited by 5
- 2025Selfi: Self Improving Reconstruction Engine via 3D Geometric Feature Alignmentcited by 4
- 2026SoMA: A Real-to-Sim Neural Simulator for Robotic Soft-body Manipulationcited by 4
- 2026Large Depth Completion Model from Sparse Observationscited by 4
- 2025GeoWorld: Providing Full-frame Geometry Features to Facilitate 3D Scene Generationcited by 3
- 2025Self-Evolving 3D Scene Generation from a Single Imagecited by 3
12 most cited of 44 All 44 (JSON)
- 2026InfiniSplat v2: Analyzing and Improving Feed-Forward 3DGS from Any Views14 Oct 2026
- 2026Zebra3D: Efficient Hybrid Foundation Models For Scalable 3D Reconstruction8 Oct 2026
- 2026DensiTok: Making Feed-Forward 3D Gaussian Splatting See More Views Than It Is Given6 Oct 2026
- 2026LoCoSplat: Real-Time Feed-Forward 3D Gaussian Splatting with Minimal 3D Reasoning3 Oct 2026
- 2026StereoGaussians: Feed-Forward 3D Gaussian Splatting from Stereo Images29 Sep 2026
- 2026GeoVerse: World-Consistent Novel View Synthesis in Geometric Latent Space28 Sep 2026
- 2026GenNVS: Geometry-enhanced Novel View Synthesis via Disentangled 3D Prior28 Sep 2026
- 2026PhGS: Post-Hoc Pruning and Refinement of Single-View Feed-Forward 3D Gaussian Reconstructions17 Sep 2026
- 2026G-ray: Ray-Level Relative Geometric Position Encoding in Multi-View Vision Transformers under Camera Heterogeneity14 Sep 2026
- 2026Zero-Shot Novel Depth Synthesis Using 3D Foundation Models Scene Representations3 Sep 2026
- 2026RoGe: Novel View Synthesis via End-to-End Implicit Reconstruction and Generation2 Sep 2026
- 2026GeoFF3D: Coordinate-Anchored Feed-Forward Reconstruction for Large-Scale UAV Mapping28 Aug 2026
12 newest of 44 All 44 (JSON)