mlsanityData to 7 Oct 2026

Infinite Photorealistic Worlds using Procedural Generation

arXiv 2306.09310 ↗First posted 15 Jun 2023cs.CVcited by 142

Not on the map. Why?

Abstract (arXiv)

We introduce Infinigen, a procedural generator of photorealistic 3D scenes of the natural world. Infinigen is entirely procedural: every asset, from shape to texture, is generated from scratch via randomized mathematical rules, using no external source and allowing infinite variation and composition. Infinigen offers broad coverage of objects and scenes in the natural world including plants, animals, terrains, and natural phenomena such as fire, cloud, rain, and snow. Infinigen can be used to generate unlimited, diverse training data for a wide range of computer vision tasks including object detection, semantic segmentation, optical flow, and 3D reconstruction. We expect Infinigen to be a useful resource for computer vision research and beyond. Please visit https://infinigen.org for videos, code and pre-generated data.

Key facts. Cited by 142 papers in the map (data through 7 Oct 2026). Builds on 58 of its 120 references that are in the map. First posted on arXiv 15 Jun 2023.

Builds on

58 of 120 references.

References · 58

  1. 2014Microsoft COCO: Common Objects in Contextcited by 17,498
  2. 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,880
  3. 2017CARLA: An Open Urban Driving Simulatorcited by 2,431
  4. 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,385
  5. 2017The Kinetics Human Action Video Datasetcited by 1,894
  6. 2019The Replica Dataset: A Digital Replica of Indoor Spacescited by 885
  7. 2015A Large Dataset to Train Convolutional Networks for Disparity, Optical Flow, and Scene Flow Estimationcited by 878
  8. 2017AI2-THOR: An Interactive 3D Environment for Visual AIcited by 850
  9. 2016Playing for Data: Ground Truth from Computer Gamescited by 816
  10. 2021DROID-SLAM: Deep Visual SLAM for Monocular, Stereo, and RGB-D Camerascited by 673
  11. 2019RLBench: The Robot Learning Benchmark & Learning Environmentcited by 669
  12. 2022Google Scanned Objects: A High-Quality Dataset of 3D Scanned Household Itemscited by 601
38 more
  1. 2020Hypersim: A Photorealistic Synthetic Dataset for Holistic Indoor Scene Understandingcited by 593
  2. 2020SAPIEN: A SimulAted Part-based Interactive ENvironmentcited by 584
  3. 2021Habitat 2.0: Training Home Assistants to Rearrange their Habitatcited by 501
  4. 2020TartanAir: A Dataset to Push the Limits of Visual SLAMcited by 494
  5. 2016Semantic Scene Completion from a Single Depth Imagecited by 468
  6. 2019Learning joint reconstruction of hands and manipulated objectscited by 377
  7. 20203D-FRONT: 3D Furnished Rooms with layOuts and semaNTicscited by 375
  8. 2022Kubric: A scalable dataset generatorcited by 373
  9. 2022ProcTHOR: Large-Scale Embodied AI Using Procedural Generationcited by 369
  10. 2021RAFT-Stereo: Multilevel Recurrent Field Transforms for Stereo Matchingcited by 348
  11. 20203D-FUTURE: 3D Furniture shape with TextUREcited by 306
  12. 2019Structured3D: A Large Photo-realistic Dataset for Structured 3D Modelingcited by 285
  13. 2018DeepMVS: Learning Multi-view Stereopsiscited by 277
  14. 2021Fake It Till You Make It: Face analysis in the wild using synthetic data alonecited by 200
  15. 2022Practical Stereo Matching via Cascaded Recurrent Network with Adaptive Correlationcited by 197
  16. 2020BOP Challenge 2020 on 6D Object Localizationcited by 192
  17. 2021iGibson 2.0: Object-Centric Simulation for Robot Learning of Everyday Household Taskscited by 191
  18. 2022Deep Patch Visual Odometrycited by 186
  19. 2023Spring: A High-Resolution High-Detail Dataset and Benchmark for Scene Flow, Optical Flow and Stereocited by 170
  20. 2021BEHAVIOR: Benchmark for Everyday Household Activities in Virtual, Interactive, and Ecological Environmentscited by 161
  21. 2018Scan2CAD: Learning CAD Model Alignment in RGB-D Scanscited by 142
  22. 2019Hierarchical Deep Stereo Matching on High-resolution Imagescited by 126
  23. 20214DComplete: Non-Rigid Motion Estimation Beyond the Observable Surfacecited by 123
  24. 2020RAFT-3D: Scene Flow using Rigid-Motion Embeddingscited by 121
  25. 2019Synthetic Data for Deep Learningcited by 113
  26. 2020TartanVO: A Generalizable Learning-based VOcited by 107
  27. 2018Synscapes: A Photorealistic Synthetic Dataset for Street Scene Parsingcited by 105
  28. 2019Neural Inverse Rendering of an Indoor Scene from a Single Imagecited by 101
  29. 2021SurfEmb: Dense and Continuous Correspondence Distributions for Object Pose Estimation with Learnt Surface Embeddingscited by 95
  30. 2018Falling Things: A Synthetic Dataset for 3D Object Detection and Pose Estimationcited by 92
  31. 2018InteriorNet: Mega-scale Multi-sensor Photo-realistic Indoor Scenes Datasetcited by 87
  32. 2018CGIntrinsics: Better Intrinsic Image Decomposition through Physically-Based Renderingcited by 85
  33. 2020OpenRooms: An End-to-End Open Framework for Photorealistic Indoor Scene Datasetscited by 73
  34. 2021MOTSynth: How Can Synthetic Data Help Pedestrian Detection and Tracking?cited by 68
  35. 2022Deep Equilibrium Optical Flow Estimationcited by 63
  36. 2020Meta-Sim2: Unsupervised Learning of Scene Structure for Synthetic Data Generationcited by 58
  37. 2022Multiview Stereo with Cascaded Epipolar RAFTcited by 51
  38. 2022Coupled Iterative Refinement for 6D Multi-Object Pose Estimationcited by 48

50 most cited of 58 All 58 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 10; 2024: 32; 2025: 45; 2026: 55.

142 papers.

Sort:

By area:

  1. 2025Fast3R: Towards 3D Reconstruction of 1000+ Images in One Forward Passcited by 356
  2. 2023XCube: Large-Scale 3D Generative Modeling using Sparse Voxel Hierarchiescited by 183
  3. 2024SEA-RAFT: Simple, Efficient, Accurate RAFT for Optical Flowcited by 169
  4. 2024CAT4D: Create Anything in 4D with Multi-View Video Diffusion Modelscited by 160
  5. 2024Infinigen Indoors: Photorealistic Indoor Scenes using Procedural Generationcited by 129
  6. 2024SceneCraft: An LLM Agent for Synthesizing 3D Scene as Blender Codecited by 125
  7. 2024Generative Camera Dolly: Extreme Monocular Dynamic Novel View Synthesiscited by 116
  8. 2024URDFormer: A Pipeline for Constructing Articulated Simulation Environments from Real-World Imagescited by 106
  9. 20233D-GPT: Procedural 3D Modeling with Large Language Modelscited by 91
  10. 2025HunyuanWorld 1.0: Generating Immersive, Explorable, and Interactive 3D Worlds from Words or Pixelscited by 91
  11. 2025Pow3R: Empowering Unconstrained 3D Reconstruction with Camera and Scene Priorscited by 69
  12. 2023GPT4Motion: Scripting Physical Motions in Text-to-Video Generation via Blender-Oriented GPT Planningcited by 61
38 more
  1. 2024MatSynth: A Modern PBR Materials Datasetcited by 42
  2. 2023MatFuse: Controllable Material Generation with Diffusion Modelscited by 39
  3. 2025AerialMegaDepth: Learning Aerial-Ground Reconstruction and View Synthesiscited by 39
  4. 2023Template Free Reconstruction of Human-object Interaction with Procedural Interaction Generationcited by 37
  5. 2025Trace Anything: Representing Any Video in 4D via Trajectory Fieldscited by 31
  6. 20243D-SceneDreamer: Text-Driven 3D-Consistent Scene Generationcited by 29
  7. 2024EgoGen: An Egocentric Synthetic Data Generatorcited by 27
  8. 2024AutoVFX: Physically Realistic Video Editing from Natural Language Instructionscited by 27
  9. 2025BlenderGym: Benchmarking Foundational Model Systems for Graphics Editingcited by 27
  10. 2025ArtiScene: Language-Driven Artistic 3D Scene Generation Through Image Intermediarycited by 27
  11. 2024Make-A-Shape: a Ten-Million-scale 3D Shape Modelcited by 25
  12. 2026Articraft: An Agentic System for Scalable Articulated 3D Asset Generationcited by 25
  13. 2024From an Image to a Scene: Learning to Imagine the World from a Million 360 Videoscited by 23
  14. 2024Sketch2Scene: Automatic Generation of Interactive 3D Game Scenes from User's Casual Sketchescited by 21
  15. 2024MegaSynth: Scaling Up 3D Scene Reconstruction with Synthesized Datacited by 21
  16. 2025WorldCraft: Photo-Realistic 3D World Creation and Customization via LLM Agentscited by 21
  17. 2024BlenderAlchemy: Editing 3D Graphics with Vision-Language Modelscited by 18
  18. 2025WorldGen: From Text to Traversable and Interactive 3D Worldscited by 18
  19. 2024Concept-Based Explanations in Computer Vision: Where Are We and Where Could We Go?cited by 17
  20. 2025Infinite Mobility: Scalable High-Fidelity Synthesis of Articulated Objects via Procedural Generationcited by 17
  21. 2024Kubrick: Multimodal Agent Collaborations for Synthetic Video Generationcited by 16
  22. 2025Compositional Generative Model of Unbounded 4D Citiescited by 16
  23. 2025Ouroboros: Single-step Diffusion Models for Cycle-consistent Forward and Inverse Renderingcited by 16
  24. 2025EgoNight: Towards Egocentric Vision Understanding at Night with a Challenging Benchmarkcited by 16
  25. 2025SPATIALGEN: Layout-guided 3D Indoor Scene Generationcited by 14
  26. 2025WorldGrow: Generating Infinite 3D Worldcited by 14
  27. 2026SimWorld Studio: Automatic Environment Generation with Evolving Coding Agent for Embodied Agent Learningcited by 13
  28. 2026AnyView: Synthesizing Any Novel View in Dynamic Scenescited by 12
  29. 2026Code2Worlds: Empowering Coding LLMs for 4D World Generationcited by 12
  30. 2024LayeredFlow: A Real-World Benchmark for Non-Lambertian Multi-Layer Optical Flowcited by 11
  31. 2024Match Stereo Videos via Bidirectional Alignmentcited by 11
  32. 2024Wavelet Latent Diffusion (Wala): Billion-Parameter 3D Generative Model with Compact Wavelet Encodingscited by 10
  33. 2025VLMaterial: Procedural Material Generation with Large Vision-Language Modelscited by 9
  34. 2025RoomCraft: Controllable and Complete 3D Indoor Scene Generationcited by 9
  35. 20263DCodeBench: Benchmarking Agentic Procedural 3D Modeling Via Codecited by 9
  36. 2025Scaling Sequence-to-Sequence Generative Neural Renderingcited by 8
  37. 2024Generating Diverse Agricultural Data for Vision-Based Farming Applicationscited by 7
  38. 2024Reconstructing Animals and the Wildcited by 7

50 most cited of 142 All 142 (JSON)