CoRe3D: Collaborative Reasoning as a Foundation for 3D Intelligence
On the map: Multimodal LLMs / vision-language models → Embodied and 3D vision-language models
Abstract (arXiv)
Recent advances in large multimodal models suggest that explicit reasoning mechanisms play a critical role in improving model reliability, interpretability, and cross-modal alignment. While such reasoning-centric approaches have been proven effective in language and vision tasks, their extension to 3D remains underdeveloped. CoRe3D introduces a unified 3D understanding and generation reasoning framework that jointly operates over semantic and spatial abstractions, enabling high-level intent inferred from language to directly guide low-level 3D content formation. Central to this design is a spatially grounded reasoning representation that decomposes 3D latent space into localized regions, allowing the model to reason over geometry in a compositional and procedural manner. By tightly coupling semantic chain-of-thought inference with structured spatial reasoning, CoRe3D produces 3D outputs that exhibit strong local consistency and faithful alignment with linguistic descriptions.
Key facts. Cited by 10 papers in the map (data through 14 Oct 2026). Placed in Embodied and 3D vision-language models, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 90 of its 112 references that are in the map. First posted on arXiv 14 Dec 2025.
Builds on
90 of 112 references.
Closest ancestors · 6
Same direction, newest first
- 2025ShapeLLM-Omni: A Native Multimodal LLM for 3D Generation and Understanding2 Jun
- 2025R1-VL: Learning to Reason with Multimodal Large Language Models via Step-wise Group Relative Policy Optimization17 Mar
- 2025Vision-R1: Incentivizing Reasoning Capability in Multimodal Large Language Models9 Mar
- 2024ShapeLLM: Universal 3D Object Understanding for Embodied Interaction27 Feb
- 2023LL3DA: Visual Interactive Instruction Tuning for Omni-3D Understanding, Reasoning, and Planning30 Nov
- 2023ShapeGPT: 3D Shape Generation with A Unified Multi-modal Language Model29 Nov
Other references · 84
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2024Qwen2.5 Technical Reportcited by 4,942
- 2017Neural Discrete Representation Learningcited by 4,712
- 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,386
- 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
- 2019PIQA: Reasoning about Physical Commonsense in Natural Languagecited by 2,883
- 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,565
- 2021SimCSE: Simple Contrastive Learning of Sentence Embeddingscited by 2,173
38 more
- 2023MMBench: Is Your Multi-modal Model an All-around Player?cited by 2,141
- 2024LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Codecited by 2,004
- 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,489
- 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,219
- 2023ImageReward: Learning and Evaluating Human Preferences for Text-to-Image Generationcited by 1,045
- 2023MVDream: Multi-view Diffusion for 3D Generationcited by 938
- 2024Chameleon: Mixed-Modal Early-Fusion Foundation Modelscited by 927
- 2023Human Preference Score v2: A Solid Benchmark for Evaluating Human Preferences of Text-to-Image Synthesiscited by 890
- 2023DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creationcited by 843
- 2024Emu3: Next-Token Prediction is All You Needcited by 781
- 2023Objaverse-XL: A Universe of 10M+ 3D Objectscited by 774
- 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 770
- 2024Show-o: One Single Transformer to Unify Multimodal Understanding and Generationcited by 752
- 2023Wonder3D: Single Image to 3D using Cross-Domain Diffusioncited by 689
- 2023Fantasia3D: Disentangling Geometry and Appearance for High-quality Text-to-3D Content Creationcited by 687
- 2023SyncDreamer: Generating Multiview-consistent Images from a Single-view Imagecited by 645
- 2022Score Jacobian Chaining: Lifting Pretrained 2D Diffusion Models for 3D Generationcited by 597
- 2023Point Transformer V3: Simpler, Faster, Strongercited by 589
- 2023One-2-3-45: Any Single Image to 3D Mesh in 45 Seconds without Per-Shape Optimizationcited by 560
- 2023Zero123++: a Single Image to Consistent Multi-view Diffusion Base Modelcited by 521
- 2024Transfusion: Predict the Next Token and Diffuse Images with One Multi-Modal Modelcited by 483
- 2024CLAY: A Controllable Large-scale Generative Model for Creating High-quality 3D Assetscited by 455
- 2025R1-Onevision: Advancing Generalized Multimodal Reasoning through Cross-Modal Formalizationcited by 370
- 2023An Embodied Generalist Agent in 3D Worldcited by 365
- 2024SV3D: Novel Multi-view Synthesis and 3D Generation from a Single Image using Latent Video Diffusioncited by 364
- 2016OctNet: Learning Deep 3D Representations at High Resolutionscited by 342
- 2023PointLLM: Empowering Large Language Models to Understand Point Cloudscited by 333
- 2022Rodin: A Generative Model for Sculpting 3D Digital Avatars Using Diffusioncited by 309
- 2023Text-to-3D using Gaussian Splattingcited by 299
- 2022ULIP: Learning a Unified Representation of Language, Images, and Point Clouds for 3D Understandingcited by 267
- 2023MeshGPT: Generating Triangle Meshes with Decoder-Only Transformerscited by 259
- 2023ImageDream: Image-Prompt Multi-view Diffusion for 3D Generationcited by 257
- 2023GaussianDreamer: Fast Generation from Text to 3D Gaussians by Bridging 2D and 3D Diffusion Modelscited by 255
- 2023DreamBooth3D: Subject-Driven Text-to-3D Generationcited by 235
- 2023Michelangelo: Conditional 3D Shape Generation based on Shape-Image-Text Aligned Latent Representationcited by 228
- 2024Direct3D: Scalable Image-to-3D Generation via 3D Latent Diffusion Transformercited by 210
- 20233D-VisTA: Pre-trained Transformer for 3D Vision and Text Alignmentcited by 204
- 2023ULIP-2: Towards Scalable Multimodal Pre-training for 3D Understandingcited by 202
50 most cited of 84 All 84 (JSON)
Built on by
Citing papers per year: 2026: 10.
10 papers.
- 2026PALM: Progress-Aware Policy Learning via Affordance Reasoning for Long-Horizon Robotic Manipulationcited by 21
- 2026EgoForge: Goal-Directed Egocentric World Simulatorcited by 12
- 2026Edit in 2D, Verify in 3D: Reinforcement Learning for Multi-view Consistent Scene Editingcited by 4
- 2026When Images Look Right and Retrieve Wrong: Coverage-Guided Cross-Scale Re-Indexing for Knowledge-Faithful Generative Perceptioncited by 3
- 2026DreamPartGen: Semantically Grounded Part-Level 3D Generation via Collaborative Latent Denoisingcited by 2
- 2026Self-Evaluation Is Already There: Eliciting Latent Judge Calibration in Base LLMs with Minimal Datacited by 2
- 2026ELSA3D: Elastic Semantic Anchoring for Unified 3D Understanding and Generationcited by 2
- 2026AutoCRAT: Within-trajectory Joint Control of Stochasticity and Compute for LLM Reasoningcited by 2
- 2026When LLM Meets Tree Search: A Systematic View of Inference as Search in Large Language Modelscited by 0
- 2026SILSA: Sliding-Window Slice Latents for Topology-Preserving High-Resolution 3D Generationcited by 0
- 2026SILSA: Sliding-Window Slice Latents for Topology-Preserving High-Resolution 3D Generation1 Oct 2026
- 2026When LLM Meets Tree Search: A Systematic View of Inference as Search in Large Language Models31 Aug 2026
- 2026AutoCRAT: Within-trajectory Joint Control of Stochasticity and Compute for LLM Reasoning30 Aug 2026
- 2026When Images Look Right and Retrieve Wrong: Coverage-Guided Cross-Scale Re-Indexing for Knowledge-Faithful Generative Perception21 Aug 2026
- 2026ELSA3D: Elastic Semantic Anchoring for Unified 3D Understanding and Generation7 Jul 2026
- 2026Self-Evaluation Is Already There: Eliciting Latent Judge Calibration in Base LLMs with Minimal Data3 Jun 2026
- 2026EgoForge: Goal-Directed Egocentric World Simulator20 Mar 2026
- 2026DreamPartGen: Semantically Grounded Part-Level 3D Generation via Collaborative Latent Denoising19 Mar 2026
- 2026Edit in 2D, Verify in 3D: Reinforcement Learning for Multi-view Consistent Scene Editing3 Mar 2026
- 2026PALM: Progress-Aware Policy Learning via Affordance Reasoning for Long-Horizon Robotic Manipulation11 Jan 2026
Similar, not cited
Close in wording, no citation either way
- 2026Flame3D: Zero-shot Compositional Reasoning of 3D Scenes with Agentic Language Models
- 2025Think with 3D: Geometric Imagination Grounded Spatial Reasoning from Limited Views
- 2026GeoAnchor: Collaborative Reasoning via Latent Decomposition for 3D Spatial Understanding
- 2025SURPRISE3D: A Dataset for Spatial Understanding and Reasoning in Complex 3D Scenes
- 2026GraFT: A Training-Free Framework for Spatial Reasoning in Multimodal Large Language Models via 3D Scene Graphs
- 2026Imagine3D-LLM: Teaching MLLMs to Imagine 3D Scenes Before Answering
- 2026Disentangling 3D Modeling from Spatial Reasoning
- 2026Thinking in Structures: Evaluating Spatial Intelligence in Constraint-Governed Spaces