mlsanityData to 14 Oct 2026

Gen3DEval: Using vLLMs for Automatic Evaluation of Generated 3D Objects

arXiv 2504.08125 ↗First posted 10 Apr 2025cs.CVcited by 11

Not on the map. Why?

Abstract (arXiv)

Rapid advancements in text-to-3D generation require robust and scalable evaluation metrics that align closely with human judgment, a need unmet by current metrics such as PSNR and CLIP, which require ground-truth data or focus only on prompt fidelity. To address this, we introduce Gen3DEval, a novel evaluation framework that leverages vision large language models (vLLMs) specifically fine-tuned for 3D object quality assessment. Gen3DEval evaluates text fidelity, appearance, and surface quality by analyzing 3D surface normals, without requiring ground-truth comparisons, bridging the gap between automated metrics and user preferences. Compared to state-of-the-art task-agnostic models, Gen3DEval demonstrates superior performance in user-aligned evaluations, placing it as a comprehensive and accessible benchmark for future research on text-to-3D generation. The project page can be found here: hrefhttps://shalini-maiti.github.io/gen3deval.github.io/https://shalini-maiti.github.io/gen3deval.github.io/.

Key facts. Cited by 11 papers in the map (data through 14 Oct 2026). Builds on 49 of its 63 references that are in the map. First posted on arXiv 10 Apr 2025.

Builds on

49 of 63 references.

References · 49

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  4. 2024The Llama 3 Herd of Modelscited by 14,715
  5. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  6. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  7. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
  8. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
  9. 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,322
  10. 2023Qwen Technical Reportcited by 3,344
  11. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
  12. 2024Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phonecited by 1,917
37 more
  1. 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,540
  2. 2022Magic3D: High-Resolution Text-to-3D Content Creationcited by 1,290
  3. 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,219
  4. 2023ImageReward: Learning and Evaluating Human Preferences for Text-to-Image Generationcited by 1,045
  5. 2023Pick-a-Pic: An Open Dataset of User Preferences for Text-to-Image Generationcited by 977
  6. 2023MVDream: Multi-view Diffusion for 3D Generationcited by 938
  7. 2023LRM: Large Reconstruction Model for Single Image to 3Dcited by 849
  8. 2023DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creationcited by 843
  9. 2023Objaverse-XL: A Universe of 10M+ 3D Objectscited by 774
  10. 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 770
  11. 2024Genie: Generative Interactive Environmentscited by 747
  12. 2019Differentiable Volumetric Rendering: Learning Implicit 3D Representations without 3D Supervisioncited by 700
  13. 2024PaliGemma: A versatile 3B VLM for transfercited by 696
  14. 2023Fantasia3D: Disentangling Geometry and Appearance for High-quality Text-to-3D Content Creationcited by 687
  15. 2023SyncDreamer: Generating Multiview-consistent Images from a Single-view Imagecited by 645
  16. 2022Score Jacobian Chaining: Lifting Pretrained 2D Diffusion Models for 3D Generationcited by 597
  17. 2023Zero123++: a Single Image to Consistent Multi-view Diffusion Base Modelcited by 521
  18. 2022Latent-NeRF for Shape-Guided Generation of 3D Shapes and Texturescited by 506
  19. 2024CAT3D: Create Anything in 3D with Multi-View Diffusion Modelscited by 432
  20. 2023Magic123: One Image to High-Quality 3D Object Generation Using Both 2D and 3D Diffusion Priorscited by 397
  21. 2023One-2-3-45++: Fast Single Image to 3D Objects with Consistent Multi-View Generation and 3D Diffusioncited by 283
  22. 2023ImageDream: Image-Prompt Multi-view Diffusion for 3D Generationcited by 257
  23. 2023GaussianDreamer: Fast Generation from Text to 3D Gaussians by Bridging 2D and 3D Diffusion Modelscited by 255
  24. 2024TripoSR: Fast 3D Object Reconstruction from a Single Imagecited by 232
  25. 2024GPT-4V(ision) is a Human-Aligned Evaluator for Text-to-3D Generationcited by 153
  26. 2020Augmented SBERT: Data Augmentation Method for Improving Bi-Encoders for Pairwise Sentence Scoring Taskscited by 138
  27. 2023HiFA: High-fidelity Text-to-3D Generation with Advanced Diffusion Guidancecited by 110
  28. 2023Text-Guided Texturing by Synchronized Multi-View Diffusioncited by 86
  29. 2024IM-3D: Iterative Multiview Diffusion and Reconstruction for High-Quality 3D Generationcited by 84
  30. 2023DreamTime: An Improved Optimization Strategy for Diffusion-Guided 3D Generationcited by 81
  31. 2024Improving 2D Feature Representations by 3D-Aware Fine-Tuningcited by 71
  32. 2024Meta 3D AssetGen: Text-to-Mesh Generation with High-Quality Geometry, Texture, and PBR Materialscited by 66
  33. 2024ViewDiff: 3D-Consistent Image Generation with Text-to-Image Modelscited by 57
  34. 2024VFusion3D: Learning Scalable 3D Generative Models from Video Diffusion Modelscited by 56
  35. 2024Meta 3D TextureGen: Fast and Consistent Texture Generation for 3D Objectscited by 52
  36. 2023NViST: In the Wild New View Synthesis from a Single Image with Transformerscited by 19
  37. 2024Flex3D: Feed-Forward 3D Generation with Flexible Reconstruction Model and Input View Curationcited by 12

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 2; 2026: 9.

11 papers.

  1. 2025Hi3DEval: Advancing 3D Generation Evaluation with Hierarchical Validitycited by 3
  2. 2025GuideFlow3D: Optimization-Guided Rectified Flow For Appearance Transfercited by 2
  3. 2026DB-3DME: From Dataset to Benchmark for Human-aligned Automatic 3D Mesh Evaluationcited by 2
  4. 2026From Idea to Co-Creation: A Planner-Actor-Critic Framework for Agent Augmented 3D Modelingcited by 1
  5. 2026Search-to-World: Evaluation of 3D World Delivery from User Request through Web Searchcited by 1
  6. 2026Can These Views Be One Scene? Evaluating Multiview 3D Consistency when 3D Foundation Models Hallucinatecited by 0
  7. 2026CompoSE: Compositional Synthesis and Editing of 3D Shapes via Part-Aware Controlcited by 0
  8. 2026To See a World in a Living Context: Unified Indoor-Outdoor Urban World Generationcited by 0
  9. 2026Cyc3D: Evaluating Cyclic Structural Stability and Asset Usability in Image-to-3D Generationcited by 0
  10. 2026FoldingAgent: Inferring Parametric Origami Procedures from Demonstration Videoscited by 0
  11. 2026COMPASS: Membership Inference Attack Against Vision Large Language Models via Adaptive Noise Calibrationcited by 0