mlsanityData to 14 Oct 2026

CRAFT: Designing Creative and Functional 3D Objects

arXiv 2412.03889 ↗First posted 5 Dec 2024cs.CV cs.GRcited by 2

Not on the map. Why?

Abstract (arXiv)

For designing a wide range of everyday objects, the design process should be aware of both the human body and the underlying semantics of the design specification. However, these two objectives present significant challenges to the current AI-based designing tools. In this work, we present a method to synthesize body-aware 3D objects from a base mesh given an input body geometry and either text or image as guidance. The generated objects can be simulated on virtual characters, or fabricated for real-world use. We propose to use a mesh deformation procedure that optimizes for both semantic alignment as well as contact and penetration losses. Using our method, users can generate both virtual or real-world objects from text, image, or sketch, without the need for manual artist intervention. We present both qualitative and quantitative results on various object categories, demonstrating the effectiveness of our approach.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 43 of its 62 references that are in the map. First posted on arXiv 5 Dec 2024.

Builds on

43 of 62 references.

References · 43

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  3. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
  4. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
  5. 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,489
  6. 2022Magic3D: High-Resolution Text-to-3D Content Creationcited by 1,290
  7. 2022Point-E: A System for Generating 3D Point Clouds from Complex Promptscited by 699
  8. 2023Fantasia3D: Disentangling Geometry and Appearance for High-quality Text-to-3D Content Creationcited by 687
  9. 2023SyncDreamer: Generating Multiview-consistent Images from a Single-view Imagecited by 645
  10. 2022Score Jacobian Chaining: Lifting Pretrained 2D Diffusion Models for 3D Generationcited by 597
  11. 2021Zero-Shot Text-Guided Object Generation with Dream Fieldscited by 513
  12. 2022GET3D: A Generative Model of High Quality 3D Textured Shapes Learned from Imagescited by 446
31 more
  1. 2020Modular Primitives for High-Performance Differentiable Renderingcited by 441
  2. 2023Magic123: One Image to High-Quality 3D Object Generation Using Both 2D and 3D Diffusion Priorscited by 397
  3. 2023Shap-E: Generating Conditional 3D Implicit Functionscited by 385
  4. 2021Text2Mesh: Text-Driven Neural Stylization for Meshescited by 334
  5. 2023TEXTure: Text-Guided Texturing of 3D Shapescited by 304
  6. 2022CLIP-Mesh: Generating textured meshes from text using pretrained image-text modelscited by 281
  7. 2023Text2Tex: Text-driven Texture Synthesis via Diffusion Modelscited by 235
  8. 2023MeshDiffusion: Score-based Generative 3D Mesh Modelingcited by 199
  9. 2018Text2Shape: Generating Shapes from Natural Language by Learning Joint Embeddingscited by 169
  10. 2023TextMesh: Generation of Realistic 3D Meshes From Text Promptscited by 135
  11. 2023Paint3D: Paint Anything 3D with Lighting-Less Texture Diffusion Modelscited by 123
  12. 2023HiFA: High-fidelity Text-to-3D Generation with Advanced Diffusion Guidancecited by 110
  13. 2019Neural Cages for Detail-Preserving 3D Deformationscited by 106
  14. 2023Art and the science of generative AI: A deeper divecited by 95
  15. 2023TextDeformer: Geometry Manipulation using Text Guidancecited by 94
  16. 2022MIME: Human-Aware 3D Scene Generationcited by 57
  17. 2018Learning a Shared Shape Space for Multimodal Garment Designcited by 52
  18. 2024TextureDreamer: Image-guided Texture Synthesis through Geometry-aware Diffusioncited by 52
  19. 2023How Can Large Language Models Help Humans in Design and Manufacturing?cited by 41
  20. 2023DiffAvatar: Simulation-Ready Garment Optimization with Differentiable Simulationcited by 41
  21. 20233D Paintbrush: Local Stylization of 3D Shapes with Cascaded Score Distillationcited by 35
  22. 2022Neural Jacobian Fields: Learning Intrinsic Mappings of Arbitrary Meshescited by 28
  23. 2024Garment3DGen: 3D Garment Stylization and Texture Generationcited by 26
  24. 2019Unsupervised cycle-consistent deformation for shape matchingcited by 23
  25. 2023Scene Synthesis from Human Motioncited by 20
  26. 2023VIVE3D: Viewpoint-Independent Video Editing using 3D-Aware GANscited by 16
  27. 2024Geometry Transfer for Stylizing Radiance Fieldscited by 16
  28. 2023Language-driven Scene Synthesis using Multi-conditional Diffusion Modelcited by 10
  29. 2019Is That a Chair? Imagining Affordances Using Simulations of an Articulated Human Bodycited by 6
  30. 2020Pose to Seat: Automated Design of Body-Supporting Surfacescited by 5
  31. 2021Learning Body-Aware 3D Shape Generative Modelscited by 5

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.

  1. 2026Deep Sketch-Based 3D Modeling: A Surveycited by 3
  2. 2026MeshOn: Intersection-Free Mesh-to-Mesh Compositioncited by 0