mlsanityData to 14 Oct 2026

JanusMesh: Fast and Zero-Shot 3D Visual Illusion Generation via Cross-Space Denoising

arXiv 2606.20563 ↗First posted 18 Jun 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Creating 3D visual illusions, a single 3D mesh that reveals entirely different semantics from various viewing angles, is a fascinating but tough challenge. Existing optimization-based methods are slow and can produce oversaturated colors. In contrast, naive stitching approaches fail to produce geometrically coherent objects. This results in visible unnatural seams and semantic leaks. In this paper, we present a fast and training-free framework for generating text-driven 3D visual illusions. Our approach decouples the generation into two stages. First, we propose a cross-space dual-branch denoising process. This process dynamically decodes 3D latents into voxel space for CLIP-guided orientation alignment and Signed Distance Field (SDF) blending, which ensures seamless geometric fusion. Second, we introduce a view-conditioned texture synthesis module that projects and aggregates view-specific 2D diffusion priors onto the fused geometry. Extensive experiments demonstrate that our method generates highly realistic, dual-semantic 3D illusions in just 3-5 minutes. It significantly outperforms existing methods in geometric integrity, semantic recognizability, and efficiency. Project page: https://siang1105.github.io/JanusMesh.github.io/

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 75 of its 81 references that are in the map. First posted on arXiv 18 Jun 2026.

Builds on

75 of 81 references.

References · 75

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  4. 2020Denoising Diffusion Implicit Modelscited by 9,781
  5. 2022Classifier-Free Diffusion Guidancecited by 5,847
  6. 2022Flow Matching for Generative Modelingcited by 5,702
  7. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
  8. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
  9. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
  10. 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,540
  11. 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,489
  12. 2018Demystifying MMD GANscited by 1,293
38 more
  1. 2022Magic3D: High-Resolution Text-to-3D Content Creationcited by 1,290
  2. 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,219
  3. 2023MVDream: Multi-view Diffusion for 3D Generationcited by 938
  4. 2023LRM: Large Reconstruction Model for Single Image to 3Dcited by 849
  5. 2023DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creationcited by 843
  6. 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 770
  7. 2023Wonder3D: Single Image to 3D using Cross-Domain Diffusioncited by 689
  8. 2023Fantasia3D: Disentangling Geometry and Appearance for High-quality Text-to-3D Content Creationcited by 687
  9. 2023SyncDreamer: Generating Multiview-consistent Images from a Single-view Imagecited by 645
  10. 2022Compositional Visual Generation with Composable Diffusion Modelscited by 624
  11. 2023MultiDiffusion: Fusing Diffusion Paths for Controlled Image Generationcited by 536
  12. 2021Zero-Shot Text-Guided Object Generation with Dream Fieldscited by 513
  13. 2022Latent-NeRF for Shape-Guided Generation of 3D Shapes and Texturescited by 506
  14. 2021Putting NeRF on a Diet: Semantically Consistent Few-Shot View Synthesiscited by 464
  15. 2024InstantMesh: Efficient 3D Mesh Generation from a Single Image with Sparse-view Large Reconstruction Modelscited by 433
  16. 2023Shap-E: Generating Conditional 3D Implicit Functionscited by 385
  17. 2021CLIP-NeRF: Text-and-Image Driven Manipulation of Neural Radiance Fieldscited by 370
  18. 2025Hunyuan3D 2.0: Scaling Diffusion Models for High Resolution Textured 3D Assets Generationcited by 356
  19. 2023Scaling Open-Vocabulary Object Detectioncited by 343
  20. 2021Text2Mesh: Text-Driven Neural Stylization for Meshescited by 334
  21. 2023TEXTure: Text-Guided Texturing of 3D Shapescited by 304
  22. 2023LucidDreamer: Towards High-Fidelity Text-to-3D Generation via Interval Score Matchingcited by 290
  23. 2023GaussianDreamer: Fast Generation from Text to 3D Gaussians by Bridging 2D and 3D Diffusion Modelscited by 255
  24. 2023Text2Tex: Text-driven Texture Synthesis via Diffusion Modelscited by 235
  25. 2023Michelangelo: Conditional 3D Shape Generation based on Shape-Image-Text Aligned Latent Representationcited by 228
  26. 2023Reduce, Reuse, Recycle: Compositional Generation with Energy-Based Diffusion Models and MCMCcited by 220
  27. 2024CRM: Single Image to 3D Textured Mesh with Convolutional Reconstruction Modelcited by 215
  28. 2025TripoSG: High-Fidelity 3D Shape Synthesis using Large-Scale Rectified Flow Modelscited by 213
  29. 2024Direct3D: Scalable Image-to-3D Generation via 3D Latent Diffusion Transformercited by 210
  30. 2023Paint3D: Paint Anything 3D with Lighting-Less Texture Diffusion Modelscited by 123
  31. 2023SyncDiffusion: Coherent Montage via Synchronized Joint Diffusionscited by 110
  32. 2023TexFusion: Synthesizing 3D Textures with Text-Guided Image Diffusion Modelscited by 87
  33. 2023Text-Guided Texturing by Synchronized Multi-View Diffusioncited by 86
  34. 2024FlashTex: Fast Relightable Mesh Texturing with LightControlNetcited by 56
  35. 2024TextureDreamer: Image-guided Texture Synthesis through Geometry-aware Diffusioncited by 52
  36. 2023Visual Anagrams: Generating Multi-View Optical Illusions with Diffusion Modelscited by 46
  37. 2024TEXGen: a Generative Diffusion Model for Mesh Texturescited by 46
  38. 2024Text-to-Image Rectified Flow as Plug-and-Play Priorscited by 38

50 most cited of 75 All 75 (JSON)

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2023Make-It-3D: High-Fidelity 3D Creation from A Single Image with Diffusion Prior
  2. 2024Dual3D: Efficient and Consistent Text-to-3D Generation with Dual-mode Multi-view Latent Diffusion
  3. 2024ViewDiff: 3D-Consistent Image Generation with Text-to-Image Models
  4. 2024Ouroboros3D: Image-to-3D Generation via 3D-aware Recursive Diffusion
  5. 2024Cycle3D: High-quality and Consistent Image-to-3D Generation via Generation-Reconstruction Cycle
  6. 2023Magic123: One Image to High-Quality 3D Object Generation Using Both 2D and 3D Diffusion Priors
  7. 2023One-2-3-45++: Fast Single Image to 3D Objects with Consistent Multi-View Generation and 3D Diffusion
  8. 2025Wonder3D++: Cross-domain Diffusion for High-fidelity 3D Generation from a Single Image