JanusMesh: Fast and Zero-Shot 3D Visual Illusion Generation via Cross-Space Denoising
Not on the map. Why?
Abstract (arXiv)
Creating 3D visual illusions, a single 3D mesh that reveals entirely different semantics from various viewing angles, is a fascinating but tough challenge. Existing optimization-based methods are slow and can produce oversaturated colors. In contrast, naive stitching approaches fail to produce geometrically coherent objects. This results in visible unnatural seams and semantic leaks. In this paper, we present a fast and training-free framework for generating text-driven 3D visual illusions. Our approach decouples the generation into two stages. First, we propose a cross-space dual-branch denoising process. This process dynamically decodes 3D latents into voxel space for CLIP-guided orientation alignment and Signed Distance Field (SDF) blending, which ensures seamless geometric fusion. Second, we introduce a view-conditioned texture synthesis module that projects and aggregates view-specific 2D diffusion priors onto the fused geometry. Extensive experiments demonstrate that our method generates highly realistic, dual-semantic 3D illusions in just 3-5 minutes. It significantly outperforms existing methods in geometric integrity, semantic recognizability, and efficiency. Project page: https://siang1105.github.io/JanusMesh.github.io/
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 75 of its 81 references that are in the map. First posted on arXiv 18 Jun 2026.
Builds on
75 of 81 references.
References · 75
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 2022Classifier-Free Diffusion Guidancecited by 5,847
- 2022Flow Matching for Generative Modelingcited by 5,702
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
- 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
- 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,540
- 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,489
- 2018Demystifying MMD GANscited by 1,293
38 more
- 2022Magic3D: High-Resolution Text-to-3D Content Creationcited by 1,290
- 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,219
- 2023MVDream: Multi-view Diffusion for 3D Generationcited by 938
- 2023LRM: Large Reconstruction Model for Single Image to 3Dcited by 849
- 2023DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creationcited by 843
- 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 770
- 2023Wonder3D: Single Image to 3D using Cross-Domain Diffusioncited by 689
- 2023Fantasia3D: Disentangling Geometry and Appearance for High-quality Text-to-3D Content Creationcited by 687
- 2023SyncDreamer: Generating Multiview-consistent Images from a Single-view Imagecited by 645
- 2022Compositional Visual Generation with Composable Diffusion Modelscited by 624
- 2023MultiDiffusion: Fusing Diffusion Paths for Controlled Image Generationcited by 536
- 2021Zero-Shot Text-Guided Object Generation with Dream Fieldscited by 513
- 2022Latent-NeRF for Shape-Guided Generation of 3D Shapes and Texturescited by 506
- 2021Putting NeRF on a Diet: Semantically Consistent Few-Shot View Synthesiscited by 464
- 2024InstantMesh: Efficient 3D Mesh Generation from a Single Image with Sparse-view Large Reconstruction Modelscited by 433
- 2023Shap-E: Generating Conditional 3D Implicit Functionscited by 385
- 2021CLIP-NeRF: Text-and-Image Driven Manipulation of Neural Radiance Fieldscited by 370
- 2025Hunyuan3D 2.0: Scaling Diffusion Models for High Resolution Textured 3D Assets Generationcited by 356
- 2023Scaling Open-Vocabulary Object Detectioncited by 343
- 2021Text2Mesh: Text-Driven Neural Stylization for Meshescited by 334
- 2023TEXTure: Text-Guided Texturing of 3D Shapescited by 304
- 2023LucidDreamer: Towards High-Fidelity Text-to-3D Generation via Interval Score Matchingcited by 290
- 2023GaussianDreamer: Fast Generation from Text to 3D Gaussians by Bridging 2D and 3D Diffusion Modelscited by 255
- 2023Text2Tex: Text-driven Texture Synthesis via Diffusion Modelscited by 235
- 2023Michelangelo: Conditional 3D Shape Generation based on Shape-Image-Text Aligned Latent Representationcited by 228
- 2023Reduce, Reuse, Recycle: Compositional Generation with Energy-Based Diffusion Models and MCMCcited by 220
- 2024CRM: Single Image to 3D Textured Mesh with Convolutional Reconstruction Modelcited by 215
- 2025TripoSG: High-Fidelity 3D Shape Synthesis using Large-Scale Rectified Flow Modelscited by 213
- 2024Direct3D: Scalable Image-to-3D Generation via 3D Latent Diffusion Transformercited by 210
- 2023Paint3D: Paint Anything 3D with Lighting-Less Texture Diffusion Modelscited by 123
- 2023SyncDiffusion: Coherent Montage via Synchronized Joint Diffusionscited by 110
- 2023TexFusion: Synthesizing 3D Textures with Text-Guided Image Diffusion Modelscited by 87
- 2023Text-Guided Texturing by Synchronized Multi-View Diffusioncited by 86
- 2024FlashTex: Fast Relightable Mesh Texturing with LightControlNetcited by 56
- 2024TextureDreamer: Image-guided Texture Synthesis through Geometry-aware Diffusioncited by 52
- 2023Visual Anagrams: Generating Multi-View Optical Illusions with Diffusion Modelscited by 46
- 2024TEXGen: a Generative Diffusion Model for Mesh Texturescited by 46
- 2024Text-to-Image Rectified Flow as Plug-and-Play Priorscited by 38
50 most cited of 75 All 75 (JSON)
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2023Make-It-3D: High-Fidelity 3D Creation from A Single Image with Diffusion Prior
- 2024Dual3D: Efficient and Consistent Text-to-3D Generation with Dual-mode Multi-view Latent Diffusion
- 2024ViewDiff: 3D-Consistent Image Generation with Text-to-Image Models
- 2024Ouroboros3D: Image-to-3D Generation via 3D-aware Recursive Diffusion
- 2024Cycle3D: High-quality and Consistent Image-to-3D Generation via Generation-Reconstruction Cycle
- 2023Magic123: One Image to High-Quality 3D Object Generation Using Both 2D and 3D Diffusion Priors
- 2023One-2-3-45++: Fast Single Image to 3D Objects with Consistent Multi-View Generation and 3D Diffusion
- 2025Wonder3D++: Cross-domain Diffusion for High-fidelity 3D Generation from a Single Image