VTON 360: High-Fidelity Virtual Try-On from Any Viewing Direction
Not on the map. Why?
Abstract (arXiv)
Virtual Try-On (VTON) is a transformative technology in e-commerce and fashion design, enabling realistic digital visualization of clothing on individuals. In this work, we propose VTON 360, a novel 3D VTON method that addresses the open challenge of achieving high-fidelity VTON that supports any-view rendering. Specifically, we leverage the equivalence between a 3D model and its rendered multi-view 2D images, and reformulate 3D VTON as an extension of 2D VTON that ensures 3D consistent results across multiple views. To achieve this, we extend 2D VTON models to include multi-view garments and clothing-agnostic human body images as input, and propose several novel techniques to enhance them, including: i) a pseudo-3D pose representation using normal maps derived from the SMPL-X 3D human model, ii) a multi-view spatial attention mechanism that models the correlations between features from different viewing angles, and iii) a multi-view CLIP embedding that enhances the garment CLIP features used in 2D VTON with camera information. Extensive experiments on large-scale real datasets and clothing images from e-commerce platforms demonstrate the effectiveness of our approach. Project page: https://scnuhealthy.github.io/VTON360.
Key facts. Cited by 10 papers in the map (data through 14 Oct 2026). Builds on 52 of its 64 references that are in the map. First posted on arXiv 15 Mar 2025.
Builds on
52 of 64 references.
References · 52
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
- 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,101
- 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,300
- 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
38 more
- 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,612
- 2022Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generationcited by 961
- 2023Animate Anyone: Consistent and Controllable Image-to-Video Synthesis for Character Animationcited by 688
- 2018DensePose: Dense Human Pose Estimation In The Wildcited by 575
- 2023Instruct-NeRF2NeRF: Editing 3D Scenes with Instructionscited by 484
- 2023GaussianEditor: Swift and Controllable 3D Editing with Gaussian Splattingcited by 335
- 2023ControlVideo: Training-free Controllable Text-to-Video Generationcited by 327
- 2021VITON-HD: High-Resolution Virtual Try-On via Misalignment-Aware Normalizationcited by 287
- 2017VITON: An Image-based Virtual Try-on Networkcited by 286
- 2021Function4D: Real-time Human Volumetric Capture from Very Sparse Consumer RGBD Sensorscited by 246
- 2019Multi-Garment Net: Learning to Dress 3D People from Imagescited by 245
- 2023StableVITON: Learning Semantic Correspondence with Latent Diffusion Model for Virtual Try-Oncited by 175
- 2023GaussianEditor: Editing 3D Gaussians Delicately with Text Instructionscited by 168
- 2024CamCo: Camera-Controllable 3D-Consistent Image-to-Video Generationcited by 166
- 2023DreamEditor: Text-Driven 3D Scene Editing with Neural Fieldscited by 155
- 2023LaDI-VTON: Latent Diffusion Textual-Inversion Enhanced Virtual Try-Oncited by 152
- 2024OOTDiffusion: Outfitting Fusion based Latent Diffusion for Controllable Virtual Try-oncited by 151
- 2020Controllable Person Image Synthesis with Attribute-Decomposed GANcited by 150
- 2021Parser-Free Virtual Try-on via Distilling Appearance Flowscited by 143
- 2023TryOnDiffusion: A Tale of Two UNetscited by 141
- 2022High-Resolution Virtual Try-On with Misalignment and Occlusion-Handled Conditionscited by 130
- 2023Taming the Power of Diffusion Models for High-Quality Virtual Try-On with Appearance Flowcited by 124
- 2024GaussCtrl: Multi-View Consistent Text-Driven 3D Gaussian Splatting Editingcited by 115
- 2018DeepWrinkles: Accurate and Realistic Clothing Modelingcited by 90
- 2022Style-Based Global Appearance Flow for Virtual Try-Oncited by 88
- 2023DreamWaltz: Make a Scene with Complex 3D Animatable Avatarscited by 82
- 2021Self-Supervised Collision Handling via Generative 3D Garment Models for Virtual Try-Oncited by 81
- 2024TIP-Editor: An Accurate 3D Editor Following Both Text-Prompts And Image-Promptscited by 77
- 2022Single Stage Virtual Try-on via Deformable Attention Flowscited by 65
- 2021PISE: Person Image Synthesis and Editing with Decoupled GANcited by 62
- 2020Learning to Transfer Texture from Clothing Images to 3D Humanscited by 58
- 2022Neural Texture Extraction and Distribution for Controllable Person Image Synthesiscited by 55
- 2023MVHumanNet: A Large-scale Dataset of Multi-view Daily Dressing Human Capturescited by 54
- 2021M3D-VTON: A Monocular-to-3D Virtual Try-On Networkcited by 31
- 2024MV-VTON: Multi-View Virtual Try-On with Diffusion Modelscited by 25
- 2024GaussianVTON: 3D Human Virtual Try-ON via Multi-Stage Gaussian Splatting Editing with Image Promptingcited by 22
- 2024WildVidFit: Video Virtual Try-On in the Wild via Image-Based Controlled Diffusion Modelscited by 22
- 2022Dressing in the Wild by Watching Dance Videoscited by 20
50 most cited of 52 All 52 (JSON)
Built on by
Citing papers per year: 2025: 5; 2026: 5.
10 papers.
- 2025Why LVLMs Are More Prone to Hallucinations in Longer Responses: The Role of Contextcited by 10
- 2025Voost: A Unified and Scalable Diffusion Transformer for Bidirectional Virtual Try-On and Try-Offcited by 8
- 2025SMPL-GPTexture: Dual-View 3D Human Texture Estimation using Text-to-Image Generation Modelscited by 2
- 2026Mobile-VTON: High-Fidelity On-Device Virtual Try-Oncited by 2
- 2026DAMA: Disentangled Body-Anchored Gaussians for Controllable Multi-Layered Avatarscited by 2
- 2025Real-Time Per-Garment Virtual Try-On with Temporal Consistency for Loose-Fitting Garmentscited by 1
- 2025One Model for All: Unified Try-On and Try-Off in Any Pose via LLM-Inspired Bidirectional Tweedie Diffusioncited by 1
- 2026LayerGS: Decomposition and Inpainting of Layered 3D Human Avatars via 2D Gaussian Splattingcited by 1
- 2026SceneExpander: Text-Guided 3D Scene Expansion via Free-Form View Insertioncited by 0
- 2026AvatarMix: Identity-Preserving Cross-Avatar Composition for Outfit Personalizationcited by 0
- 2026AvatarMix: Identity-Preserving Cross-Avatar Composition for Outfit Personalization2 Jun 2026
- 2026DAMA: Disentangled Body-Anchored Gaussians for Controllable Multi-Layered Avatars20 May 2026
- 2026SceneExpander: Text-Guided 3D Scene Expansion via Free-Form View Insertion28 Mar 2026
- 2026Mobile-VTON: High-Fidelity On-Device Virtual Try-On1 Mar 2026
- 2026LayerGS: Decomposition and Inpainting of Layered 3D Human Avatars via 2D Gaussian Splatting9 Jan 2026
- 2025Why LVLMs Are More Prone to Hallucinations in Longer Responses: The Role of Context23 Oct 2025
- 2025Voost: A Unified and Scalable Diffusion Transformer for Bidirectional Virtual Try-On and Try-Off6 Aug 2025
- 2025One Model for All: Unified Try-On and Try-Off in Any Pose via LLM-Inspired Bidirectional Tweedie Diffusion6 Aug 2025
- 2025Real-Time Per-Garment Virtual Try-On with Temporal Consistency for Loose-Fitting Garments14 Jun 2025
- 2025SMPL-GPTexture: Dual-View 3D Human Texture Estimation using Text-to-Image Generation Models17 Apr 2025