Multiresolution Textual Inversion
Not on the map. Why?
Abstract (arXiv)
We extend Textual Inversion to learn pseudo-words that represent a concept at different resolutions. This allows us to generate images that use the concept with different levels of detail and also to manipulate different resolutions using language. Once learned, the user can generate images at different levels of agreement to the original concept; "A photo of S^*(0)" produces the exact object while the prompt "A photo of S^*(0.8)" only matches the rough outlines and colors. Our framework allows us to generate images that use different resolutions of an image (e.g. details, textures, styles) as separate pseudo-words that can be composed in various ways. We open-soure our code in the following URL: https://github.com/giannisdaras/multirestextualinversion
Key facts. Cited by 33 papers in the map (data through 7 Oct 2026). Builds on 13 of its 15 references that are in the map. First posted on arXiv 30 Nov 2022.
Builds on
13 of 15 references.
References · 13
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
- 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,286
- 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,231
- 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,903
- 2022Cold Diffusion: Inverting Arbitrary Image Transforms Without Noisecited by 275
- 2022Soft Diffusion: Score Matching for General Corruptionscited by 101
- 2021Intermediate Layer Optimization for Inverse Problems using Deep Generative Modelscited by 70
- 2022Score-Guided Intermediate Layer Optimization: Fast Langevin Mixing for Inverse Problemscited by 11
1 more
- 2021Generator Surgery for Compressed Sensingcited by 5
Built on by
Citing papers per year: 2023: 17; 2024: 12; 2025: 3; 2026: 1.
33 papers.
Sort:
By area:
- 2023Key-Locked Rank One Editing for Text-to-Image Personalizationcited by 194
- 2023Zero-Shot Composed Image Retrieval with Textual Inversioncited by 171
- 2023LaDI-VTON: Latent Diffusion Textual-Inversion Enhanced Virtual Try-Oncited by 151
- 2023DDP: Diffusion Model for Dense Visual Predictioncited by 148
- 2023Localizing Object-level Shape Variations with Text-to-Image Diffusion Modelscited by 142
- 2023Understanding the Latent Space of Diffusion Models through the Lens of Riemannian Geometrycited by 121
- 2023Improving Tuning-Free Real Image Editing with Proximal Guidancecited by 87
- 2023Consistent Diffusion Models: Mitigating Sampling Drift by Learning to be Consistentcited by 58
- 2023Personalization as a Shortcut for Few-Shot Backdoor Attack against Text-to-Image Diffusion Modelscited by 42
- 2024RealCustom: Narrowing Real Text Word for Real-Time Open-Domain Text-to-Image Customizationcited by 39
- 2024Customizing Text-to-Image Models with a Single Image Paircited by 36
- 2023ReFACT: Updating Text-to-Image Models by Editing the Text Encodercited by 32
21 more
- 2023Unsupervised Discovery of Semantic Latent Directions in Diffusion Modelscited by 28
- 2023Gradient-Free Textual Inversioncited by 28
- 2024ColorPeel: Color Prompt Learning with Diffusion Models via Color and Shape Disentanglementcited by 28
- 2023Diff-Privacy: Diffusion-based Face Privacy Protectioncited by 25
- 2024iSEARLE: Improving Textual Inversion for Zero-Shot Composed Image Retrievalcited by 24
- 2023IMPUS: Image Morphing with Perceptually-Uniform Sampling Using Diffusion Modelscited by 20
- 2024Learning Discrete Concepts in Latent Hierarchical Modelscited by 17
- 2024RealCustom++: Representing Images as Real Textual Word for Real-Time Customizationcited by 16
- 2023AdjointDPM: Adjoint Sensitivity Method for Gradient Backpropagation of Diffusion Probabilistic Modelscited by 11
- 2024InstructBrush: Learning Attention-based Instruction Optimization for Image Editingcited by 10
- 2024LEAD: Latent Realignment for Human Motion Diffusioncited by 9
- 2024Multimodal-Conditioned Latent Diffusion Models for Fashion Image Editingcited by 5
- 2024HypDAE: Hyperbolic Diffusion Autoencoders for Hierarchical Few-shot Image Generationcited by 3
- 2023Resolution Chromatography of Diffusion Modelscited by 2
- 2024Assessing Open-world Forgetting in Generative Image Model Customizationcited by 2
- 2025Exploring Structured Semantic Priors Underlying Diffusion Score for Test-time Adaptationcited by 2
- 2025Diffusion-Based Action Recognition Generalizes to Untrained Domainscited by 2
- 2025Efficient Personalization of Quantized Diffusion Model without Backpropagationcited by 1
- 2026Steering Away from Memorization: Reachability-Constrained Reinforcement Learning for Text-to-Image Diffusioncited by 1
- 2023Textual and Visual Prompt Fusion for Image Editing via Step-Wise Alignmentcited by 0
- 2024Opt-In Art: Learning Art Styles Only from Few Examplescited by 0
- 2026Steering Away from Memorization: Reachability-Constrained Reinforcement Learning for Text-to-Image Diffusion24 Feb 2026
- 2025Diffusion-Based Action Recognition Generalizes to Untrained Domains10 Sep 2025
- 2025Efficient Personalization of Quantized Diffusion Model without Backpropagation19 Mar 2025
- 2025Exploring Structured Semantic Priors Underlying Diffusion Score for Test-time Adaptation1 Jan 2025
- 2024Opt-In Art: Learning Art Styles Only from Few Examples29 Nov 2024
- 2024HypDAE: Hyperbolic Diffusion Autoencoders for Hierarchical Few-shot Image Generation27 Nov 2024
- 2024LEAD: Latent Realignment for Human Motion Diffusion18 Oct 2024
- 2024Assessing Open-world Forgetting in Generative Image Model Customization18 Oct 2024
- 2024RealCustom++: Representing Images as Real Textual Word for Real-Time Customization19 Aug 2024
- 2024ColorPeel: Color Prompt Learning with Diffusion Models via Color and Shape Disentanglement9 Jul 2024
- 2024Learning Discrete Concepts in Latent Hierarchical Models1 Jun 2024
- 2024iSEARLE: Improving Textual Inversion for Zero-Shot Composed Image Retrieval5 May 2024
21 more
- 2024Customizing Text-to-Image Models with a Single Image Pair2 May 2024
- 2024InstructBrush: Learning Attention-based Instruction Optimization for Image Editing27 Mar 2024
- 2024Multimodal-Conditioned Latent Diffusion Models for Fashion Image Editing21 Mar 2024
- 2024RealCustom: Narrowing Real Text Word for Real-Time Open-Domain Text-to-Image Customization1 Mar 2024
- 2023Resolution Chromatography of Diffusion Models7 Dec 2023
- 2023IMPUS: Image Morphing with Perceptually-Uniform Sampling Using Diffusion Models12 Nov 2023
- 2023Diff-Privacy: Diffusion-based Face Privacy Protection11 Sep 2023
- 2023Textual and Visual Prompt Fusion for Image Editing via Step-Wise Alignment30 Aug 2023
- 2023Understanding the Latent Space of Diffusion Models through the Lens of Riemannian Geometry24 Jul 2023
- 2023AdjointDPM: Adjoint Sensitivity Method for Gradient Backpropagation of Diffusion Probabilistic Models20 Jul 2023
- 2023Improving Tuning-Free Real Image Editing with Proximal Guidance8 Jun 2023
- 2023ReFACT: Updating Text-to-Image Models by Editing the Text Encoder1 Jun 2023
- 2023LaDI-VTON: Latent Diffusion Textual-Inversion Enhanced Virtual Try-On22 May 2023
- 2023Personalization as a Shortcut for Few-Shot Backdoor Attack against Text-to-Image Diffusion Models18 May 2023
- 2023Key-Locked Rank One Editing for Text-to-Image Personalization2 May 2023
- 2023Gradient-Free Textual Inversion12 Apr 2023
- 2023DDP: Diffusion Model for Dense Visual Prediction30 Mar 2023
- 2023Zero-Shot Composed Image Retrieval with Textual Inversion27 Mar 2023
- 2023Localizing Object-level Shape Variations with Text-to-Image Diffusion Models20 Mar 2023
- 2023Unsupervised Discovery of Semantic Latent Directions in Diffusion Models24 Feb 2023
- 2023Consistent Diffusion Models: Mitigating Sampling Drift by Learning to be Consistent17 Feb 2023
- 2023LaDI-VTON: Latent Diffusion Textual-Inversion Enhanced Virtual Try-Oncited by 151
- 2023DDP: Diffusion Model for Dense Visual Predictioncited by 148
- 2023Localizing Object-level Shape Variations with Text-to-Image Diffusion Modelscited by 142
- 2023Understanding the Latent Space of Diffusion Models through the Lens of Riemannian Geometrycited by 121
- 2023Improving Tuning-Free Real Image Editing with Proximal Guidancecited by 87
- 2023Consistent Diffusion Models: Mitigating Sampling Drift by Learning to be Consistentcited by 58
- 2023Personalization as a Shortcut for Few-Shot Backdoor Attack against Text-to-Image Diffusion Modelscited by 42
- 2023Unsupervised Discovery of Semantic Latent Directions in Diffusion Modelscited by 28
- 2024ColorPeel: Color Prompt Learning with Diffusion Models via Color and Shape Disentanglementcited by 28
- 2023IMPUS: Image Morphing with Perceptually-Uniform Sampling Using Diffusion Modelscited by 20
- 2023AdjointDPM: Adjoint Sensitivity Method for Gradient Backpropagation of Diffusion Probabilistic Modelscited by 11
- 2024LEAD: Latent Realignment for Human Motion Diffusioncited by 9
12 most cited of 19 All 19 (JSON)
- 2026Steering Away from Memorization: Reachability-Constrained Reinforcement Learning for Text-to-Image Diffusion24 Feb 2026
- 2025Efficient Personalization of Quantized Diffusion Model without Backpropagation19 Mar 2025
- 2025Exploring Structured Semantic Priors Underlying Diffusion Score for Test-time Adaptation1 Jan 2025
- 2024LEAD: Latent Realignment for Human Motion Diffusion18 Oct 2024
- 2024Assessing Open-world Forgetting in Generative Image Model Customization18 Oct 2024
- 2024ColorPeel: Color Prompt Learning with Diffusion Models via Color and Shape Disentanglement9 Jul 2024
- 2024Multimodal-Conditioned Latent Diffusion Models for Fashion Image Editing21 Mar 2024
- 2023Resolution Chromatography of Diffusion Models7 Dec 2023
- 2023IMPUS: Image Morphing with Perceptually-Uniform Sampling Using Diffusion Models12 Nov 2023
- 2023Textual and Visual Prompt Fusion for Image Editing via Step-Wise Alignment30 Aug 2023
- 2023Understanding the Latent Space of Diffusion Models through the Lens of Riemannian Geometry24 Jul 2023
- 2023AdjointDPM: Adjoint Sensitivity Method for Gradient Backpropagation of Diffusion Probabilistic Models20 Jul 2023
12 newest of 19 All 19 (JSON)
- 2023Key-Locked Rank One Editing for Text-to-Image Personalizationcited by 194
- 2023Zero-Shot Composed Image Retrieval with Textual Inversioncited by 171
- 2024RealCustom: Narrowing Real Text Word for Real-Time Open-Domain Text-to-Image Customizationcited by 39
- 2024Customizing Text-to-Image Models with a Single Image Paircited by 36
- 2023ReFACT: Updating Text-to-Image Models by Editing the Text Encodercited by 32
- 2023Gradient-Free Textual Inversioncited by 28
- 2023Diff-Privacy: Diffusion-based Face Privacy Protectioncited by 25
- 2024iSEARLE: Improving Textual Inversion for Zero-Shot Composed Image Retrievalcited by 24
- 2024Learning Discrete Concepts in Latent Hierarchical Modelscited by 17
- 2024RealCustom++: Representing Images as Real Textual Word for Real-Time Customizationcited by 16
- 2024InstructBrush: Learning Attention-based Instruction Optimization for Image Editingcited by 10
- 2024HypDAE: Hyperbolic Diffusion Autoencoders for Hierarchical Few-shot Image Generationcited by 3
12 most cited of 14 All 14 (JSON)
- 2025Diffusion-Based Action Recognition Generalizes to Untrained Domains10 Sep 2025
- 2024Opt-In Art: Learning Art Styles Only from Few Examples29 Nov 2024
- 2024HypDAE: Hyperbolic Diffusion Autoencoders for Hierarchical Few-shot Image Generation27 Nov 2024
- 2024RealCustom++: Representing Images as Real Textual Word for Real-Time Customization19 Aug 2024
- 2024Learning Discrete Concepts in Latent Hierarchical Models1 Jun 2024
- 2024iSEARLE: Improving Textual Inversion for Zero-Shot Composed Image Retrieval5 May 2024
- 2024Customizing Text-to-Image Models with a Single Image Pair2 May 2024
- 2024InstructBrush: Learning Attention-based Instruction Optimization for Image Editing27 Mar 2024
- 2024RealCustom: Narrowing Real Text Word for Real-Time Open-Domain Text-to-Image Customization1 Mar 2024
- 2023Diff-Privacy: Diffusion-based Face Privacy Protection11 Sep 2023
- 2023ReFACT: Updating Text-to-Image Models by Editing the Text Encoder1 Jun 2023
- 2023Key-Locked Rank One Editing for Text-to-Image Personalization2 May 2023
12 newest of 14 All 14 (JSON)