Encoder-Decoder Manifold Alignment for Idempotent Generation
Not on the map. Why?
Abstract (arXiv)
Recently, several learning paradigms have been introduced to enforce idempotency in generative models. The goal is to ensure that repeated application of a model leaves samples unchanged once they lie on the target data manifold. In practice, however, many of these approaches fail to achieve exact fixed points, leading to instability and drift under repeated application. In this work, we argue that a key reason for this failure is a geometric mismatch between the manifolds learned by the encoder and decoder. The encoder projects inputs onto one latent manifold, while the decoder implicitly learns to reconstruct data from a different manifold. This discrepancy prevents the model from learning truly idempotent mappings. To address this issue, we propose a new training framework that explicitly closes this gap by forcing the encoder and decoder to learn consistent representations of the same underlying data manifold. By aligning the geometry of these components, our method encourages stable projections. Empirically, we show that our approach achieves significantly lower idempotency error and consistently regenerates identical outputs under repeated application, compared to existing methods. We demonstrate the effectiveness of the proposed framework on both image generation and image editing tasks. Finally, we show that enforcing idempotency in this manner improves identity preservation and information stability, leading to more realistic and controllable generative editing models.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 39 of its 56 references that are in the map. First posted on arXiv 21 Jun 2026.
Builds on
39 of 56 references.
References · 39
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
- 2022Flow Matching for Generative Modelingcited by 5,426
- 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,712
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
- 2020Exploring Simple Siamese Representation Learningcited by 2,853
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
- 2022Video Diffusion Modelscited by 2,280
27 more
- 2015Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networkscited by 2,048
- 2019Generating Diverse High-Fidelity Images with VQ-VAE-2cited by 1,376
- 2022Imagic: Text-Based Real Image Editing with Diffusion Modelscited by 1,172
- 2016InfoGAN: Interpretable Representation Learning by Information Maximizing Generative Adversarial Netscited by 858
- 2023MagicBrush: A Manually Annotated Dataset for Instruction-Guided Image Editingcited by 615
- 2020StyleFlow: Attribute-conditioned Exploration of StyleGAN-Generated Images using Conditional Continuous Normalizing Flowscited by 348
- 2018Understanding disentangling in β-VAEcited by 332
- 2020StyleSpace Analysis: Disentangled Controls for StyleGAN Image Generationcited by 331
- 2017Cross-Age LFW: A Database for Studying Cross-Age Face Recognition in Unconstrained Environmentscited by 258
- 2023NaturalSpeech 2: Latent Diffusion Models are Natural and Zero-Shot Speech and Singing Synthesizerscited by 233
- 2024Semantic Image Inversion and Editing using Rectified Stochastic Differential Equationscited by 162
- 2019Classification Accuracy Score for Conditional Generative Modelscited by 134
- 2024Stable Flow: Vital Layers for Training-Free Image Editingcited by 111
- 2023DisenBooth: Identity-Preserving Disentangled Tuning for Subject-Driven Text-to-Image Generationcited by 75
- 2025VideoGrain: Modulating Space-Time Attention for Multi-grained Video Editingcited by 50
- 2023Latent Space Editing in Transformer-Based Flow Matchingcited by 32
- 2021Consistency Regularization Can Improve Robustness to Label Noisecited by 18
- 2023Idempotent Generative Networkcited by 17
- 2025ReFlex: Text-Guided Editing of Real Images in Rectified Flow via Mid-Step Feature Extraction and Attention Adaptationcited by 15
- 2023Image-to-Image Translation with Disentangled Latent Vectors for Face Editingcited by 13
- 2024Voice Attribute Editing with Text Promptcited by 9
- 2024VoiceShop: A Unified Speech-to-Speech Framework for Identity-Preserving Zero-Shot Voice Editingcited by 7
- 2024IT3: Idempotent Test-Time Trainingcited by 6
- 2025Optimal Transport for Rectified Flow Image Editing: Unifying Inversion-Based and Direct Methodscited by 5
- 2022Semantic Unfolding of StyleGAN Latent Spacecited by 4
- 2024VoxGenesis: Unsupervised Discovery of Latent Speaker Manifold for Speech Synthesiscited by 4
- 2025Score-based Idempotent Distillation of Diffusion Modelscited by 2
Built on by
Not cited yet.