TransText: Alpha-as-RGB Representation for Transparent Text Animation
Not on the map. Why?
Abstract (arXiv)
We introduce the first method, to the best of our knowledge, for adapting image-to-video models to layer-aware text (glyph) animation, a capability critical for practical dynamic visual design. Existing approaches predominantly handle the transparency-encoding (alpha channel) as an extra latent dimension appended to the RGB space, necessitating the reconstruction of the underlying RGB-centric variational autoencoder (VAE). However, given the scarcity of high-quality transparent glyph data, retraining the VAE is computationally expensive and may erode the robust semantic priors learned from massive RGB corpora, potentially leading to latent pattern mixing. To mitigate these limitations, we propose TransText, a framework based on a novel Alpha-as-RGB paradigm to jointly model appearance and transparency without modifying the pre-trained generative manifold. TransText embeds the alpha channel as an RGB-compatible visual signal through latent spatial concatenation, explicitly ensuring strict cross-modal (RGB-and-Alpha) consistency while preventing feature entanglement. Our experiments demonstrate that TransText significantly outperforms baselines, generating coherent, high-fidelity transparent animations with diverse, fine-grained effects.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 67 of its 85 references that are in the map. First posted on arXiv 18 Mar 2026.
Builds on
67 of 85 references.
References · 67
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
- 2022Scalable Diffusion Models with Transformerscited by 5,931
- 2022Flow Matching for Generative Modelingcited by 5,426
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,526
- 2022Video Diffusion Modelscited by 2,280
38 more
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
- 2022Imagen Video: High Definition Video Generation with Diffusion Modelscited by 1,765
- 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,725
- 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,418
- 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,204
- 2023VideoCrafter1: Open Diffusion Models for High-Quality Video Generationcited by 530
- 2024Sora: A Review on Background, Technology, Limitations, and Opportunities of Large Vision Modelscited by 467
- 2023DynamiCrafter: Animating Open-domain Images with Video Diffusion Priorscited by 463
- 2022DiffusionDet: Diffusion Model for Object Detectioncited by 354
- 2022Images Speak in Images: A Generalist Painter for In-Context Visual Learningcited by 317
- 2021SegDiff: Image Segmentation with Diffusion Probabilistic Modelscited by 279
- 2023SEINE: Short-to-Long Video Diffusion Model for Generative Transition and Predictioncited by 231
- 2023TextDiffuser: Diffusion Models as Text Painterscited by 223
- 2023Sequential Modeling Enables Scalable Learning for Large Vision Modelscited by 212
- 2020Real-Time High-Resolution Background Mattingcited by 172
- 2023AnyText: Multilingual Visual Text Generation And Editingcited by 165
- 2021Robust High-Resolution Video Matting with Temporal Guidancecited by 136
- 2023TextDiffuser-2: Unleashing the Power of Language Models for Text Renderingcited by 136
- 2023Make-Your-Video: Customized Video Generation Using Textual and Structural Guidancecited by 129
- 2024Transparent Image Layer Diffusion using Latent Transparencycited by 111
- 2024LamRA: Large Multimodal Model as Your Advanced Retrieval Assistantcited by 106
- 2020Background Matting: The World is Your Green Screencited by 104
- 2025Mixture of Contexts for Long Video Generationcited by 90
- 2024FreeLong: Training-Free Long Video Generation with SpectralBlend Temporal Attentioncited by 87
- 2024Glyph-ByT5: A Customized Text Encoder for Accurate Visual Text Renderingcited by 80
- 2021Complementary Patch for Weakly Supervised Semantic Segmentationcited by 75
- 2023Anomaly Detection with Conditioned Denoising Diffusion Modelscited by 56
- 2023DiffusionSeg: Adapting Diffusion Towards Unsupervised Object Discoverycited by 53
- 2024AnyText2: Visual Text Generation and Editing With Customizable Attributescited by 48
- 2024FonTS: Text Rendering with Typography and Style Controlscited by 40
- 2023Text2Layer: Layered Image Generation using Latent Diffusion Modelcited by 35
- 2024Image Segmentation in Foundation Model Era: A Surveycited by 35
- 2023Zero-shot Composed Text-Image Retrievalcited by 31
- 2023AttrSeg: Open-Vocabulary Semantic Segmentation via Attribute Decomposition-Aggregationcited by 29
- 2025Qwen-Image-Layered: Towards Inherent Editability via Layer Decompositioncited by 29
- 2023Uncovering Prototypical Knowledge for Weakly Open-Vocabulary Semantic Segmentationcited by 27
- 2024Audio-Visual Segmentation via Unlabeled Frame Exploitationcited by 27
- 2024LayerDiff: Exploring Text-guided Multi-layered Composable Image Synthesis via Layer-Collaborative Diffusion Modelcited by 26
50 most cited of 67 All 67 (JSON)
Built on by
Not cited yet.