mlsanityData to 7 Oct 2026

TransText: Alpha-as-RGB Representation for Transparent Text Animation

arXiv 2603.17944 ↗First posted 18 Mar 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

We introduce the first method, to the best of our knowledge, for adapting image-to-video models to layer-aware text (glyph) animation, a capability critical for practical dynamic visual design. Existing approaches predominantly handle the transparency-encoding (alpha channel) as an extra latent dimension appended to the RGB space, necessitating the reconstruction of the underlying RGB-centric variational autoencoder (VAE). However, given the scarcity of high-quality transparent glyph data, retraining the VAE is computationally expensive and may erode the robust semantic priors learned from massive RGB corpora, potentially leading to latent pattern mixing. To mitigate these limitations, we propose TransText, a framework based on a novel Alpha-as-RGB paradigm to jointly model appearance and transparency without modifying the pre-trained generative manifold. TransText embeds the alpha channel as an RGB-compatible visual signal through latent spatial concatenation, explicitly ensuring strict cross-modal (RGB-and-Alpha) consistency while preventing feature entanglement. Our experiments demonstrate that TransText significantly outperforms baselines, generating coherent, high-fidelity transparent animations with diverse, fine-grained effects.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 67 of its 85 references that are in the map. First posted on arXiv 18 Mar 2026.

Builds on

67 of 85 references.

References · 67

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  4. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  5. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
  6. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
  7. 2022Scalable Diffusion Models with Transformerscited by 5,931
  8. 2022Flow Matching for Generative Modelingcited by 5,426
  9. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
  10. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
  11. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,526
  12. 2022Video Diffusion Modelscited by 2,280
38 more
  1. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
  2. 2022Imagen Video: High Definition Video Generation with Diffusion Modelscited by 1,765
  3. 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,725
  4. 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,418
  5. 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,204
  6. 2023VideoCrafter1: Open Diffusion Models for High-Quality Video Generationcited by 530
  7. 2024Sora: A Review on Background, Technology, Limitations, and Opportunities of Large Vision Modelscited by 467
  8. 2023DynamiCrafter: Animating Open-domain Images with Video Diffusion Priorscited by 463
  9. 2022DiffusionDet: Diffusion Model for Object Detectioncited by 354
  10. 2022Images Speak in Images: A Generalist Painter for In-Context Visual Learningcited by 317
  11. 2021SegDiff: Image Segmentation with Diffusion Probabilistic Modelscited by 279
  12. 2023SEINE: Short-to-Long Video Diffusion Model for Generative Transition and Predictioncited by 231
  13. 2023TextDiffuser: Diffusion Models as Text Painterscited by 223
  14. 2023Sequential Modeling Enables Scalable Learning for Large Vision Modelscited by 212
  15. 2020Real-Time High-Resolution Background Mattingcited by 172
  16. 2023AnyText: Multilingual Visual Text Generation And Editingcited by 165
  17. 2021Robust High-Resolution Video Matting with Temporal Guidancecited by 136
  18. 2023TextDiffuser-2: Unleashing the Power of Language Models for Text Renderingcited by 136
  19. 2023Make-Your-Video: Customized Video Generation Using Textual and Structural Guidancecited by 129
  20. 2024Transparent Image Layer Diffusion using Latent Transparencycited by 111
  21. 2024LamRA: Large Multimodal Model as Your Advanced Retrieval Assistantcited by 106
  22. 2020Background Matting: The World is Your Green Screencited by 104
  23. 2025Mixture of Contexts for Long Video Generationcited by 90
  24. 2024FreeLong: Training-Free Long Video Generation with SpectralBlend Temporal Attentioncited by 87
  25. 2024Glyph-ByT5: A Customized Text Encoder for Accurate Visual Text Renderingcited by 80
  26. 2021Complementary Patch for Weakly Supervised Semantic Segmentationcited by 75
  27. 2023Anomaly Detection with Conditioned Denoising Diffusion Modelscited by 56
  28. 2023DiffusionSeg: Adapting Diffusion Towards Unsupervised Object Discoverycited by 53
  29. 2024AnyText2: Visual Text Generation and Editing With Customizable Attributescited by 48
  30. 2024FonTS: Text Rendering with Typography and Style Controlscited by 40
  31. 2023Text2Layer: Layered Image Generation using Latent Diffusion Modelcited by 35
  32. 2024Image Segmentation in Foundation Model Era: A Surveycited by 35
  33. 2023Zero-shot Composed Text-Image Retrievalcited by 31
  34. 2023AttrSeg: Open-Vocabulary Semantic Segmentation via Attribute Decomposition-Aggregationcited by 29
  35. 2025Qwen-Image-Layered: Towards Inherent Editability via Layer Decompositioncited by 29
  36. 2023Uncovering Prototypical Knowledge for Weakly Open-Vocabulary Semantic Segmentationcited by 27
  37. 2024Audio-Visual Segmentation via Unlabeled Frame Exploitationcited by 27
  38. 2024LayerDiff: Exploring Text-guided Multi-layered Composable Image Synthesis via Layer-Collaborative Diffusion Modelcited by 26

50 most cited of 67 All 67 (JSON)

Built on by

Not cited yet.