OmniAlpha: Aligning Transparency-Aware Generation via Multi-Task Unified Reinforcement Learning
Not on the map. Why?
Abstract (arXiv)
Transparency-aware generation requires modeling not only RGB appearance but also alpha-based opacity and cross-layer composition, which are essential for tasks such as image matting, object removal, layer decomposition, and multi-layer content creation. However, existing RGBA-related methods remain largely fragmented, with separate pipelines designed for individual tasks. While a unified model is desirable, supervised fine-tuning alone is insufficient, as localized regression objectives cannot directly optimize the compositional fidelity, alpha-boundary precision, and structural consistency required for high-quality RGBA generation. To address this, we propose OmniAlpha, a unified multi-task reinforcement learning framework for transparency-aware generation and manipulation. OmniAlpha combines an end-to-end alpha-aware VAE and a sequence-to-sequence Diffusion Transformer, with a bi-directional layer axis in positional encoding to jointly model multiple RGBA inputs and outputs within a single forward pass. Built on a multi-task SFT cold start, it further performs GRPO-style post-training with layer-aware rewards defined on decoded RGBA outputs, enabling direct optimization of cross-layer coherence and fine transparency details. Experiments across five categories of transparency-aware tasks show that OmniAlpha consistently outperforms its unified SFT baseline and achieves strong performance against specialized expert models, including a 9.07% relative reduction in RGB L1 on layer decomposition and 74%/68% improvements over conventional matting tools on SAD/Grad for automatic matting.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). First posted on arXiv 25 Nov 2025.
Builds on
0 of 0 references.
No references here yet.
Built on by
Citing papers per year: 2026: 3.
3 papers.
- 2026PromptHub: Enhancing Multi-Prompt Visual In-Context Learning with Locality-Aware Fusion, Concentration and Alignmentcited by 2
- 2026UniWorld-Design: From Pixel Generation to Layer-Native Designcited by 0
- 2026PixelART: Image-to-Layer Decomposition without Latents or Text-to-Image Pretrainingcited by 0
- 2026PixelART: Image-to-Layer Decomposition without Latents or Text-to-Image Pretraining19 Sep 2026
- 2026UniWorld-Design: From Pixel Generation to Layer-Native Design4 Aug 2026
- 2026PromptHub: Enhancing Multi-Prompt Visual In-Context Learning with Locality-Aware Fusion, Concentration and Alignment19 Mar 2026
Similar, not cited
Close in wording, no citation either way
- 2025AlphaVAE: Unified End-to-End RGBA Image Reconstruction and Generation with Alpha-Aware Representation Learning
- 2024Generating Compositional Scenes via Text-to-image RGBA Instance Generation
- 2025Training-Free Text-Guided Color Editing with Multi-Modal Diffusion Transformer
- 2026Recolour What Matters: Region-Aware Colour Editing via Token-Level Diffusion
- 2026OmniColor: A Unified Framework for Multi-modal Lineart Colorization
- 2025TransPixeler: Advancing Text-to-Video Generation with Transparency
- 2025IntrinsicEdit: Precise generative image manipulation in intrinsic space
- 2026SemiNFT: Learning to Transfer Presets from Imitation to Appreciation via Hybrid-Sample Reinforcement Learning