mlsanityData to 14 Oct 2026

OmniAlpha: Aligning Transparency-Aware Generation via Multi-Task Unified Reinforcement Learning

arXiv 2511.20211 ↗First posted 25 Nov 2025cs.CV cs.AIcited by 3

Not on the map. Why?

Abstract (arXiv)

Transparency-aware generation requires modeling not only RGB appearance but also alpha-based opacity and cross-layer composition, which are essential for tasks such as image matting, object removal, layer decomposition, and multi-layer content creation. However, existing RGBA-related methods remain largely fragmented, with separate pipelines designed for individual tasks. While a unified model is desirable, supervised fine-tuning alone is insufficient, as localized regression objectives cannot directly optimize the compositional fidelity, alpha-boundary precision, and structural consistency required for high-quality RGBA generation. To address this, we propose OmniAlpha, a unified multi-task reinforcement learning framework for transparency-aware generation and manipulation. OmniAlpha combines an end-to-end alpha-aware VAE and a sequence-to-sequence Diffusion Transformer, with a bi-directional layer axis in positional encoding to jointly model multiple RGBA inputs and outputs within a single forward pass. Built on a multi-task SFT cold start, it further performs GRPO-style post-training with layer-aware rewards defined on decoded RGBA outputs, enabling direct optimization of cross-layer coherence and fine transparency details. Experiments across five categories of transparency-aware tasks show that OmniAlpha consistently outperforms its unified SFT baseline and achieves strong performance against specialized expert models, including a 9.07% relative reduction in RGB L1 on layer decomposition and 74%/68% improvements over conventional matting tools on SAD/Grad for automatic matting.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). First posted on arXiv 25 Nov 2025.

Builds on

0 of 0 references.

No references here yet.

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025AlphaVAE: Unified End-to-End RGBA Image Reconstruction and Generation with Alpha-Aware Representation Learning
  2. 2024Generating Compositional Scenes via Text-to-image RGBA Instance Generation
  3. 2025Training-Free Text-Guided Color Editing with Multi-Modal Diffusion Transformer
  4. 2026Recolour What Matters: Region-Aware Colour Editing via Token-Level Diffusion
  5. 2026OmniColor: A Unified Framework for Multi-modal Lineart Colorization
  6. 2025TransPixeler: Advancing Text-to-Video Generation with Transparency
  7. 2025IntrinsicEdit: Precise generative image manipulation in intrinsic space
  8. 2026SemiNFT: Learning to Transfer Presets from Imitation to Appreciation via Hybrid-Sample Reinforcement Learning