# Information-Flow Matting

arXiv: https://arxiv.org/abs/1707.05055 · HTML: https://mlsanity.com/paper/1707.05055/

## Key facts

- Cited by 59 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 17 Jul 2017.

## Built on by (most cited first, 30 of 59)

- [Robust High-Resolution Video Matting with Temporal Guidance](https://mlsanity.com/paper/2108.11515/) (2021)
- [Transparent Image Layer Diffusion using Latent Transparency](https://mlsanity.com/paper/2402.17113/) (2024)
- [Privacy-Preserving Portrait Matting](https://mlsanity.com/paper/2104.14222/) (2021)
- [Semantic Image Matting](https://mlsanity.com/paper/2104.08201/) (2021)
- [Deep Video Matting via Spatio-Temporal Alignment and Aggregation](https://mlsanity.com/paper/2104.11208/) (2021)
- [Matting Anything](https://mlsanity.com/paper/2306.05399/) (2023)
- [Attention-guided Temporally Coherent Video Object Matting](https://mlsanity.com/paper/2105.11427/) (2021)
- [Rethinking Portrait Matting with Privacy Preserving](https://mlsanity.com/paper/2203.16828/) (2022)
- [Human Instance Matting via Mutual Guidance and Multi-Instance Refinement](https://mlsanity.com/paper/2205.10767/) (2022)
- [PP-Matting: High-Accuracy Natural Image Matting](https://mlsanity.com/paper/2204.09433/) (2022)
- [LayerD: Decomposing Raster Graphic Designs into Layers](https://mlsanity.com/paper/2509.25134/) (2025)
- [VMFormer: End-to-End Video Matting with Transformer](https://mlsanity.com/paper/2208.12801/) (2022)
- [Long-Range Feature Propagating for Natural Image Matting](https://mlsanity.com/paper/2109.12252/) (2021)
- [Matting by Generation](https://mlsanity.com/paper/2407.21017/) (2024)
- [Robust Human Matting via Semantic Guidance](https://mlsanity.com/paper/2210.05210/) (2022)
- [Deep Image Matting: A Comprehensive Survey](https://mlsanity.com/paper/2304.04672/) (2023)
- [Smart Scribbles for Image Mating](https://mlsanity.com/paper/2103.17062/) (2021)
- [Multi-scale Information Assembly for Image Matting](https://mlsanity.com/paper/2101.02391/) (2021)
- [MODNet-V: Improving Portrait Video Matting via Background Restoration](https://mlsanity.com/paper/2109.11818/) (2021)
- [Salient Image Matting](https://mlsanity.com/paper/2103.12337/) (2021)
- [Prior-Induced Information Alignment for Image Matting](https://mlsanity.com/paper/2106.14439/) (2021)
- [Highly Efficient Natural Image Matting](https://mlsanity.com/paper/2110.12748/) (2021)
- [Hierarchical and Progressive Image Matting](https://mlsanity.com/paper/2210.06906/) (2022)
- [EFormer: Enhanced Transformer towards Semantic-Contour Features of Foreground for Portraits Matting](https://mlsanity.com/paper/2308.12831/) (2023)
- [Lightweight Portrait Matting via Regional Attention and Refinement](https://mlsanity.com/paper/2311.03770/) (2023)
- [Video Instance Matting](https://mlsanity.com/paper/2311.04212/) (2023)
- [Boosting General Trimap-free Matting in the Real-World Image](https://mlsanity.com/paper/2405.17916/) (2024)
- [Training Matting Models without Alpha Labels](https://mlsanity.com/paper/2408.10539/) (2024)
- [Alpha Matte Generation from Single Input for Portrait Matting](https://mlsanity.com/paper/2106.03210/) (2021)
- [Virtual Multi-Modality Self-Supervised Foreground Matting for Human-Object Interaction](https://mlsanity.com/paper/2110.03278/) (2021)

## Abstract (arXiv)

We present a novel, purely affinity-based natural image matting algorithm. Our method relies on carefully defined pixel-to-pixel connections that enable effective use of information available in the image. We control the information flow from the known-opacity regions into the unknown region, as well as within the unknown region itself, by utilizing multiple definitions of pixel affinities. Among other forms of information flow, we introduce color-mixture flow, which builds upon local linear embedding and effectively encapsulates the relation between different pixel opacities. Our resulting novel linear system formulation can be solved in closed-form and is robust against several fundamental challenges of natural matting such as holes and remote intricate structures. While our method is primarily designed as a standalone matting tool, we show that it can also be used for regularizing mattes obtained by sampling-based methods. The formulation is also extended to layer color estimation and we show that the use of multiple channels of flow increases the layer color quality. We also demonstrate our performance in green-screen keying and analyze the characteristics of the utilized affinities.
