Parallax Portrait Matting
Not on the map. Why?
Abstract (arXiv)
Image matting is highly ill-posed, especially when both the foreground and background are richly textured. While single-image matting methods learn strong priors from data, they often struggle on these challenging cases. Existing approaches improve results by requiring additional signals such as green screens, polarized lighting, or clean background images, but these typically rely on specialized capture setups. We present Parallax Portrait Matting, a practical two-frame matting method that uses a second image captured with slight viewpoint change. Such a setting arises naturally in burst photography, where small camera motion induces foreground-background parallax and provides complementary observations for matting. Our pipeline estimates trimaps and foreground/background motion, then constructs aligned views for prediction. To handle imperfect motion estimation, the network uses the background-aligned pair for direct fusion and the foreground-aligned cue through cross-attention for error compensation. Experiments show that our method recovers finer details and more accurate foreground colors than strong single-image matting baselines on challenging portrait cases.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 32 of its 47 references that are in the map. First posted on arXiv 13 Jul 2026.
Builds on
32 of 47 references.
References · 32
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,385
- 2021GMFlow: Learning Optical Flow via Global Matchingcited by 324
- 2020Real-Time High-Resolution Background Mattingcited by 172
- 2022CroCo: Self-Supervised Pre-training for 3D Vision Tasks by Cross-View Completioncited by 158
- 2021Robust High-Resolution Video Matting with Temporal Guidancecited by 136
- 2020MODNet: Real-Time Trimap-Free Portrait Matting via Objective Decompositioncited by 127
- 2024Bilateral Reference for High-Resolution Dichotomous Image Segmentationcited by 112
- 2024Transparent Image Layer Diffusion using Latent Transparencycited by 111
- 2020Background Matting: The World is Your Green Screencited by 104
- 2020Bridging Composite and Real: Towards End-to-end Deep Image Mattingcited by 89
- 2020Mask Guided Matting via Progressive Refinement Networkcited by 84
20 more
- 2021Deep Burst Super-Resolutioncited by 83
- 2019Context-Aware Image Matting for Simultaneous Foreground and Alpha Estimationcited by 79
- 2020Natural Image Matting via Guided Contextual Attentioncited by 78
- 2018Semantic Human Mattingcited by 67
- 2021Privacy-Preserving Portrait Mattingcited by 60
- 2017Information-Flow Mattingcited by 59
- 2023ViTMatte: Boosting Image Matting with Pretrained Plain Vision Transformerscited by 56
- 2020Boosting Semantic Human Matting with Coarse Annotationscited by 48
- 2022MatteFormer: Transformer-Based Image Matting via Prior-Tokenscited by 48
- 2021Deep Video Matting via Spatio-Temporal Alignment and Aggregationcited by 41
- 2023Matting Anythingcited by 30
- 2022Rethinking Portrait Matting with Privacy Preservingcited by 25
- 2022Human Instance Matting via Mutual Guidance and Multi-Instance Refinementcited by 25
- 2025MatAnyone: Stable Video Matting with Consistent Memory Propagationcited by 24
- 2022VMFormer: End-to-End Video Matting with Transformercited by 20
- 2024MaGGIe: Masked Guided Gradual Human Instance Mattingcited by 18
- 2024Matting by Generationcited by 13
- 2024PhoCoLens: Photorealistic and Consistent Reconstruction in Lensless Imagingcited by 13
- 2026DA-VAE: Plug-in Latent Compression for Diffusion via Detail Alignmentcited by 4
- 2021Alpha Matte Generation from Single Input for Portrait Mattingcited by 3
Built on by
Not cited yet.