mlsanityData to 7 Oct 2026

Parallax Portrait Matting

arXiv 2607.11205 ↗First posted 13 Jul 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Image matting is highly ill-posed, especially when both the foreground and background are richly textured. While single-image matting methods learn strong priors from data, they often struggle on these challenging cases. Existing approaches improve results by requiring additional signals such as green screens, polarized lighting, or clean background images, but these typically rely on specialized capture setups. We present Parallax Portrait Matting, a practical two-frame matting method that uses a second image captured with slight viewpoint change. Such a setting arises naturally in burst photography, where small camera motion induces foreground-background parallax and provides complementary observations for matting. Our pipeline estimates trimaps and foreground/background motion, then constructs aligned views for prediction. To handle imperfect motion estimation, the network uses the background-aligned pair for direct fusion and the foreground-aligned cue through cross-attention for error compensation. Experiments show that our method recovers finer details and more accurate foreground colors than strong single-image matting baselines on challenging portrait cases.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 32 of its 47 references that are in the map. First posted on arXiv 13 Jul 2026.

Builds on

32 of 47 references.

References · 32

  1. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  2. 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,385
  3. 2021GMFlow: Learning Optical Flow via Global Matchingcited by 324
  4. 2020Real-Time High-Resolution Background Mattingcited by 172
  5. 2022CroCo: Self-Supervised Pre-training for 3D Vision Tasks by Cross-View Completioncited by 158
  6. 2021Robust High-Resolution Video Matting with Temporal Guidancecited by 136
  7. 2020MODNet: Real-Time Trimap-Free Portrait Matting via Objective Decompositioncited by 127
  8. 2024Bilateral Reference for High-Resolution Dichotomous Image Segmentationcited by 112
  9. 2024Transparent Image Layer Diffusion using Latent Transparencycited by 111
  10. 2020Background Matting: The World is Your Green Screencited by 104
  11. 2020Bridging Composite and Real: Towards End-to-end Deep Image Mattingcited by 89
  12. 2020Mask Guided Matting via Progressive Refinement Networkcited by 84
20 more
  1. 2021Deep Burst Super-Resolutioncited by 83
  2. 2019Context-Aware Image Matting for Simultaneous Foreground and Alpha Estimationcited by 79
  3. 2020Natural Image Matting via Guided Contextual Attentioncited by 78
  4. 2018Semantic Human Mattingcited by 67
  5. 2021Privacy-Preserving Portrait Mattingcited by 60
  6. 2017Information-Flow Mattingcited by 59
  7. 2023ViTMatte: Boosting Image Matting with Pretrained Plain Vision Transformerscited by 56
  8. 2020Boosting Semantic Human Matting with Coarse Annotationscited by 48
  9. 2022MatteFormer: Transformer-Based Image Matting via Prior-Tokenscited by 48
  10. 2021Deep Video Matting via Spatio-Temporal Alignment and Aggregationcited by 41
  11. 2023Matting Anythingcited by 30
  12. 2022Rethinking Portrait Matting with Privacy Preservingcited by 25
  13. 2022Human Instance Matting via Mutual Guidance and Multi-Instance Refinementcited by 25
  14. 2025MatAnyone: Stable Video Matting with Consistent Memory Propagationcited by 24
  15. 2022VMFormer: End-to-End Video Matting with Transformercited by 20
  16. 2024MaGGIe: Masked Guided Gradual Human Instance Mattingcited by 18
  17. 2024Matting by Generationcited by 13
  18. 2024PhoCoLens: Photorealistic and Consistent Reconstruction in Lensless Imagingcited by 13
  19. 2026DA-VAE: Plug-in Latent Compression for Diffusion via Detail Alignmentcited by 4
  20. 2021Alpha Matte Generation from Single Input for Portrait Mattingcited by 3

Built on by

Not cited yet.