# Parallax-Tolerant Unsupervised Deep Image Stitching

arXiv: https://arxiv.org/abs/2302.08207 · HTML: https://mlsanity.com/paper/2302.08207/

## Key facts

- Cited by 30 papers in the map (data through 14 Oct 2026).
- Builds on 15 of its 54 references that are in the map.
- First posted on arXiv 16 Feb 2023.

## Builds on (most cited first, 15 of 15)

- [Deep Residual Learning for Image Recognition](https://mlsanity.com/paper/1512.03385/) (2015)
- [Adam: A Method for Stochastic Optimization](https://mlsanity.com/paper/1412.6980/) (2014)
- [U-Net: Convolutional Networks for Biomedical Image Segmentation](https://mlsanity.com/paper/1505.04597/) (2015)
- [Spatial Transformer Networks](https://mlsanity.com/paper/1506.02025/) (2015)
- [Deep Image Homography Estimation](https://mlsanity.com/paper/1606.03798/) (2016)
- [Unsupervised Deep Homography: A Fast and Robust Homography Estimation Model](https://mlsanity.com/paper/1709.03966/) (2017)
- [Unsupervised Deep Image Stitching: Reconstructing Stitched Features to Images](https://mlsanity.com/paper/2106.12859/) (2021)
- [Depth-Aware Multi-Grid Deep Homography Estimation with Contextual Correlation](https://mlsanity.com/paper/2107.02524/) (2021)
- [Single-Perspective Warps in Natural Image Stitching](https://mlsanity.com/paper/1802.04645/) (2018)
- [Deep Rectangling for Image Stitching: A Learning Baseline](https://mlsanity.com/paper/2203.03831/) (2022)
- [Weakly-Supervised Stitching Network for Real-World Panoramic Image Generation](https://mlsanity.com/paper/2209.05968/) (2022)
- [Video Stitching for Linear Camera Arrays](https://mlsanity.com/paper/1907.13622/) (2019)
- [Image Stitching Based on Planar Region Consensus](https://mlsanity.com/paper/2007.02722/) (2020)
- [Image Stitching by Line-guided Local Warping with Global Similarity Constraint](https://mlsanity.com/paper/1702.07935/) (2017)
- [Pixel-wise Deep Image Stitching](https://mlsanity.com/paper/2112.06171/) (2021)

## Built on by (most cited first, 30 of 30)

- [RecDiffusion: Rectangling for Image Stitching with Diffusion Models](https://mlsanity.com/paper/2403.19164/) (2024)
- [Object-level Geometric Structure Preserving for Natural Image Stitching](https://mlsanity.com/paper/2402.12677/) (2024)
- [Semi-Supervised Coupled Thin-Plate Spline Model for Rotation Correction and Beyond](https://mlsanity.com/paper/2401.13432/) (2024)
- [Learning Residual Elastic Warps for Image Stitching under Dirichlet Boundary Condition](https://mlsanity.com/paper/2309.01406/) (2023)
- [Implicit Neural Image Stitching](https://mlsanity.com/paper/2309.01409/) (2023)
- [Eliminating Warping Shakes for Unsupervised Online Video Stitching](https://mlsanity.com/paper/2403.06378/) (2024)
- [Reconstructing the Image Stitching Pipeline: Integrating Fusion and Rectangling into a Unified Inpainting Model](https://mlsanity.com/paper/2404.14951/) (2024)
- [Modification Takes Courage: Seamless Image Stitching via Reference-Driven Inpainting](https://mlsanity.com/paper/2411.10309/) (2024)
- [Learning Efficient Meshflow and Optical Flow from Event Cameras](https://mlsanity.com/paper/2510.04111/) (2025)
- [Parallax-tolerant Image Stitching via Segmentation-guided Multi-homography Warping](https://mlsanity.com/paper/2406.19922/) (2024)
- [StabStitch++: Unsupervised Online Video Stitching with Spatiotemporal Bidirectional Warps](https://mlsanity.com/paper/2505.05001/) (2025)
- [FlowLUT: Efficient Image Enhancement via Differentiable LUTs and Iterative Flow Matching](https://mlsanity.com/paper/2509.23608/) (2025)
- [Parallax-Tolerant Image Stitching with Epipolar Displacement Field](https://mlsanity.com/paper/2311.16637/) (2023)
- [Neural Augmentation Based Panoramic High Dynamic Range Stitching](https://mlsanity.com/paper/2409.04679/) (2024)
- [Robust Image Stitching with Optimal Plane](https://mlsanity.com/paper/2508.05903/) (2025)
- [Object-IR: Leveraging Object Consistency and Mesh Deformation for Self-Supervised Image Retargeting](https://mlsanity.com/paper/2510.27236/) (2025)
- [LiftProj: Space Lifting and Projection-Based Panorama Stitching](https://mlsanity.com/paper/2512.24276/) (2025)
- [Towards Generalized Multimodal Homography Estimation](https://mlsanity.com/paper/2603.03956/) (2026)
- [Leveraging Local Patch Alignment to Seam-cutting for Large Parallax Image Stitching](https://mlsanity.com/paper/2311.18564/) (2023)
- [SX-Stitch: An Efficient VMS-UNet Based Framework for Intraoperative Scoliosis X-Ray Image Stitching](https://mlsanity.com/paper/2409.05681/) (2024)
- [ChatStitch: Visualizing Through Structures via Surround-View Unsupervised Deep Image Stitching with Collaborative LLM-Agents](https://mlsanity.com/paper/2503.14948/) (2025)
- [Flow Intelligence: Robust Feature Matching via Temporal Signature Correlation](https://mlsanity.com/paper/2504.11949/) (2025)
- [Generative Panoramic Image Stitching](https://mlsanity.com/paper/2507.07133/) (2025)
- [PIS3R: Very Large Parallax Image Stitching via Deep 3D Reconstruction](https://mlsanity.com/paper/2508.04236/) (2025)
- [EDFFDNet: Towards Accurate and Efficient Unsupervised Multi-Grid Image Registration](https://mlsanity.com/paper/2509.07662/) (2025)
- [Depth-Supervised Fusion Network for Seamless-Free Image Stitching](https://mlsanity.com/paper/2510.21396/) (2025)
- [SemanticStitch: Enhancing Image Coherence through Foreground-Aware Seam Carving](https://mlsanity.com/paper/2511.12084/) (2025)
- [Seamlessly Natural: Image Stitching with Natural Appearance Preservation](https://mlsanity.com/paper/2601.01257/) (2026)
- [UniStitch: Unifying Semantic and Geometric Features for Image Stitching](https://mlsanity.com/paper/2603.10568/) (2026)
- [Pano360: Perspective to Panoramic Vision with Geometric Consistency](https://mlsanity.com/paper/2603.12013/) (2026)

## Abstract (arXiv)

Traditional image stitching approaches tend to leverage increasingly complex geometric features (point, line, edge, etc.) for better performance. However, these hand-crafted features are only suitable for specific natural scenes with adequate geometric structures. In contrast, deep stitching schemes overcome the adverse conditions by adaptively learning robust semantic features, but they cannot handle large-parallax cases due to homography-based registration. To solve these issues, we propose UDIS++, a parallax-tolerant unsupervised deep image stitching technique. First, we propose a robust and flexible warp to model the image registration from global homography to local thin-plate spline motion. It provides accurate alignment for overlapping regions and shape preservation for non-overlapping regions by joint optimization concerning alignment and distortion. Subsequently, to improve the generalization capability, we design a simple but effective iterative strategy to enhance the warp adaption in cross-dataset and cross-resolution applications. Finally, to further eliminate the parallax artifacts, we propose to composite the stitched image seamlessly by unsupervised learning for seam-driven composition masks. Compared with existing methods, our solution is parallax-tolerant and free from laborious designs of complicated geometric features for specific scenes. Extensive experiments show our superiority over the SoTA methods, both quantitatively and qualitatively. The code is available at https://github.com/nie-lang/UDIS2.