View Transition based Dual Camera Image Fusion

The dual camera system of wide-angle (bfW) and telephoto (bfT) cameras has been widely adopted by popular phones. In the overlap region, fusing the bfW and bfT images can generate a higher quality image. Related works perform pixel-level motion alignment or high-dimensional feature alignment of the bfT image to the view of the bfW image and then perform image/feature fusion, but the enhancement in occlusion area is ill-posed and can hardly utilize data from bfT images. Our insight is to minimize the occlusion area and thus maximize the use of pixels from bfT images. Instead of insisting on placing the output in the bfW view, we propose a view transition method to transform both bfW and bfT images into a mixed view and then blend them into the output. The transformation ratio is kept small and not apparent to users, and the center area of the output, which has accumulated a sufficient amount of transformation, can directly use the contents from the T view to minimize occlusions. Experimental results show that, in comparison with the SOTA methods, occlusion area is largely reduced by our method and thus more pixels of the bfT image can be used for improving the quality of the output image.