# Nonlinear Intensity, Scale and Rotation Invariant Matching for Multimodal Images

arXiv: https://arxiv.org/abs/2302.14239 · HTML: https://mlsanity.com/paper/2302.14239/

## Key facts

- Cited by 1 papers in the map (data through 14 Oct 2026).
- Builds on 2 of its 31 references that are in the map.
- First posted on arXiv 28 Feb 2023.

## Builds on (most cited first, 2 of 2)

- [Direct Sparse Odometry](https://mlsanity.com/paper/1607.02565/) (2016)
- [Robust Registration of Multimodal Remote Sensing Images Based on Structural Similarity](https://mlsanity.com/paper/2103.16871/) (2021)

## Built on by (most cited first, 1 of 1)

- [REMM:Rotation-Equivariant Framework for End-to-End Multimodal Image Matching](https://mlsanity.com/paper/2407.11637/) (2024)

## Abstract (arXiv)

We present an effective method for the matching of multimodal images. Accurate image matching is the basis of various applications, such as image registration and structure from motion. Conventional matching methods fail when handling noisy multimodal image pairs with severe scale change, rotation, and nonlinear intensity distortion (NID). Toward this need, we introduce an image pyramid strategy to tackle scale change. We put forward an accurate primary orientation estimation approach to reduce the effect of image rotation at any angle. We utilize multi-scale and multi-orientation image filtering results and a feature-to-template matching scheme to ensure effective and accurate matching under large NID. Integrating these improvements significantly increases noise, scale, rotation, and NID invariant capability. Our experimental results confirm the excellent ability to achieve high-quality matches across various multimodal images. The proposed method outperforms the mainstream multimodal image matching methods in qualitative and quantitative evaluations. Our implementation is available at https://github.com/Zhongli-Fan/NISR.