# Comparison of Consecutive and Re-stained Sections for Image Registration in Histopathology

arXiv: https://arxiv.org/abs/2106.13150 · HTML: https://mlsanity.com/paper/2106.13150/

## Key facts

- Cited by 12 papers in the map (data through 14 Oct 2026).
- Builds on 5 of its 45 references that are in the map.
- First posted on arXiv 24 Jun 2021.

## Builds on (most cited first, 5 of 5)

- [Deep Learning in Medical Image Registration: A Survey](https://mlsanity.com/paper/1903.02026/) (2019)
- [Whole-Slide Mitosis Detection in H&E Breast Histology Using PHH3 as a Reference to Train Distilled Stain-Invariant Convolutional Networks](https://mlsanity.com/paper/1808.05896/) (2018)
- [CNN-based Lung CT Registration with Multiple Anatomical Constraints](https://mlsanity.com/paper/2011.14372/) (2020)
- [Epithelium segmentation using deep learning in H&E-stained prostate specimens with immunohistochemistry as reference standard](https://mlsanity.com/paper/1808.05883/) (2018)
- [A matrix-free approach to parallel and memory-efficient deformable image registration](https://mlsanity.com/paper/1804.10541/) (2018)

## Built on by (most cited first, 12 of 12)

- [The ACROBAT 2022 Challenge: Automatic Registration Of Breast Cancer Tissue](https://mlsanity.com/paper/2305.18033/) (2023)
- [ACROBAT -- a multi-stain breast cancer histological whole-slide-image data set from routine diagnostics for computational pathology](https://mlsanity.com/paper/2211.13621/) (2022)
- [RegWSI: Whole Slide Image Registration using Combined Deep Feature- and Intensity-Based Methods: Winner of the ACROBAT 2023 Challenge](https://mlsanity.com/paper/2404.13108/) (2024)
- [DeeperHistReg: Robust Whole Slide Images Registration Framework](https://mlsanity.com/paper/2404.14434/) (2024)
- [Nuclei-Location Based Point Set Registration of Multi-Stained Whole Slide Images](https://mlsanity.com/paper/2404.17041/) (2024)
- [From Pixels to Pathology: Restoration Diffusion for Diagnostic-Consistent Virtual IHC](https://mlsanity.com/paper/2508.02528/) (2025)
- [Multimodal Alignment of Histopathological Images Using Cell Segmentation and Point Set Matching for Integrative Cancer Analysis](https://mlsanity.com/paper/2410.00152/) (2024)
- [ZeroReg3D: A Zero-shot Registration Pipeline for 3D Consecutive Histopathology Image Reconstruction](https://mlsanity.com/paper/2506.21923/) (2025)
- [CORE -- A Cell-Level Coarse-to-Fine Image Registration Engine for Multi-stain Image Alignment](https://mlsanity.com/paper/2511.03826/) (2025)
- [Automatic Registration of SHG and H&E Images with Feature-based Initial Alignment and Intensity-based Instance Optimization: Contribution to the COMULIS Challenge](https://mlsanity.com/paper/2409.15931/) (2024)
- [Leveraging Adversarial Learning for Pathological Fidelity in Virtual Staining](https://mlsanity.com/paper/2511.18946/) (2025)
- [SheafStain: Sheaf-Theoretic Schr"odinger Bridge for Spatially and Biologically Coherent Virtual Staining](https://mlsanity.com/paper/2606.11846/) (2026)

## Abstract (arXiv)

Purpose: In digital histopathology, virtual multi-staining is important for diagnosis and biomarker research. Additionally, it provides accurate ground-truth for various deep-learning tasks. Virtual multi-staining can be obtained using different stains for consecutive sections or by re-staining the same section. Both approaches require image registration to compensate tissue deformations, but little attention has been devoted to comparing their accuracy. Approach: We compare variational image registration of consecutive and re-stained sections and analyze the effect of the image resolution which influences accuracy and required computational resources. We present a new hybrid dataset of re-stained and consecutive sections (HyReCo, 81 slide pairs, approx. 3000 landmarks) that we made publicly available and compare its image registration results to the automatic non-rigid histological image registration (ANHIR) challenge data (230 consecutive slide pairs). Results: We obtain a median landmark error after registration of 7.1 μm (HyReCo) and 16.0 μm (ANHIR) between consecutive sections. Between re-stained sections, the median registration error is 2.3 μm and 0.9 μm in the two subsets of the HyReCo dataset. We observe that deformable registration leads to lower landmark errors than affine registration in both cases, though the effect is smaller in re-stained sections. Conclusion: Deformable registration of consecutive and re-stained sections is a valuable tool for the joint analysis of different stains. Significance: While the registration of re-stained sections allows nucleus-level alignment which allows for a direct analysis of interacting biomarkers, consecutive sections only allow the transfer of region-level annotations. The latter can be achieved at low computational cost using coarser image resolutions.
