mlsanityData to 14 Oct 2026

LRMIL: Efficient Low-Resolution Multiple Instance Learning via High-Resolution Knowledge Distillation for Whole Slide Image Classification

arXiv 2606.06864 ↗First posted 5 Jun 2026cs.CV cs.LGcited by 0

On the map: Knowledge distillation → Distillation for medical imaging

Abstract (arXiv)

Multiple instance learning (MIL) has become a standard paradigm for whole slide image (WSI) analysis in digital pathology, as it enables slide-level prediction without dense annotations. Existing MIL methods typically rely on exhaustive extraction and encoding of high-resolution patches. However, this practice suffers from two critical limitations in real-world clinical settings: it struggles to capture global visual cues at lower magnifications, and incurs substantial computational overhead due to the massive number of high-resolution patches per slide. To address these limitations, we propose an efficient low-resolution multiple instance learning (LRMIL) framework that transfers high-resolution knowledge to low-resolution representations. LRMIL adopts a two-stage distillation strategy. First, patch-level cross-resolution distillation aligns low-resolution patch embeddings with high-resolution representations. Second, slide-level knowledge distillation trains a low-resolution student MIL model under both slide-level supervision and teacher guidance. At inference time, LRMIL operates exclusively on low-resolution patches, substantially reducing data preprocessing and computational cost. Extensive experiments on multiple WSI benchmarks demonstrate that LRMIL consistently outperforms state-of-the-art MIL methods while achieving more efficient inference. These results highlight LRMIL as a practical and scalable solution for WSI analysis in clinical pathology.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Distillation for medical imaging, one of 12 directions in Knowledge distillation. Builds on 15 of its 19 references that are in the map. First posted on arXiv 5 Jun 2026.

Builds on

15 of 19 references.

Closest ancestors · 1

Same direction, newest first

  1. 2022DTFD-MIL: Double-Tier Feature Distillation Multiple Instance Learning for Histopathology Whole Slide Image Classification22 Mar

Other references · 14

  1. 2015Distilling the Knowledge in a Neural Networkcited by 10,324
  2. 2018Attention-based Deep Multiple Instance Learningcited by 1,095
  3. 2020Data Efficient and Weakly Supervised Computational Pathology on Whole Slide Imagescited by 745
  4. 2020Dual-stream Multiple Instance Learning Network for Whole Slide Image Classification with Self-supervised Contrastive Learningcited by 478
  5. 2021Distilling Knowledge via Knowledge Reviewcited by 288
  6. 2024Virchow2: Scaling Self-Supervised Mixed Magnification Models in Pathologycited by 161
  7. 2021BRACS: A Dataset for BReAst Carcinoma Subtyping in H&E Histology Imagescited by 132
  8. 2022Knowledge Distillation via the Target-aware Transformercited by 70
  9. 2023From Knowledge Distillation to Self-Knowledge Distillation: A Unified Approach with Normalized Loss and Customized Soft Labelscited by 69
  10. 2022Differentiable Zooming for Multiple Instance Learning on Whole-Slide Imagescited by 43
  11. 2025Distilling foundation models for robust and efficient models in digital pathologycited by 36
  12. 2024FOCUS: Knowledge-enhanced Adaptive Visual Compression for Few-shot Whole Slide Image Classificationcited by 20
2 more
  1. 2025Fast and Accurate Gigapixel Pathological Image Classification with Hierarchical Distillation Multi-Instance Learningcited by 5
  2. 2025Efficient Multi-Slide Visual-Language Feature Fusion for Placental Disease Classificationcited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Dual-stream attention-guided learning for weakly supervised whole slide image classification
  2. 2025LadderMIL: Multiple Instance Learning with Coarse-to-Fine Self-Distillation
  3. 2025Denoising Mutual Knowledge Distillation in Bi-Directional Multiple Instance Learning
  4. 2026Mixture of Mini Experts: Overcoming the Linear Layer Bottleneck in Multiple Instance Learning
  5. 2025AHDMIL: Asymmetric Hierarchical Distillation Multi-Instance Learning for Fast and Accurate Whole-Slide Image Classification
  6. 2025SemaMIL: Semantic-Aware Multiple Instance Learning with Retrieval-Guided State Space Modeling for Whole Slide Images
  7. 2025PathRWKV: Enhancing Whole Slide Image Inference with Asymmetric Recurrent Modeling
  8. 2025Prototype-Based Multiple Instance Learning for Gigapixel Whole Slide Image Classification