Uni-Hema: Unified Model for Digital Hematopathology
Not on the map. Why?
Abstract (arXiv)
Digital hematopathology requires cell-level analysis across diverse disease categories, including malignant disorders (e.g., leukemia), infectious conditions (e.g., malaria), and non-malignant red blood cell disorders (e.g., sickle cell disease). Whether single-task, vision-language, WSI-optimized, or single-cell hematology models, these approaches share a key limitation, they cannot provide unified, multi-task, multi-modal reasoning across the complexities of digital hematopathology. To overcome these limitations, we propose Uni-Hema, a multi-task, unified model for digital hematopathology integrating detection, classification, segmentation, morphology prediction, and reasoning across multiple diseases. Uni-Hema leverages 46 publicly available datasets, encompassing over 700K images and 21K question-answer pairs, and is built upon Hema-Former, a multimodal module that bridges visual and textual representations at the hierarchy level for the different tasks (detection, classification, segmentation, morphology, mask language modeling and visual question answer) at different granularity. Extensive experiments demonstrate that Uni-Hema achieves comparable or superior performance to train on a single-task and single dataset models, across diverse hematological tasks, while providing interpretable, morphologically relevant insights at the single-cell level. Our framework establishes a new standard for multi-task and multi-modal digital hematopathology. The code will be made publicly available.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 40 of its 85 references that are in the map. First posted on arXiv 17 Nov 2025.
Builds on
40 of 85 references.
References · 40
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,617
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2021Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervisioncited by 3,848
- 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,175
- 2019FCOS: Fully Convolutional One-Stage Object Detectioncited by 1,573
- 2018Attention U-Net: Learning Where to Look for the Pancreascited by 1,420
- 2022DINO: DETR with Improved DeNoising Anchor Boxes for End-to-End Object Detectioncited by 1,306
- 2025DINOv3cited by 1,297
28 more
- 2022CoCa: Contrastive Captioners are Image-Text Foundation Modelscited by 1,265
- 2021MedMNIST v2 -- A large-scale lightweight benchmark for 2D and 3D biomedical image classificationcited by 682
- 2022MedCLIP: Contrastive Learning from Unpaired Medical Images and Textcited by 564
- 2020Sparse R-CNN: End-to-End Object Detection with Learnable Proposalscited by 494
- 2022Mask DINO: Towards A Unified Transformer-based Framework for Object Detection and Segmentationcited by 341
- 2024BioMistral: A Collection of Open-Source Pretrained Large Language Models for Medical Domainscited by 299
- 2023Towards Generalist Biomedical AIcited by 286
- 2022GLIPv2: Unifying Localization and Vision-Language Understandingcited by 275
- 2022A Unified Sequence Interface for Vision Taskscited by 152
- 2024DINO-X: A Unified Vision Model for Open-World Object Detection and Understandingcited by 85
- 2024Phikon-v2, A large and public feature extractor for biomarker predictioncited by 67
- 2022Uni-Perceiver v2: A Generalist Model for Large-Scale Vision and Vision-Language Taskscited by 57
- 2023Towards a Visual-Language Foundation Model for Computational Pathologycited by 52
- 2020NuClick: A Deep Learning Framework for Interactive Segmentation of Microscopy Imagescited by 46
- 2024DinoBloom: A Foundation Model for Generalizable Cell Embeddings in Hematologycited by 27
- 2023TransNetR: Transformer-based Residual Network for Polyp Segmentation with Multi-Center Out-of-Distribution Testingcited by 26
- 2023WBCAtt: A White Blood Cell Dataset Annotated with Detailed Morphological Attributescited by 22
- 2021NanoNet: Real-Time Polyp Segmentation in Video Capsule Endoscopy and Colonoscopycited by 16
- 2018Applying Faster R-CNN for Object Detection on Malaria Imagescited by 15
- 2024One Model is All You Need: ByT5-Sanskrit, a Unified Model for Sanskrit NLP Taskscited by 15
- 2021Towards Low-Cost and Efficient Malaria Detectioncited by 12
- 2024SCKansformer: Fine-Grained Classification of Bone Marrow Cells via Kansformer Backbone and Hierarchical Attention Mechanismscited by 10
- 2023Uni3DL: Unified Model for 3D and Language Understandingcited by 9
- 2023You Only Learn One Query: Learning Unified Human Query for Single-Stage Multi-Person Multi-Task Human-Centric Perceptioncited by 9
- 2024Pathology Foundation Modelscited by 7
- 2024A Large-scale Multi Domain Leukemia Dataset for the White Blood Cells Detection with Morphological Attributes for Explainabilitycited by 4
- 2025RedDino: A foundation model for red blood cell analysiscited by 2
- 2025Leveraging Sparse Annotations for Leukemia Diagnosis on the Large Leukemia Datasetcited by 1
Built on by
Citing papers per year: 2026: 2.
2 papers.