mlsanityData to 14 Oct 2026

NuNext: Reframing Nucleus Detection as Next-Point Detection

arXiv 2603.07098 ↗First posted 7 Mar 2026cs.CVcited by 2

Not on the map. Why?

Abstract (arXiv)

Nucleus detection in histopathology is pivotal for a wide range of clinical applications. Existing approaches either regress nuclear proxy maps that require complex post-processing, or employ dense anchors or queries that introduce severe foreground-background imbalance. In this work, we reformulate nucleus detection as next-point prediction, wherein a multimodal large language model is developed to directly output foreground nucleus centroids from the input image. The model is trained in two stages. In the supervised learning stage, we propose spatial-aware soft supervision to relax strict centroid matching and a chain-of-visual-thought strategy to incorporate visual priors that facilitate coordinate prediction. In the reinforcement fine-tuning stage, we design distribution matching reward, low-variance group filtering, and fine-grained advantage shaping to further improve the model's detection quality. Extensive experiments on nine widely used benchmarks demonstrate the superiority of our method. Code will be released soon.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 48 of its 70 references that are in the map. First posted on arXiv 7 Mar 2026.

Builds on

48 of 70 references.

References · 48

  1. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  2. 2017Proximal Policy Optimization Algorithmscited by 15,215
  3. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  4. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  5. 2023Segment Anythingcited by 8,234
  6. 2017Mask R-CNNcited by 7,277
  7. 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,944
  8. 2025Qwen2.5-VL Technical Reportcited by 5,587
  9. 2022Large Language Models are Zero-Shot Reasonerscited by 4,374
  10. 2025DAPO: An Open-Source LLM Reinforcement Learning System at Scalecited by 2,810
  11. 2023AWQ: Activation-aware Weight Quantization for LLM Compression and Accelerationcited by 1,298
  12. 2018HoVer-Net: Simultaneous Segmentation and Classification of Nuclei in Multi-Tissue Histology Imagescited by 388
36 more
  1. 2018Cell Detection with Star-convex Polygonscited by 183
  2. 2021Rethinking Counting and Localization in Crowds:A Purely Point-Based Frameworkcited by 152
  3. 2020PanNuke Dataset Extension, Insights and Baselinescited by 114
  4. 2023CellViT: Vision Transformers for Precise Cell Segmentation and Classificationcited by 108
  5. 2024HEST-1k: A Dataset for Spatial Transcriptomics and Histology Image Analysiscited by 107
  6. 2023Quilt-LLaVA: Visual Instruction Tuning by Extracting Localized Narratives from Open-Source Histopathology Videoscited by 86
  7. 2018Methods for Segmentation and Classification of Digital Microscopy Tissue Imagescited by 73
  8. 2025Detect Anything via Next Point Predictioncited by 73
  9. 2024SlideChat: A Large Vision-Language Assistant for Whole-Slide Pathology Image Understandingcited by 57
  10. 2019CIA-Net: Robust Nuclei Instance Segmentation with Contour-aware Information Aggregationcited by 54
  11. 2021CryoNuSeg: A Dataset for Nuclei Instance Segmentation of Cryosectioned H&E-Stained Histological Imagescited by 51
  12. 2023Histopathology Whole Slide Image Analysis with Heterogeneous Graph Representation Learningcited by 47
  13. 2024HistGen: Histopathology Report Generation via Local-Global Feature Encoding and Cross-modal Context Interactioncited by 43
  14. 2024WSI-LLaVA: A Multimodal Large Language Model for Whole Slide Imagecited by 40
  15. 2025Patho-R1: A Multimodal Reinforcement Learning-Based Pathology Expert Reasonercited by 40
  16. 2025PathFinder: A Multi-Modal Multi-Agent System for Medical Diagnostic Decision-Making Applied to Histopathologycited by 39
  17. 2021NuCLS: A scalable crowdsourcing, deep learning approach and dataset for nucleus classification, localization and segmentationcited by 34
  18. 2024CPath-Omni: A Unified Multimodal Foundation Model for Patch and Whole Slide Image Analysis in Computational Pathologycited by 34
  19. 2021CPP-Net: Context-aware Polygon Proposal Network for Nucleus Segmentationcited by 32
  20. 2023WsiCaption: Multiple Instance Generation of Pathology Reports for Gigapixel Whole-Slide Imagescited by 31
  21. 2026MMFineReason: Closing the Multimodal Reasoning Gap via Open Data-Centric Methodscited by 30
  22. 2025CPathAgent: An Agent-based Foundation Model for Interpretable High-Resolution Pathology Image Analysis Mimicking Pathologists' Diagnostic Logiccited by 29
  23. 2021Multi-Class Cell Detection Using Spatial Context Representationcited by 24
  24. 2025CellViT++: Energy-Efficient and Adaptive Cell Segmentation and Classification Using Foundation Modelscited by 21
  25. 2023Unleashing the Power of Prompt-driven Nucleus Instance Segmentationcited by 19
  26. 2025CodeDance: A Dynamic Tool-integrated MLLM for Executable Visual Reasoningcited by 16
  27. 2023Affine-Consistent Transformer for Multi-Class Cell Nuclei Detectioncited by 12
  28. 2021PointNu-Net: Keypoint-assisted Convolutional Neural Network for Simultaneous Multi-tissue Histology Nuclei Segmentation and Classificationcited by 8
  29. 2023DPA-P2PNet: Deformable Proposal-aware P2PNet for Accurate Point-based Cell Detectioncited by 8
  30. 2025Towards Effective and Efficient Context-aware Nucleus Detection in Histopathology Whole Slide Imagescited by 5
  31. 2025COIN: Confidence Score-Guided Distillation for Annotation-Free Cell Segmentationcited by 3
  32. 2025The Four Color Theorem for Cell Instance Segmentationcited by 3
  33. 2024From Histopathology Images to Cell Clouds: Learning Slide Representations with Hierarchical Cell Transformercited by 2
  34. 2025MUSE: Multi-Scale Dense Self-Distillation for Nucleus Detection and Classificationcited by 2
  35. 2026Disco: Densely-overlapping Cell Instance Segmentation via Adjacency-aware Collaborative Coloringcited by 2
  36. 2025Cell Nuclei Detection and Classification in Whole Slide Images with Transformerscited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2024Co-synthesis of Histopathology Nuclei Image-Label Pairs using a Context-Conditioned Joint Diffusion Model
  2. 2026From UNI2-h to ConvNeXt-T: Lightweight Nuclei Instance Segmentation via Knowledge Distillation
  3. 2023TransNuSeg: A Lightweight Multi-Task Transformer for Nuclei Segmentation
  4. 2023Diffusion-based Data Augmentation for Nuclei Image Segmentation
  5. 2024AttriPrompter: Auto-Prompting with Attribute Semantics for Zero-shot Nuclei Detection via Visual-Language Pre-trained Models
  6. 2023HoVer-UNet: Accelerating HoVerNet with UNet-based multi-class nuclei segmentation via knowledge distillation
  7. 2023NASDM: Nuclei-Aware Semantic Histopathology Image Generation Using Diffusion Models
  8. 2024Controllable and Efficient Multi-Class Pathology Nuclei Data Augmentation using Text-Conditioned Diffusion Models