mlsanityData to 7 Oct 2026

SP-Det: Self-Prompted Dual-Text Fusion for Generalized Multi-Label Lesion Detection

arXiv 2512.04875 ↗First posted 4 Dec 2025cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Automated lesion detection in chest X-rays has demonstrated significant potential for improving clinical diagnosis by precisely localizing pathological abnormalities. While recent promptable detection frameworks have achieved remarkable accuracy in target localization, existing methods typically rely on manual annotations as prompts, which are labor-intensive and impractical for clinical applications. To address this limitation, we propose SP-Det, a novel self-prompted detection framework that automatically generates rich textual context to guide multi-label lesion detection without requiring expert annotations. Specifically, we introduce an expert-free dual-text prompt generator (DTPG) that leverages two complementary textual modalities: semantic context prompts that capture global pathological patterns and disease beacon prompts that focus on disease-specific manifestations. Moreover, we devise a bidirectional feature enhancer (BFE) that synergistically integrates comprehensive diagnostic context with disease-specific embeddings to significantly improve feature representation and detection accuracy. Extensive experiments on two chest X-ray datasets with diverse thoracic disease categories demonstrate that our SP-Det framework outperforms state-of-the-art detection methods while completely eliminating the dependency on expert-annotated prompts compared to existing promptable architectures.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 23 of its 37 references that are in the map. First posted on arXiv 4 Dec 2025.

Builds on

23 of 37 references.

References · 23

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,829
  3. 2021Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervisioncited by 3,848
  4. 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,274
  5. 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,048
  6. 2019BioBERT: a pre-trained biomedical language representation model for biomedical text miningcited by 1,935
  7. 2021Grounded Language-Image Pre-trainingcited by 1,147
  8. 2019Publicly Available Clinical BERT Embeddingscited by 995
  9. 2017ChestX-ray8: Hospital-scale Chest X-ray Database and Benchmarks on Weakly-Supervised Classification and Localization of Common Thorax Diseasescited by 969
  10. 2021Open-vocabulary Object Detection via Vision and Language Knowledge Distillationcited by 903
  11. 2023Textbooks Are All You Need II: phi-1.5 technical reportcited by 559
  12. 2019Object Detection in 20 Years: A Surveycited by 528
11 more
  1. 2023DETRs Beat YOLOs on Real-time Object Detectioncited by 526
  2. 2024YOLOv10: Real-Time End-to-End Object Detectioncited by 508
  3. 2024YOLO-World: Real-Time Open-Vocabulary Object Detectioncited by 498
  4. 2020Open-Vocabulary Object Detection Using Captionscited by 427
  5. 2022GLIPv2: Unifying Localization and Vision-Language Understandingcited by 275
  6. 2020VinDr-CXR: An open dataset of chest X-rays with radiologist's annotationscited by 236
  7. 2022Diagnose Like a Radiologist: Hybrid Neuro-Probabilistic Reasoning for Attribute-Based Medical Image Diagnosiscited by 21
  8. 2020Deep Learning for Automatic Pneumonia Detectioncited by 20
  9. 2023Exploring Image Augmentations for Siamese Representation Learning with Chest X-Rayscited by 12
  10. 2023CheXFusion: Effective Fusion of Multi-View Features using Transformers for Long-Tailed Chest X-Ray Classificationcited by 12
  11. 2023DualAttNet: Synergistic Fusion of Image-level and Fine-Grained Disease Attention for Multi-Label Lesion Detection in Chest X-rayscited by 5

Built on by

Not cited yet.