VLM- and LLM-Driven Multi-Agent System for PET Image Denoising
Not on the map. Why?
Abstract (arXiv)
Positron emission tomography (PET) imaging suffers from limited spatial resolution and low signal-to-noise ratio, which can compromise quantitative accuracy and lesion detectability. Deep learning-based denoising methods have demonstrated strong potential for improving PET image quality. However, their practical deployment in real-world settings remains challenging, often requiring multiple specialized models and expert interventions, such as identifying motion-induced misregistration artifacts, estimating noise levels to select an appropriate denoiser, and performing lesion-focused quantitative assessment after denoising. Recent advances in vision-language models (VLMs) for image quality understanding and large language models (LLMs) for contextual reasoning provide new opportunities for automated, decision-driven workflows. Inspired by expert workflows for PET image quality enhancement, we propose an VLM- and LLM-driven multi-agent PET denoising framework that dynamically assesses image quality and lesion status, autonomously selects optimal denoising models and parameters, and enables closed-loop feedback with rollback mechanisms. Experiments were conducted on Siemens Biograph Vision Quadra PET/CT data with 1/20 and 1/50 low-dose settings. Individual module evaluations demonstrated the reliability of the agentic components, while the complete framework achieved higher PSNR and SSIM than UNet, GAN, and DDPM baselines at both dose levels. These preliminary results demonstrate the feasibility of using a closed-loop multi-agent framework to adapt PET denoising strategies to different image conditions.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 24 of its 55 references that are in the map. First posted on arXiv 13 Aug 2026.
Builds on
24 of 55 references.
References · 24
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,182
- 2023LLaVA-Med: Training a Large Language-and-Vision Assistant for Biomedicine in One Daycited by 1,305
- 2023HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging Facecited by 1,190
- 2022TotalSegmentator: robust segmentation of 104 anatomical structures in CT imagescited by 613
- 2023BiomedCLIP: a multimodal biomedical foundation model pretrained from fifteen million scientific image-text pairscited by 520
- 2023Q-Align: Teaching LMMs for Visual Scoring via Discrete Text-Defined Levelscited by 503
- 2023Q-Bench: A Benchmark for General-Purpose Foundation Models on Low-level Visioncited by 249
- 2023Almanac: Retrieval-Augmented Language Models for Clinical Medicinecited by 123
12 more
- 2023Depicting Beyond Scores: Advancing Image Quality Assessment through Multi-modal Language Modelscited by 105
- 2022PET image denoising based on denoising diffusion probabilistic modelscited by 57
- 2024RestoreAgent: Autonomous Image Restoration Agent via Multimodal Large Language Modelscited by 43
- 20254KAgent: Agentic Any Image to 4K Super-Resolutioncited by 36
- 2025Multi-Agent Image Restorationcited by 21
- 2023Full-dose Whole-body PET Synthesis from Low-dose PET Using High-efficiency Denoising Diffusion Probabilistic Model: PET Consistency Modelcited by 15
- 2024SynArtifact: Classifying and Alleviating Artifacts in Synthetic Images via Vision-Language Modelcited by 15
- 2023DDPET-3D: Dose-aware Diffusion Model for 3D Ultra Low-dose PET Imagingcited by 12
- 2025RadAgents: Multimodal Agentic Reasoning for Chest X-ray Interpretation with Radiologist-like Workflowscited by 8
- 2024LegoPET: Hierarchical Feature Guided Conditional Diffusion for PET Image Reconstructioncited by 2
- 2026A multi-agent system for spine MRI report generation from multi-sequence imagingcited by 2
- 2025Supervised Diffusion-Model-Based PET Image Reconstructioncited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025PET Image Denoising via Text-Guided Diffusion: Integrating Anatomical Priors through Text Prompts
- 2024Adaptive Whole-Body PET Image Denoising Using 3D Diffusion Models with ControlNet
- 2025Toward a Vision-Language Foundation Model for Medical Data: Multimodal Dataset and Benchmarks for Vietnamese PET/CT Report Generation
- 2024Dose-aware Diffusion Model for 3D PET Image Denoising: Multi-institutional Validation with Reader Study and Real Low-dose Data
- 20263D Wavelet-Based Structural Priors for Controlled Diffusion in Whole-Body Low-Dose PET Denoising
- 2025Fed-NDIF: A Noise-Embedded Federated Diffusion Model For Low-Count Whole-Body PET Denoising
- 2025End-to-End PET Image Reconstruction via a Posterior-Mean Diffusion Model
- 2025MDAA-Diff: CT-Guided Multi-Dose Adaptive Attention Diffusion Model for PET Denoising