Synergistic Vision-Language Reinforcement Enables Scalable On-Demand Analysis across Diverse Clinical Tasks

Accurate segmentation of tumors and organs-at-risk is essential for oncology but remains time-consuming and expertise-intensive. Existing AI systems often require manual spatial prompts or task-specific retraining, while generic class labels provide limited guidance for heterogeneous disease targets. Here we present SyRe, a text-prompted segmentation foundation model based on Synergistic vision-language Reinforcement, which strengthens bidirectional interaction between visual and linguistic representations. We introduce Color Region Description (CRD) to generate region-level semantic supervision and construct SyReData, comprising 20 million image-mask-description triplets across 9 modalities and 229 segmentation tasks. Training with diversified prompt formats enables single-target, multi-target and open-ended segmentation, together with invalid-prompt rejection. SyRe achieves accurate segmentation across diverse clinical scenarios, with strong gains on disease-related targets. Evaluation on 28 unseen external datasets, including 17 cancer types, 3 non-cancer diseases and multinational in-house cohorts, demonstrates generalization under distribution shift. Beyond spatial overlap, SyRe-generated masks preserve quantitative pathology information. Across five retrospective tumor imaging cohorts spanning CT and MRI, radiomics derived from these masks stratify survival and improve prognostic modeling over clinical baselines. Clinician-in-the-loop refinement further supports case-level correction. These results establish SyRe as a generalizable framework for scalable quantitative oncology analysis and clinician-guided segmentation.