TopoAgent: An Agentic Framework for Automated Topology Learning in Medical Imaging
Not on the map. Why?
Abstract (arXiv)
Topological data analysis (TDA), particularly persistent homology (PH), captures geometric structural properties in medical images (e.g., connected components, loops, shape characteristics), which conventional pixel-level deep learning approaches often neglect. While many topological descriptors are known for converting persistence diagrams (PDs) or raw images into topological feature vectors, existing methods mostly default to a single fixed descriptor (e.g., persistence images), leaving the diversity of topological representations largely unexplored. To the best of our knowledge, there is no known large language model (LLM)-based agentic framework that can automatically determine the most suitable topological descriptors for a given image dataset and produce the corresponding topological feature vectors for downstream tasks. To fill this gap, we propose TopoAgent, an LLM-based agentic framework that automates topology learning for medical image analysis.TopoAgent operates through a Perception--Reasoning--Action--Reflection loop supported by 21 domain-specific tools and dual memory that accumulates experience across runs. Its skill set is distilled from systematic evaluation of 15 topological descriptors across 26 datasets with six classifiers. TopoAgent analyzes input images and their topological characteristics, reasons about which topological descriptors best suit the input, and determines the optimal descriptor and its configuration, all without task-specific training.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 38 of its 75 references that are in the map. First posted on arXiv 29 Jun 2026.
Builds on
38 of 75 references.
References · 38
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,166
- 2024GPT-4o System Cardcited by 4,588
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
- 2023A Survey on Large Language Model based Autonomous Agentscited by 2,242
- 2023The Rise and Potential of Large Language Model Based Agents: A Surveycited by 1,439
- 2021Swin Transformer V2: Scaling Up Capacity and Resolutioncited by 1,228
- 2015Persistence Images: A Stable Vector Representation of Persistent Homologycited by 236
- 2025TabArena: A Living Benchmark for Machine Learning on Tabular Datacited by 176
- 2019PersLay: A Neural Network Layer for Persistence Diagrams and New Graph Topological Signaturescited by 126
26 more
- 2024TabM: Advancing Tabular Deep Learning with Parameter-Efficient Ensemblingcited by 113
- 2024MMedAgent: Learning to Use Medical Tools with Multi-modal Agentcited by 109
- 2024Better by Default: Strong Pre-Tuned MLPs and Boosted Trees on Tabular Datacited by 92
- 2025MedAgent-Pro: Towards Evidence-based Multi-modal Medical Diagnosis via Reasoning Agentic Workflowcited by 73
- 2025MedRAX: Medical Reasoning Agent for Chest X-raycited by 70
- 2023Topological Deep Learning: A Review of an Emerging Paradigmcited by 34
- 2025MedEyes: Learning Dynamic Visual Focus for Medical Progressive Diagnosiscited by 32
- 2025Pathology-Aware Prototype Evolution via LLM-Driven Semantic Disambiguation for Multicenter Diabetic Retinopathy Diagnosiscited by 22
- 2026MedSynapse-V: Bridging Visual Perception and Clinical Intuition via Latent Memory Evolutioncited by 12
- 2019Approximating Continuous Functions on Persistence Diagrams Using Template Functionscited by 10
- 2025Topological Signatures vs. Gradient Histograms: A Comparative Study for Medical Image Classificationcited by 10
- 2025ANTS: Adaptive Negative Textual Space Shaping for OOD Detection via Test-Time MLLM Understanding and Reasoningcited by 10
- 2023PHG-Net: Persistent Homology Guided Medical Image Classificationcited by 9
- 2024A Psychology-based Unified Dynamic Framework for Curriculum Learningcited by 6
- 2026When Models Learn to Ask Why: Adaptive Causal Reasoning for Trustworthy Medical Vision-Language Modelscited by 6
- 2025Topo-VM-UNetV2: Encoding Topology into Vision Mamba UNet for Polyp Segmentationcited by 5
- 2026I2E: From Image Pixels to Actionable Interactive Environments for Text-Guided Image Editingcited by 5
- 2026Not Just What's There: Enabling CLIP to Comprehend Negated Visual Descriptions Without Fine-tuningcited by 5
- 2025A Stable and Theoretically Grounded Gromov-Wasserstein Distance for Reeb Graph Comparison using Persistence Imagescited by 4
- 2026TopoCL: Topological Contrastive Learning for Medical Imagingcited by 4
- 2023ChatGPT for Computational Topologycited by 3
- 2024Efficient approximation of Earth Mover's Distance Based on Nearest Neighbor Searchcited by 3
- 2025Cell Instance Segmentation: The Devil Is in the Boundariescited by 3
- 2025fMRI2GES: Co-speech Gesture Reconstruction from fMRI Signal with Dual Brain Decoding Alignmentcited by 3
- 2025Integrating Multi-scale and Multi-filtration Topological Features for Medical Image Classificationcited by 2
- 2026Anatomy-Anchored Self-Supervision: Distilling Vision Foundation Models for Invariant Ultrasound Representationcited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026TubeMLLM: A Foundation Model for Topology Knowledge Exploration in Vessel-like Anatomy
- 2026Topo-R1: Detecting Topological Anomalies via Vision-Language Models
- 2024TopoDiffusionNet: A Topology-aware Diffusion Model
- 2026TopoAgent: A Structure-Aware Perception-to-Reasoning Framework for Diagram-to-Graph Topology Extraction with Large Vision-Language Models
- 2025REACT-KD: Region-Aware Cross-modal Topological Knowledge Distillation for Interpretable Medical Image Classification
- 2024TPIE: Topology-Preserved Image Editing With Text Instructions
- 2026Agentic Large Language Models for Training-Free Neuro-Radiological Image Analysis
- 2026TopoMamba: Topology-Aware Scanning and Fusion for Segmenting Heterogeneous Medical Visual Media