TC-SSA: Token Compression via Semantic Slot Aggregation for Gigapixel Pathology Reasoning
On the map: LLM reasoning → Clinical and biomedical applications
also in 2 more
Abstract (arXiv)
The application of large vision-language models to computational pathology holds great promise for diagnostic assistants but faces a critical computational bottleneck: the gigapixel scale of Whole Slide Images (WSIs). A single WSI typically contains over 105 patches, creating sequence lengths that exceed the constraints of standard Transformer architectures. Existing solutions often resort to spatial sampling, which risks discarding diagnostically critical evidence. To address this, we propose TC-SSA (Token Compression via Semantic Slot Aggregation), a learnable token compression framework that aggregates patch features into a fixed number of semantic slots. A gated routing module assigns patches to slots using sparse Top-2 routing, followed by weighted aggregation, enabling global slide coverage under a strict token budget. The resulting representation retains diagnostically relevant information while reducing the number of visual tokens to 1.7% of the original sequence. On the SlideBench(TCGA), our model achieves 78.34% overall accuracy and 77.14% on the diagnosis subset, outperforming sampling-based baselines under comparable token budgets. The method also generalizes to MIL classification, reaching AUC of 95.83% on TCGA-BRCA, 98.27% on TCGA-NSCLC and 79.80% on PANDA. These results suggest that learnable semantic aggregation provides an effective trade-off between efficiency and diagnostic performance for gigapixel pathology reasoning.
Key facts. Cited by 17 papers in the map (data through 7 Oct 2026). Placed in Clinical and biomedical applications, one of 17 directions in LLM reasoning. Builds on 7 of its 35 references that are in the map. First posted on arXiv 1 Mar 2026.
Builds on
7 of 35 references.
References · 7
- 2024GPT-4o System Cardcited by 4,467
- 2025Fewer Tokens, Greater Scaling: Self-Adaptive Visual Bases for Efficient and Expansive Representation Learningcited by 16
- 2023Learning A Multi-Task Transformer Via Unified And Customized Instruction Tuning For Chest Radiograph Interpretationcited by 14
- 2025Drift-aware Collaborative Assistance Mixture of Experts for Heterogeneous Multistream Learningcited by 14
- 2025Resilient Contrastive Pre-training under Non-Stationary Driftcited by 7
- 2025LoC-Path: Learning to Compress for Pathology Multimodal Large Language Modelscited by 6
- 2025Turning Drift into Constraint: Robust Reasoning Alignment in Non-Stationary Multi-Stream Environmentscited by 5
Built on by
Citing papers per year: 2026: 17.
17 papers.
Sort:
By area:
- 2026The Model Knows Which Tokens Matter: Automatic Token Selection via Noise Gatingcited by 11
- 2026Efficient Chest X-ray Representation Learning via Semantic-Partitioned Contrastive Learningcited by 10
- 2026Beyond Surrogate Gradients: Fully Differentiable Token Pruning for Vision-Language Modelscited by 7
- 2026Multimodal Model for Computational Pathology:Representation Learning and Image Compressioncited by 6
- 2026XrayClaw: Cooperative-Competitive Multi-Agent Alignment for Trustworthy Chest X-ray Diagnosiscited by 5
- 2026A unified multi-task framework enables interpretable chest radiograph analysiscited by 5
- 2026Stepwise Token Selection for Efficient Multimodal Large Language Modelscited by 5
- 2026Learnable Token Sparsification for Efficient Gigapixel Whole Slide Image Reasoningcited by 4
- 2026Towards Robust Endogenous Reasoning: Unifying Drift Adaptation in Non-Stationary Tuningcited by 2
- 2026PathSelect: Sequential Token Selection for Whole Slide Pathologycited by 2
- 2026DiffPrune: differentiable information throttling for token pruning in vision-language modelscited by 1
- 2026From Snapshots to Symphonies: The Evolution of Protein Prediction from Static Structures to Generative Dynamics and Multimodal Interactionscited by 0
5 more
- 2026Autonomous Drift Learning in Data Streams: A Unified Perspectivecited by 0
- 2026Gated Spatial Redundancy Projection for Pathology Transformer Attentionscited by 0
- 2026StepPrune: Adaptive Sequential Visual Token Selection across Multimodal Large Language Modelscited by 0
- 2026SLICEChat: Progressive In-Encoder Token Pruning for Whole-Slide Pathology Language Modelscited by 0
- 2026MedTokenBudget: Lesion-Preserving Token Routing for Dermoscopic Image Classificationcited by 0
- 2026MedTokenBudget: Lesion-Preserving Token Routing for Dermoscopic Image Classification24 Sep 2026
- 2026SLICEChat: Progressive In-Encoder Token Pruning for Whole-Slide Pathology Language Models21 Sep 2026
- 2026StepPrune: Adaptive Sequential Visual Token Selection across Multimodal Large Language Models12 Sep 2026
- 2026Gated Spatial Redundancy Projection for Pathology Transformer Attentions8 Aug 2026
- 2026DiffPrune: differentiable information throttling for token pruning in vision-language models3 Aug 2026
- 2026PathSelect: Sequential Token Selection for Whole Slide Pathology26 Jul 2026
- 2026Stepwise Token Selection for Efficient Multimodal Large Language Models14 Jun 2026
- 2026Learnable Token Sparsification for Efficient Gigapixel Whole Slide Image Reasoning7 Jun 2026
- 2026A unified multi-task framework enables interpretable chest radiograph analysis2 Jun 2026
- 2026Beyond Surrogate Gradients: Fully Differentiable Token Pruning for Vision-Language Models27 May 2026
- 2026Autonomous Drift Learning in Data Streams: A Unified Perspective2 May 2026
- 2026Towards Robust Endogenous Reasoning: Unifying Drift Adaptation in Non-Stationary Tuning17 Apr 2026
5 more
- 2026XrayClaw: Cooperative-Competitive Multi-Agent Alignment for Trustworthy Chest X-ray Diagnosis3 Apr 2026
- 2026Multimodal Model for Computational Pathology:Representation Learning and Image Compression19 Mar 2026
- 2026From Snapshots to Symphonies: The Evolution of Protein Prediction from Static Structures to Generative Dynamics and Multimodal Interactions19 Mar 2026
- 2026The Model Knows Which Tokens Matter: Automatic Token Selection via Noise Gating7 Mar 2026
- 2026Efficient Chest X-ray Representation Learning via Semantic-Partitioned Contrastive Learning7 Mar 2026
- 2026The Model Knows Which Tokens Matter: Automatic Token Selection via Noise Gatingcited by 11
- 2026Beyond Surrogate Gradients: Fully Differentiable Token Pruning for Vision-Language Modelscited by 7
- 2026Stepwise Token Selection for Efficient Multimodal Large Language Modelscited by 5
- 2026PathSelect: Sequential Token Selection for Whole Slide Pathologycited by 2
- 2026DiffPrune: differentiable information throttling for token pruning in vision-language modelscited by 1
- 2026StepPrune: Adaptive Sequential Visual Token Selection across Multimodal Large Language Modelscited by 0
- 2026SLICEChat: Progressive In-Encoder Token Pruning for Whole-Slide Pathology Language Modelscited by 0
- 2026SLICEChat: Progressive In-Encoder Token Pruning for Whole-Slide Pathology Language Models21 Sep 2026
- 2026StepPrune: Adaptive Sequential Visual Token Selection across Multimodal Large Language Models12 Sep 2026
- 2026DiffPrune: differentiable information throttling for token pruning in vision-language models3 Aug 2026
- 2026PathSelect: Sequential Token Selection for Whole Slide Pathology26 Jul 2026
- 2026Stepwise Token Selection for Efficient Multimodal Large Language Models14 Jun 2026
- 2026Beyond Surrogate Gradients: Fully Differentiable Token Pruning for Vision-Language Models27 May 2026
- 2026The Model Knows Which Tokens Matter: Automatic Token Selection via Noise Gating7 Mar 2026
- 2026Efficient Chest X-ray Representation Learning via Semantic-Partitioned Contrastive Learningcited by 10
- 2026Multimodal Model for Computational Pathology:Representation Learning and Image Compressioncited by 6
- 2026XrayClaw: Cooperative-Competitive Multi-Agent Alignment for Trustworthy Chest X-ray Diagnosiscited by 5
- 2026A unified multi-task framework enables interpretable chest radiograph analysiscited by 5
- 2026From Snapshots to Symphonies: The Evolution of Protein Prediction from Static Structures to Generative Dynamics and Multimodal Interactionscited by 0
- 2026Autonomous Drift Learning in Data Streams: A Unified Perspectivecited by 0
- 2026Gated Spatial Redundancy Projection for Pathology Transformer Attentionscited by 0
- 2026MedTokenBudget: Lesion-Preserving Token Routing for Dermoscopic Image Classificationcited by 0
- 2026MedTokenBudget: Lesion-Preserving Token Routing for Dermoscopic Image Classification24 Sep 2026
- 2026Gated Spatial Redundancy Projection for Pathology Transformer Attentions8 Aug 2026
- 2026A unified multi-task framework enables interpretable chest radiograph analysis2 Jun 2026
- 2026Autonomous Drift Learning in Data Streams: A Unified Perspective2 May 2026
- 2026XrayClaw: Cooperative-Competitive Multi-Agent Alignment for Trustworthy Chest X-ray Diagnosis3 Apr 2026
- 2026Multimodal Model for Computational Pathology:Representation Learning and Image Compression19 Mar 2026
- 2026From Snapshots to Symphonies: The Evolution of Protein Prediction from Static Structures to Generative Dynamics and Multimodal Interactions19 Mar 2026
- 2026Efficient Chest X-ray Representation Learning via Semantic-Partitioned Contrastive Learning7 Mar 2026
Similar, not cited
Close in wording, no citation either way
- 2025Efficient Whole Slide Pathology VQA via Token Compression
- 2026Simple Token-Efficient Vision-Language Model for Case-level Pathology Synoptic Report Generation
- 2024SlideChat: A Large Vision-Language Assistant for Whole-Slide Pathology Image Understanding
- 2025LanGuSTE: Language-Guided Coarse-to-Fine Patch Selection for Efficient Whole Slide Image Analysis
- 2026MLLM-HWSI: A Multimodal Large Language Model for Hierarchical Whole Slide Image Understanding
- 2026Reducing Redundancy in Whole-Slide Image Patching for Scalable Indexing and Retrieval
- 2026Decomposing Whole Slide Image Report Generation with Graph-Constrained Multiple Instance Learning Workflows
- 2026Exploiting Spatial Structure for Transductive Few-Shot Classification of Whole-Slide Images