CP-Agent: Context-Aware Multimodal Reasoning for Cellular Morphological Profiling under Chemical Perturbations
On the map: LLM reasoning → Clinical and biomedical applications
also in 1 more
Abstract (arXiv)
Cell Painting combines multiplexed fluorescent staining, high-content imaging, and quantitative analysis to generate high-dimensional phenotypic readouts to support diverse downstream tasks such as mechanism-of-action (MoA) inference, toxicity prediction, and construction of drug-disease atlases. However, existing workflows are slow, costly and difficult to interpret. Approaches for drug screening modeling predominantly focus on molecular representation learning, while neglecting actual experimental context (e.g., cell line, dosing schedule, etc.), limiting generalization and MoA resolution. We introduce CP-Agent, an agentic multimodal large language model (MLLM) capable of generating mechanism-relevant, human-interpretable rationales for cell morphological changes under drug perturbations. At its core, CP-Agent leverages a context-aware alignment module, CP-CLIP, that jointly embeds high-content images and experimental metadata to enable robust treatment and MoA discrimination (achieving a maximum F1-score of 0.896). By integrating CP-CLIP outputs with agentic tool usage and reasoning, CP-Agent compiles rationales into a structured report to guide experimental design and hypothesis refinement. These capabilities highlight CP-Agent's potential to accelerate drug discovery by enabling more interpretable, scalable, and context-aware phenotypic screening -- streamlining iterative cycles of hypothesis generation in drug discovery.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Clinical and biomedical applications, one of 17 directions in LLM reasoning. Builds on 8 of its 64 references that are in the map. First posted on arXiv 2 Jun 2026.
Builds on
8 of 64 references.
References · 8
- 2024MM-LLMs: Recent Advances in MultiModal Large Language Modelscited by 277
- 2024Large Language Models(LLMs) on Tabular Data: Prediction, Generation, and Understanding -- A Surveycited by 157
- 2025LIDDIA: Language-based Intelligent Drug Discovery Agentcited by 24
- 2024μ-Bench: A Vision-Language Benchmark for Microscopy Understandingcited by 15
- 2024Geneverse: A collection of Open-source Multimodal Large Language Models for Genomic and Proteomic Researchcited by 8
- 2025CellCLIP -- Learning Perturbation Effects in Cell Painting via Text-Guided Contrastive Learningcited by 6
- 2024GenoTEX: An LLM Agent Benchmark for Automated Gene Expression Data Analysiscited by 5
- 2025scI2CL: Effectively Integrating Single-cell Multi-omics by Intra- and Inter-omics Contrastive Learningcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026From Retrieval to Reasoning: Agentic Mechanism Prediction from Cell Painting Profiles
- 2025DrugPilot: LLM-based Parameterized Reasoning Agent for Drug Discovery
- 2026Agentic-J: An AI Agent for Biological Microscopy Image Analysis
- 2026Progressive Multi-Agent Reasoning for Biological Perturbation Prediction
- 2026CodeCytos: AI-assisted spatial molecular imaging analysis via code-augmented agent action space
- 2025LLM Agent Swarm for Hypothesis-Driven Drug Discovery
- 2025A Multi-Agent System Enables Versatile Information Extraction from the Chemical Literature
- 2026MolDeTox: Evaluating Language Model's Stepwise Fragment Editing for Molecular Detoxification