mlsanityData to 14 Oct 2026

CodeCytos: AI-assisted spatial molecular imaging analysis via code-augmented agent action space

arXiv 2606.00472 ↗First posted 30 May 2026cs.CV cs.AI cs.HCcited by 0

Not on the map. Why?

Abstract (arXiv)

Conventional tissue image analysis software provides foundational capabilities for cellular analysis, including segmentation, basic morphological feature extraction, and spatial organization analysis. However, these tools often require manual intervention and are not well integrated with code-driven automation, limiting efficiency and scalability for complex spatial tissue studies. In addition, they offer limited flexibility for custom analyses, as they typically support only a fixed set of pre-implemented spatial cellular features. To address these limitations, we propose CodeCytos, a coding-based reasoning agent framework that enables dynamic, programmable interaction with spatial molecular imaging data to improve automation and customization. CodeCytos is designed to streamline the exploration of custom spatial cellular features and adapt to diverse research needs. We demonstrate its utility through case studies on four expert-curated datasets from distinct tissue types: frontal cortex, non-small-cell lung cancer, pancreas, and tonsil. We evaluate CodeCytos under a realistic minimal prompt setting, where bioscientists pose simple questions without task-specific instructions or contextual information about spatial cellular analysis, and benchmark multiple LLM backbones with strong coding capabilities. We further show that incorporating tailored, domain-agnostic few-shot in-context coding-reasoning examples (randomly sampled demonstrations outside the spatial analysis domain) can substantially improve performance without requiring costly, expert-crafted in-domain demonstrations. Overall, CodeCytos outperforms baseline approaches, highlighting the potential of code-action agents to assist with custom feature exploration in spatial molecular imaging and to accelerate biomarker discovery.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 25 of its 48 references that are in the map. First posted on arXiv 30 May 2026.

Builds on

25 of 48 references.

References · 25

  1. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  2. 2025Qwen3 Technical Reportcited by 8,820
  3. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  4. 2021Evaluating Large Language Models Trained on Codecited by 8,320
  5. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
  6. 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,944
  7. 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,754
  8. 2018FEVER: a large-scale dataset for Fact Extraction and VERificationcited by 1,375
  9. 2022Code as Policies: Language Model Programs for Embodied Controlcited by 1,210
  10. 2020ALFWorld: Aligning Text and Embodied Environments for Interactive Learningcited by 1,205
  11. 2024Qwen2.5-Coder Technical Reportcited by 1,203
  12. 2023SGLang: Efficient Execution of Structured Language Model Programscited by 1,141
13 more
  1. 2022Transformers learn in-context by gradient descentcited by 732
  2. 2022What learning algorithm is in-context learning? Investigations with linear modelscited by 684
  3. 2024Executable Code Actions Elicit Better LLM Agentscited by 564
  4. 2025GLM-4.5: Agentic, Reasoning, and Coding (ARC) Foundation Modelscited by 467
  5. 2025Kimi Linear: An Expressive, Efficient Attention Architecturecited by 196
  6. 2024In-Context Learning with Long-Context Models: An In-Depth Explorationcited by 128
  7. 2023CellViT: Vision Transformers for Precise Cell Segmentation and Classificationcited by 108
  8. 2025CWM: An Open-Weights LLM for Research on Code Generation with World Modelscited by 93
  9. 2025MedRAX: Medical Reasoning Agent for Chest X-raycited by 70
  10. 2025Devstral: Fine-tuning Language Models for Coding Agent Applicationscited by 24
  11. 2022DeepLIIF: An Online Platform for Quantification of Clinical Pathology Slidescited by 9
  12. 2024InstanSeg: an embedding-based instance segmentation algorithm optimized for accurate, efficient and portable cell segmentationcited by 9
  13. 2025NOVA: An Agentic Framework for Automated Histopathology Analysis and Discoverycited by 3

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Agentic-J: An AI Agent for Biological Microscopy Image Analysis
  2. 2026BIABench: Evaluating AI agents on real-world bioimage analysis tasks
  3. 2026How Spatial Biologists Direct and Verify AI-Assisted Analyses ↗
  4. 2026Verifiable Benchmarking of Long-Horizon Spatial Biology
  5. 2025GenCellAgent: Generalizable, Training-Free Cellular Image Segmentation via Large Language Model Agents
  6. 2026CP-Agent: Context-Aware Multimodal Reasoning for Cellular Morphological Profiling under Chemical Perturbations
  7. 2026From Retrieval to Reasoning: Agentic Mechanism Prediction from Cell Painting Profiles
  8. 2025Simple Agents Outperform Experts in Biomedical Imaging Workflow Optimization