Imaging-101: Benchmarking LLM Coding Agents on Scientific Computational Imaging
On the map: LLM agents and tool use → Medical and scientific domain agents
Abstract (arXiv)
Computational imaging, which recovers hidden signals from indirect, noisy measurements, underpins quantitative discovery across scientific disciplines, yet building a correct reconstruction pipeline demands deep domain expertise and remains laborious even for domain scientists. We introduce Imaging-101, a benchmark of 57 expert-verified computational imaging tasks spanning six scientific domains, each grounded in a peer-reviewed paper and canonicalized into a standardized four-stage pipeline (preprocessing, forward physics modeling, inverse solver, and visualization) Three evaluation tracks (planning, function-level unit tests, and end-to-end reconstruction) probe distinct agent capabilities across the full pipeline. Evaluating seven frontier LLMs uncovers systematic challenges in applying coding agents to computational imaging that go beyond those exposed by general coding benchmarks, spanning algorithm selection, physical convention handling, and pipeline integration. These findings highlight concrete capability gaps and point toward skill-augmented, domain-specialized agents as a practical path to reliable computational imaging assistance.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Medical and scientific domain agents, one of 16 directions in LLM agents and tool use. Builds on 23 of its 53 references that are in the map. First posted on arXiv 12 Jul 2026.
Builds on
23 of 53 references.
Closest ancestors · 1
Same direction, newest first
Other references · 22
- 2021Evaluating Large Language Models Trained on Codecited by 8,320
- 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,373
- 2023GPQA: A Graduate-Level Google-Proof Q&A Benchmarkcited by 2,879
- 2023HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging Facecited by 1,190
- 2024Chatbot Arena: An Open Platform for Evaluating LLMs by Human Preferencecited by 1,184
- 2023ChemCrow: Augmenting large-language models with chemistry toolscited by 631
- 2024BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructionscited by 546
- 2024MLE-bench: Evaluating Machine Learning Agents on Machine Learning Engineeringcited by 469
- 2023SciBench: Evaluating College-Level Scientific Problem-Solving Abilities of Large Language Modelscited by 256
- 2024ScienceAgentBench: Toward Rigorous Assessment of Language Agents for Data-Driven Scientific Discoverycited by 235
- 2024SciCode: A Research Coding Benchmark Curated by Scientistscited by 178
- 2024BLADE: Benchmarking Language Model Agents for Data-Driven Sciencecited by 77
10 more
- 2024Hypothesis Generation with Large Language Modelscited by 71
- 2025PHYBench: Holistic Evaluation of Physical Perception and Reasoning in Large Language Modelscited by 61
- 2025ScienceBoard: Evaluating Multimodal Autonomous Agents in Realistic Scientific Workflowscited by 52
- 2025LLMs are Greedy Agents: Effects of RL Fine-tuning on Decision-Making Abilitiescited by 41
- 2015Experimental robustness of Fourier Ptychography phase retrieval algorithmscited by 14
- 2025AstroVisBench: A Code Benchmark for Scientific Computing and Visualization in Astronomycited by 13
- 2019Optimization methods for MR image reconstruction (long version)cited by 3
- 2023PtyLab.m/py/jl: a cross-platform, open-source inverse modeling toolbox for conventional and Fourier ptychographycited by 1
- 2025Spatiotemporal Maps for Dynamic MRI Reconstructioncited by 1
- 2025Local Patches Meet Global Context: Scalable 3D Diffusion Priors for Computed Tomography Reconstructioncited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Does AI Understand Imaging? A Systematic Benchmark of Agentic AI for Computational Imaging Tasks
- 2026PhysCodeGym: Benchmarking Coding Agents for Physically Verifiable 4D Reconstruction
- 2025Simple Agents Outperform Experts in Biomedical Imaging Workflow Optimization
- 2026Can Coding Agents Build Robust Baselines? A Skill-Based Approach for Automating the Medical Imaging Model-Development Pipeline
- 2025ReX-MLE: The Autonomous Agent Benchmark for Medical Imaging Challenges
- 2026Agentic Autoresearch for CT Reconstruction
- 2026Can Coding Agents Reproduce Findings in Computational Materials Science?
- 2026ReFigBench: Benchmarking Scientific Figure Reconstruction as Editable PowerPoint Artifacts