mlsanityData to 7 Oct 2026

HALO: A Physics-Aware LLM Agent Framework for Nanophotonic Design

arXiv 2608.28877 ↗First posted 28 Aug 2026physics.optics cs.MAcited by 0

On the map: LLM agents and tool use → Medical and scientific domain agents

Abstract (arXiv)

Language models have recently been applied to nanophotonic design, but it remains unclear whether they can reliably translate optical objectives into simulation-ready designs, execute electromagnetic analysis, and revise decisions from numerical feedback. We introduce HALO, a physics-aware framework that couples language-model planners with typed design specifications, electromagnetic simulation, diagnostic evaluation, and optional reuse of prior failure trajectories in an iterative design loop. We further introduce HALO-Bench, a 52-task benchmark spanning lab-derived, paper-derived, and open-ended nanophotonic design tasks under a shared evaluation protocol. We compare three planner configurations: a Fixed Structured Workflow, an Autonomous Structured Agent using the same simulation interface, and an Autonomous Coding Agent that directly writes and executes simulation code. The Fixed Structured Workflow is the most token-efficient and exhibits no observed code- or path-level failures, while autonomous coding can achieve higher task success with stronger models at the cost of additional operational failures. We also study reuse of prior failed trajectories. On targeted multi-round tasks, retrieved failure feedback reduces both iterations to first success and total token use. These results clarify the tradeoffs between explicit interfaces, autonomous execution, and reusable design experience in scientific agents.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Medical and scientific domain agents, one of 16 directions in LLM agents and tool use. Builds on 16 of its 42 references that are in the map. First posted on arXiv 28 Aug 2026.

Builds on

16 of 42 references.

Closest ancestors · 1

Same direction, newest first

  1. 2025Toward Greater Autonomy in Materials Discovery Agents: Unifying Planning, Physics, and Scientists5 Jun

Other references · 15

  1. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  2. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
  3. 2024The AI Scientist: Towards Fully Automated Open-Ended Scientific Discoverycited by 1,002
  4. 2025PaperBench: Evaluating AI's Ability to Replicate AI Researchcited by 286
  5. 2024ScienceAgentBench: Toward Rigorous Assessment of Language Agents for Data-Driven Scientific Discoverycited by 208
  6. 2023MatSci-NLP: Evaluating Scientific Language Models on Materials Science Language Tasks Using Text-to-Schema Modelingcited by 35
  7. 2019Global optimization of dielectric metasurfaces using a physics-driven neural networkcited by 30
  8. 2025A multi-agentic framework for real-time, autonomous freeform metasurface designcited by 14
  9. 2025GeoGramBench: Benchmarking the Geometric Program Reasoning in Modern LLMscited by 13
  10. 2025FloorplanQA: A Benchmark for Spatial Reasoning in LLMs using Structured Representationscited by 13
  11. 2020A Generative Machine Learning-Based Approach for Inverse Design of Multilayer Metasurfacescited by 10
  12. 2025An Agentic Framework for Autonomous Metamaterial Modeling and Inverse Designcited by 8
3 more
  1. 2025Chat to Chip: Large Language Model Based Design of Arbitrarily Shaped Metasurfacescited by 4
  2. 2025Re4: Scientific Computing Agent with Rewriting, Resolution, Review and Revisioncited by 2
  3. 2026OPTIAGENT: A Physics-Driven Agentic Framework for Automated Optical Designcited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026A Comprehensive Review of Large Language Models for Nanophotonics: From Surrogate Modeling to Autonomous Design
  2. 2026PICopilot: An LLM-based Agentic Framework for Assisting Photonic Integrated Circuit Design via Script Generation
  3. 2026VortexChat: An agentic framework for autonomous multi-objective integrated photonic design
  4. 2025AI Agents for Photonic Integrated Circuit Design Automation
  5. 2026LensDesigner: A Self-Improving Agent for Optical Lens Design
  6. 2026A Self-Evolving Agentic Framework for Metasurface Inverse Design
  7. 2026Learning Design Skills as Memory Policies for Agentic Photonic Inverse Design
  8. 2026AbsorbEvo: An Agentic Framework for Autonomous Inverse Design of Microwave Absorbers