mlsanityData to 14 Oct 2026

A Comprehensive Review of Large Language Models for Nanophotonics: From Surrogate Modeling to Autonomous Design

arXiv 2608.18279 ↗First posted 18 Aug 2026physics.optics cs.LGcited by 1

Not on the map. Why?

Abstract (arXiv)

Metasurfaces have revolutionized the development of photonic devices by enabling unprecedented precision in light manipulation. However, their design processes are often constrained by computationally expensive simulations and complex high-dimensional design spaces. Although deep learning has accelerated the design process by serving as a surrogate model, it remains constrained by task-specific architectures and lacks universal reasoning capabilities. This review surveys how Large Language Models (LLMs) are adding semantic interfaces, code generation, and tool orchestration to established numerical nanophotonic workflows. We first outline the development from classical neural networks to transformer-based models and their applications in nanophotonic design. We then review the emergence of LLM-related methods in nanophotonics and organize them into two operational modes: surrogate models that treat structure-spectrum mapping as a language task, and agentic systems that have been demonstrated to generate code, orchestrate selected simulation steps, and support closed-loop optimization. Furthermore, to identify future cross-disciplinary opportunities, we briefly explore applications of LLMs in research fields such as materials science and wireless communications. This review concludes by looking ahead to the next generation of multimodal foundation models with physical perception capabilities. In this vision, artificial intelligence is evolving from passive tools into active collaborators, participating in autonomous scientific discovery.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 44 of its 201 references that are in the map. First posted on arXiv 18 Aug 2026.

Builds on

44 of 201 references.

References · 44

  1. 2017Attention Is All You Needcited by 60,361
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  3. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  4. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
  5. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  6. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  7. 2021Evaluating Large Language Models Trained on Codecited by 8,320
  8. 2023Visual Instruction Tuningcited by 7,869
  9. 2020Scaling Laws for Neural Language Modelscited by 6,586
  10. 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,386
  11. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
  12. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,182
32 more
  1. 2021On the Opportunities and Risks of Foundation Modelscited by 4,033
  2. 2022FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenesscited by 3,673
  3. 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,442
  4. 2020Longformer: The Long-Document Transformercited by 3,413
  5. 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,211
  6. 2022Training Compute-Optimal Large Language Modelscited by 3,019
  7. 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,908
  8. 2023A Survey of Large Language Modelscited by 2,576
  9. 2022Emergent Abilities of Large Language Modelscited by 2,512
  10. 2023A Survey on Large Language Model based Autonomous Agentscited by 2,242
  11. 2023Retrieval-Augmented Generation for Large Language Models: A Surveycited by 2,212
  12. 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,988
  13. 2019Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelismcited by 1,868
  14. 2020Rethinking Attention with Performerscited by 1,601
  15. 2023GenEval: An Object-Focused Framework for Evaluating Text-to-Image Alignmentcited by 972
  16. 2022A Survey on In-context Learningcited by 721
  17. 2024Parameter-Efficient Fine-Tuning for Large Models: A Comprehensive Surveycited by 656
  18. 2024Large Language Models: A Surveycited by 525
  19. 2025Model Context Protocol (MCP): Landscape, Security Threats, and Future Research Directionscited by 265
  20. 2023T2I-CompBench++: An Enhanced and Comprehensive Benchmark for Compositional Text-to-image Generationcited by 260
  21. 2024LLMs Can't Plan, But Can Help Planning in LLM-Modulo Frameworkscited by 179
  22. 2023Scaling Down to Scale Up: A Guide to Parameter-Efficient Fine-Tuningcited by 173
  23. 2024HoneyComb: A Flexible LLM-Based Agent System for Materials Sciencecited by 57
  24. 2018Universal Language Model Fine-tuning for Text Classificationcited by 52
  25. 2024Low-Rank Adaptation for Foundation Models: A Comprehensive Reviewcited by 37
  26. 2014Generative Adversarial Networkscited by 33
  27. 2023Large Language Models as Master Key: Unlocking the Secrets of Materials Science with GPTcited by 30
  28. 2025Neuro-Symbolic Generative Diffusion Models for Physically Grounded, Robust, and Safe Generationcited by 10
  29. 2025PriM: Principle-Inspired Material Discovery through Multi-Agent Collaborationcited by 7
  30. 2025UniMate: A Unified Model for Mechanical Metamaterial Generation, Property Prediction, and Condition Confirmationcited by 2
  31. 2025CoSP: Reconfigurable Multi-State Metamaterial Inverse Design via Contrastive Pretrained Large Language Modelcited by 1
  32. 2025Meta-GPT: Decoding the Metasurface Genome with Generative Artificial Intelligencecited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025A multi-agentic framework for real-time, autonomous freeform metasurface design
  2. 2026HALO: A Physics-Aware LLM Agent Framework for Nanophotonic Design
  3. 2025An Agentic Framework for Autonomous Metamaterial Modeling and Inverse Design
  4. 2026OPTIAGENT: A Physics-Driven Agentic Framework for Automated Optical Design
  5. 2024Self-driving lab discovers principles for steering spontaneous emission
  6. 2024Map Optical Properties to Subwavelength Structures Directly via a Diffusion Model
  7. 2026OLEDLM: A Unified Language Model for OLED Molecular Design
  8. 2022NeurOLight: A Physics-Agnostic Neural Operator Enabling Parametric Photonic Device Simulation