A Comprehensive Review of Large Language Models for Nanophotonics: From Surrogate Modeling to Autonomous Design
Not on the map. Why?
Abstract (arXiv)
Metasurfaces have revolutionized the development of photonic devices by enabling unprecedented precision in light manipulation. However, their design processes are often constrained by computationally expensive simulations and complex high-dimensional design spaces. Although deep learning has accelerated the design process by serving as a surrogate model, it remains constrained by task-specific architectures and lacks universal reasoning capabilities. This review surveys how Large Language Models (LLMs) are adding semantic interfaces, code generation, and tool orchestration to established numerical nanophotonic workflows. We first outline the development from classical neural networks to transformer-based models and their applications in nanophotonic design. We then review the emergence of LLM-related methods in nanophotonics and organize them into two operational modes: surrogate models that treat structure-spectrum mapping as a language task, and agentic systems that have been demonstrated to generate code, orchestrate selected simulation steps, and support closed-loop optimization. Furthermore, to identify future cross-disciplinary opportunities, we briefly explore applications of LLMs in research fields such as materials science and wireless communications. This review concludes by looking ahead to the next generation of multimodal foundation models with physical perception capabilities. In this vision, artificial intelligence is evolving from passive tools into active collaborators, participating in autonomous scientific discovery.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 44 of its 201 references that are in the map. First posted on arXiv 18 Aug 2026.
Builds on
44 of 201 references.
References · 44
- 2017Attention Is All You Needcited by 60,361
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2021Evaluating Large Language Models Trained on Codecited by 8,320
- 2023Visual Instruction Tuningcited by 7,869
- 2020Scaling Laws for Neural Language Modelscited by 6,586
- 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,386
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,182
32 more
- 2021On the Opportunities and Risks of Foundation Modelscited by 4,033
- 2022FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenesscited by 3,673
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,442
- 2020Longformer: The Long-Document Transformercited by 3,413
- 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,211
- 2022Training Compute-Optimal Large Language Modelscited by 3,019
- 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,908
- 2023A Survey of Large Language Modelscited by 2,576
- 2022Emergent Abilities of Large Language Modelscited by 2,512
- 2023A Survey on Large Language Model based Autonomous Agentscited by 2,242
- 2023Retrieval-Augmented Generation for Large Language Models: A Surveycited by 2,212
- 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,988
- 2019Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelismcited by 1,868
- 2020Rethinking Attention with Performerscited by 1,601
- 2023GenEval: An Object-Focused Framework for Evaluating Text-to-Image Alignmentcited by 972
- 2022A Survey on In-context Learningcited by 721
- 2024Parameter-Efficient Fine-Tuning for Large Models: A Comprehensive Surveycited by 656
- 2024Large Language Models: A Surveycited by 525
- 2025Model Context Protocol (MCP): Landscape, Security Threats, and Future Research Directionscited by 265
- 2023T2I-CompBench++: An Enhanced and Comprehensive Benchmark for Compositional Text-to-image Generationcited by 260
- 2024LLMs Can't Plan, But Can Help Planning in LLM-Modulo Frameworkscited by 179
- 2023Scaling Down to Scale Up: A Guide to Parameter-Efficient Fine-Tuningcited by 173
- 2024HoneyComb: A Flexible LLM-Based Agent System for Materials Sciencecited by 57
- 2018Universal Language Model Fine-tuning for Text Classificationcited by 52
- 2024Low-Rank Adaptation for Foundation Models: A Comprehensive Reviewcited by 37
- 2014Generative Adversarial Networkscited by 33
- 2023Large Language Models as Master Key: Unlocking the Secrets of Materials Science with GPTcited by 30
- 2025Neuro-Symbolic Generative Diffusion Models for Physically Grounded, Robust, and Safe Generationcited by 10
- 2025PriM: Principle-Inspired Material Discovery through Multi-Agent Collaborationcited by 7
- 2025UniMate: A Unified Model for Mechanical Metamaterial Generation, Property Prediction, and Condition Confirmationcited by 2
- 2025CoSP: Reconfigurable Multi-State Metamaterial Inverse Design via Contrastive Pretrained Large Language Modelcited by 1
- 2025Meta-GPT: Decoding the Metasurface Genome with Generative Artificial Intelligencecited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025A multi-agentic framework for real-time, autonomous freeform metasurface design
- 2026HALO: A Physics-Aware LLM Agent Framework for Nanophotonic Design
- 2025An Agentic Framework for Autonomous Metamaterial Modeling and Inverse Design
- 2026OPTIAGENT: A Physics-Driven Agentic Framework for Automated Optical Design
- 2024Self-driving lab discovers principles for steering spontaneous emission
- 2024Map Optical Properties to Subwavelength Structures Directly via a Diffusion Model
- 2026OLEDLM: A Unified Language Model for OLED Molecular Design
- 2022NeurOLight: A Physics-Agnostic Neural Operator Enabling Parametric Photonic Device Simulation