mlsanityData to 13 Oct 2026

Learning Electromagnetic Metamaterial Physics With ChatGPT

arXiv 2404.15458 ↗First posted 23 Apr 2024physics.optics cs.LGcited by 6

Not on the map. Why?

Abstract (arXiv)

Large language models (LLMs) such as ChatGPT, Gemini, LlaMa, and Claude are trained on massive quantities of text parsed from the internet and have shown a remarkable ability to respond to complex prompts in a manner often indistinguishable from humans. For all-dielectric metamaterials consisting of unit cells with four elliptical resonators, we present a LLM fine-tuned on up to 40,000 data that can predict the absorptivity spectrum given a text prompt that only specifies the metasurface geometry. Results are compared to conventional machine learning approaches including feed-forward neural networks, random forest, linear regression, and K-nearest neighbor (KNN). Remarkably, the fine-tuned LLM (FT-LLM) achieves a comparable performance across large dataset sizes with a deep neural network. We also explore inverse problems by asking the LLM to predict the geometry necessary to achieve a desired spectrum. LLMs possess several advantages over humans that may give them benefits for research, including the ability to process enormous amounts of data, find hidden patterns in data, and operate in higher-dimensional spaces. This suggests they may be able to leverage their general knowledge of the world to learn faster from training data than traditional models, making them valuable tools for research and analysis.

Key facts. Cited by 6 papers in the map (data through 13 Oct 2026). Builds on 19 of its 64 references that are in the map. First posted on arXiv 23 Apr 2024.

Builds on

19 of 64 references.

References · 19

  1. 2017Attention Is All You Needcited by 60,106
  2. 2020Language Models are Few-Shot Learnerscited by 32,320
  3. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,376
  4. 2023Visual Instruction Tuningcited by 7,827
  5. 2022Large Language Models are Zero-Shot Reasonerscited by 4,348
  6. 2023A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questionscited by 1,594
  7. 2023A Survey on Evaluation of Large Language Modelscited by 1,236
  8. 2023An Empirical Study of Catastrophic Forgetting in Large Language Models During Continual Fine-tuningcited by 630
  9. 2021Interpretable Machine Learning: Fundamental Principles and 10 Grand Challengescited by 365
  10. 2022LIFT: Language-Interfaced Fine-Tuning for Non-Language Machine Learning Taskscited by 146
  11. 202314 Examples of How LLMs Can Transform Materials Science and Chemistry: A Reflection on a Large Language Model Hackathoncited by 86
  12. 2017Beyond Sparsity: Tree Regularization of Deep Models for Interpretabilitycited by 68
7 more
  1. 2020Deep neural networks for the evaluation and design of photonic devicescited by 50
  2. 2019Global optimization of dielectric metasurfaces using a physics-driven neural networkcited by 30
  3. 2023MeLM, a generative pretrained language modeling framework that solves forward and inverse mechanics problemscited by 29
  4. 2023A neural operator-based surrogate solver for free-form electromagnetic inverse designcited by 18
  5. 2023OptoGPT: A Foundation Model for Inverse Design in Optical Multilayer Thin Film Structurescited by 13
  6. 2021Inverse deep learning methods and benchmarks for artificial electromagnetic material designcited by 10
  7. 2021Deep learning-based design of broadband GHz complex and random metasurfacescited by 6

Built on by

Cited by year (2026 to 13 Oct)

Citing papers per year: 2025: 3; 2026: 3.

6 papers.