ChatGPT-4 with Code Interpreter can be used to solve introductory college-level vector calculus and electromagnetism problems
Not on the map. Why?
Abstract (arXiv)
We evaluated ChatGPT 3.5, 4, and 4 with Code Interpreter on a set of college-level engineering-math and electromagnetism problems, such as those often given to sophomore electrical engineering majors. We selected a set of 13 problems, and had ChatGPT solve them multiple times, using a fresh instance (chat) each time. We found that ChatGPT-4 with Code Interpreter was able to satisfactorily solve most problems we tested most of the time -- a major improvement over the performance of ChatGPT-4 (or 3.5) without Code Interpreter. The performance of ChatGPT was observed to be somewhat stochastic, and we found that solving the same problem N times in new ChatGPT instances and taking the most-common answer was an effective strategy. Based on our findings and observations, we provide some recommendations for instructors and students of classes at this level.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 6 of its 17 references that are in the map. First posted on arXiv 16 Sep 2023.
Builds on
6 of 17 references.
References · 6
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2023Mathematical Capabilities of ChatGPTcited by 268
- 2023SciBench: Evaluating College-Level Scientific Problem-Solving Abilities of Large Language Modelscited by 256
- 2023SciEval: A Multi-Level Large Language Model Evaluation Benchmark for Scientific Researchcited by 115
- 2023Have LLMs Advanced Enough? A Challenging Problem Solving Benchmark For Large Language Modelscited by 77
- 2023Testing GPT-4 with Wolfram Alpha and Code Interpreter plug-ins on math and science problemscited by 12
Built on by
Citing papers per year: 2025: 1.
1 paper.