mlsanityData to 7 Oct 2026

Electronic Circuit Principles of Large Language Models

arXiv 2502.03325 ↗First posted 5 Feb 2025cs.CL cs.AIcited by 4

On the map: LLM reasoning → Reasoning benchmarks and evaluation

Abstract (arXiv)

Large language models (LLMs) such as DeepSeek-R1 have achieved remarkable performance across diverse reasoning tasks. To uncover the principles that govern their behaviour, we introduce the Electronic Circuit Principles (ECP), which maps inference-time learning (ITL) onto a semantic electromotive force and inference-time reasoning (ITR) onto a resistive network governed by Ohm's and Faraday's laws. This circuit-based modelling yields closed-form predictions of task performance and reveals how modular prompt components interact to shape accuracy. We validated ECP on 70,000 samples spanning 350 reasoning tasks and 9 advanced LLMs, observing a about 60% improvement in Pearson correlation relative to the conventional inference-time scaling law. Moreover, ECP explains the efficacy of 15 established prompting strategies and directs the development of new modular interventions that exceed the median score of the top 80% of participants in both the International Olympiad in Informatics and the International Mathematical Olympiad. By grounding LLM reasoning in electronic-circuit principles, ECP provides a rigorous framework for predicting performance and optimising modular components.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Placed in Reasoning benchmarks and evaluation, one of 17 directions in LLM reasoning. Builds on 34 of its 45 references that are in the map. First posted on arXiv 5 Feb 2025.

Builds on

34 of 45 references.

Closest ancestors · 1

Same direction, newest first

  1. 2021Show Your Work: Scratchpads for Intermediate Computation with Language Models30 Nov

Other references · 33

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2020Language Models are Few-Shot Learnerscited by 32,199
  3. 2023GPT-4 Technical Reportcited by 18,132
  4. 2024The Llama 3 Herd of Modelscited by 14,192
  5. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  6. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  7. 2021Training Verifiers to Solve Math Word Problemscited by 9,743
  8. 2020Measuring Massive Multitask Language Understandingcited by 7,768
  9. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
  10. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
  11. 2022Large Language Models are Zero-Shot Reasonerscited by 4,323
  12. 2023GPQA: A Graduate-Level Google-Proof Q&A Benchmarkcited by 2,748
21 more
  1. 2022Challenging BIG-Bench Tasks and Whether Chain-of-Thought Can Solve Themcited by 1,767
  2. 2024MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Benchmarkcited by 1,758
  3. 2022Competition-Level Code Generation with AlphaCodecited by 1,427
  4. 2020What Disease does this Patient Have? A Large-scale Open Domain Question Answering Dataset from Medical Examscited by 1,324
  5. 2019PubMedQA: A Dataset for Biomedical Research Question Answeringcited by 1,271
  6. 2024M3-Embedding: Multi-Linguality, Multi-Functionality, Multi-Granularity Text Embeddings Through Self-Knowledge Distillationcited by 1,050
  7. 2024The AI Scientist: Towards Fully Automated Open-Ended Scientific Discoverycited by 1,002
  8. 2023Large Language Modelscited by 774
  9. 2022MedMCQA : A Large-scale Multi-Subject Multi-Choice Dataset for Medical domain Question Answeringcited by 525
  10. 2024TextGrad: Automatic "Differentiation" via Textcited by 250
  11. 2023In-context Vectors: Making In Context Learning More Effective and Controllable Through Latent Space Steeringcited by 240
  12. 2023Label Words are Anchors: An Information Flow Perspective for Understanding In-Context Learningcited by 235
  13. 2023Large language models in healthcare and medical domain: A reviewcited by 126
  14. 2024A Practical Review of Mechanistic Interpretability for Transformer-Based Language Modelscited by 113
  15. 2023Finding Support Examples for In-Context Learningcited by 104
  16. 2024LLMs Still Can't Plan; Can LRMs? A Preliminary Evaluation of OpenAI's o1 on PlanBenchcited by 93
  17. 2024Metacognitive Capabilities of LLMs: An Exploration in Mathematical Problem Solvingcited by 82
  18. 2024A Comparative Study on Reasoning Patterns of OpenAI's o1 Modelcited by 62
  19. 2023Synthetic Prompting: Generating Chain-of-Thought Demonstrations for Large Language Modelscited by 61
  20. 2024Unlocking the Capabilities of Thought: A Reasoning Boundary Framework to Quantify and Optimize Chain-of-Thoughtcited by 56
  21. 2024What Factors Affect Multi-Modal In-Context Learning? An In-Depth Explorationcited by 31

Built on by

Cited by year

Citing papers per year: 2025: 4.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Can We Trust LLMs on Memristors? Diving into Reasoning Ability under Non-Ideality
  2. 2024A Implies B: Circuit Analysis in LLMs for Propositional Logical Reasoning
  3. 2025CIRCUIT: A Benchmark for Circuit Interpretation and Reasoning Capabilities of LLMs
  4. 2024Reasoning Circuits in Language Models: A Mechanistic Interpretation of Syllogistic Inference
  5. 2026CircuitReason-1k: Benchmarking Long-Horizon Visual-to-Symbolic Reasoning inElectrical Circuits
  6. 2025Mechanistic Unveiling of Transformer Circuits: Self-Influence as a Key to Model Reasoning
  7. 2025Eidoku: A Neuro-Symbolic Verification Gate for LLM Reasoning via Structural Constraint Satisfaction
  8. 2026Efficient Reasoning on the Edge