Human-Inspired Learning for Large Language Models via Obvious Record and Maximum-Entropy Method Discovery
Not on the map. Why?
Abstract (arXiv)
Large Language Models (LLMs) excel at extracting common patterns from large-scale corpora, yet they struggle with rare, low-resource, or previously unseen scenarios-such as niche hardware deployment issues or irregular IoT device behaviors-because such cases are sparsely represented in training data. Moreover, LLMs rely primarily on implicit parametric memory, which limits their ability to explicitly acquire, recall, and refine methods, causing them to behave predominantly as intuition-driven predictors rather than deliberate, method-oriented learners. Inspired by how humans learn from rare experiences, this paper proposes a human-inspired learning framework that integrates two complementary mechanisms. The first, Obvious Record, explicitly stores cause--result (or question--solution) relationships as symbolic memory, enabling persistent learning even from single or infrequent encounters. The second, Maximum-Entropy Method Discovery, prioritizes and preserves methods with high semantic dissimilarity, allowing the system to capture diverse and underrepresented strategies that are typically overlooked by next-token prediction. Verification on a benchmark of 60 semantically diverse question--solution pairs demonstrates that the proposed entropy-guided approach achieves stronger coverage of unseen questions and significantly greater internal diversity than a random baseline, confirming its effectiveness in discovering more generalizable and human-inspired methods.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 11 of its 16 references that are in the map. First posted on arXiv 14 Dec 2025.
Builds on
11 of 16 references.
References · 11
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
- 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,304
- 2023A Survey on Evaluation of Large Language Modelscited by 1,227
- 2020A Survey of Deep Active Learningcited by 547
- 2023Fact-Checking Complex Claims with Program-Guided Reasoningcited by 146
- 2019Neural Logic Machinescited by 144
- 2025An Overview of Large Language Models for Statisticianscited by 24
- 2025Method-Based Reasoning for Large Language Models: Extraction, Reuse, and Continuous Improvementcited by 6
- 2025A Layered Intuition -- Method Model with Scope Extension for LLM Reasoningcited by 3
Built on by
Citing papers per year: 2026: 3.
3 papers.
- 2026Actively Obtaining Environmental Feedback for Autonomous Action Evaluation Without Predefined Measurementscited by 3
- 2026Human Simulation Computation: A Human-Inspired Framework for Adaptive AI Systemscited by 3
- 2026Human-Inspired Continuous Learning of Internal Reasoning Processes: Learning How to Think for Adaptive AI Systemscited by 1
- 2026Human-Inspired Continuous Learning of Internal Reasoning Processes: Learning How to Think for Adaptive AI Systems12 Feb 2026
- 2026Human Simulation Computation: A Human-Inspired Framework for Adaptive AI Systems20 Jan 2026
- 2026Actively Obtaining Environmental Feedback for Autonomous Action Evaluation Without Predefined Measurements4 Jan 2026