mlsanityData to 13 Oct 2026

Introspective Tips: Large Language Model for In-Context Decision Making

arXiv 2305.11598 ↗First posted 19 May 2023cs.AI cs.CLcited by 28

Not on the map. Why?

Abstract (arXiv)

The emergence of large language models (LLMs) has substantially influenced natural language processing, demonstrating exceptional results across various tasks. In this study, we employ ``Introspective Tips" to facilitate LLMs in self-optimizing their decision-making. By introspectively examining trajectories, LLM refines its policy by generating succinct and valuable tips. Our method enhances the agent's performance in both few-shot and zero-shot learning situations by considering three essential scenarios: learning from the agent's past experiences, integrating expert demonstrations, and generalizing across diverse games. Importantly, we accomplish these improvements without fine-tuning the LLM parameters; rather, we adjust the prompt to generalize insights from the three aforementioned situations. Our framework not only supports but also emphasizes the advantage of employing LLM in in-contxt decision-making. Experiments involving over 100 games in TextWorld illustrate the superior performance of our approach.

Key facts. Cited by 28 papers in the map (data through 13 Oct 2026). Builds on 37 of its 47 references that are in the map. First posted on arXiv 19 May 2023.

Builds on

37 of 47 references.

References · 37

  1. 2020Language Models are Few-Shot Learnerscited by 32,320
  2. 2023GPT-4 Technical Reportcited by 18,278
  3. 2022Training language models to follow instructions with human feedbackcited by 15,856
  4. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,376
  5. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,502
  6. 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,317
  7. 2022Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedbackcited by 3,691
  8. 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,367
  9. 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,321
  10. 2022Survey of Hallucination in Natural Language Generationcited by 2,068
  11. 2022Rethinking the Role of Demonstrations: What Makes In-Context Learning Work?cited by 1,424
  12. 2022Code as Policies: Language Model Programs for Embodied Controlcited by 1,186
25 more
  1. 2022Inner Monologue: Embodied Reasoning through Planning with Language Modelscited by 1,065
  2. 2022Language Models as Zero-Shot Planners: Extracting Actionable Knowledge for Embodied Agentscited by 1,032
  3. 2018DeepMind Control Suitecited by 944
  4. 2022A Generalist Agentcited by 803
  5. 2022ProgPrompt: Generating Situated Robot Task Plans using Large Language Modelscited by 602
  6. 2023Check Your Facts and Try Again: Improving Large Language Models with External Knowledge and Automated Feedbackcited by 353
  7. 2021Safe Learning in Robotics: From Learning-Based Control to Safe Reinforcement Learningcited by 338
  8. 2018TextWorld: A Learning Environment for Text-based Gamescited by 306
  9. 2023ChatGPT for Robotics: Design Principles and Model Abilitiescited by 296
  10. 2019Improving Sample Efficiency in Model-Free Reinforcement Learning from Imagescited by 268
  11. 2023Reward Design with Language Modelscited by 259
  12. 2022Pre-Trained Language Models for Interactive Decision-Makingcited by 221
  13. 2022In-context Reinforcement Learning with Algorithm Distillationcited by 186
  14. 2021Pretrained Transformers as Universal Computation Enginescited by 162
  15. 2023Foundation Models for Decision Making: Problems, Methods, and Opportunitiescited by 161
  16. 2023Human-Timescale Adaptation in an Open-Ended Task Spacecited by 136
  17. 2023Structured State Space Models for In-Context Reinforcement Learningcited by 109
  18. 2020Graph Constrained Reinforcement Learning for Natural Language Action Spacescited by 80
  19. 2021What Would Jiminy Cricket Do? Towards Agents That Behave Morallycited by 57
  20. 2020Learning Dynamic Belief Graphs to Generalize on Text-Based Gamescited by 49
  21. 2021Neuro-Symbolic Reinforcement Learning with First-Order Logiccited by 30
  22. 2021A Survey of Text Games for Reinforcement Learning informed by Natural Languagecited by 14
  23. 2022Learning to Follow Instructions in Text-Based Gamescited by 12
  24. 2019Comprehensible Context-driven Text Game Playingcited by 10
  25. 2022Perceiving the World: Question-guided Reinforcement Learning for Text-based Gamescited by 10

Built on by

Cited by year (2026 to 13 Oct)

Citing papers per year: 2023: 7; 2024: 12; 2025: 7; 2026: 2.

28 papers.

Sort:

By area:

  1. 2023A Survey on Large Language Model based Autonomous Agentscited by 2,218
  2. 2025EvolveR: Self-Evolving LLM Agents through an Experience-Driven Lifecyclecited by 134
  3. 2025Multi-Agent Collaboration via Evolving Orchestrationcited by 101
  4. 2024Agent-Pro: Learning to Evolve via Policy-Level Reflection and Optimizationcited by 93
  5. 2023CLIN: A Continually Learning Language Agent for Rapid Task Adaptation and Generalizationcited by 91
  6. 2023Large Language Models Play StarCraft II: Benchmarks and A Chain of Summarization Approachcited by 79
  7. 2024Reasoning in Token Economies: Budget-Aware Evaluation of LLM Reasoning Strategiescited by 44
  8. 2025LLMs are Greedy Agents: Effects of RL Fine-tuning on Decision-Making Abilitiescited by 38
  9. 2023An In-depth Survey of Large Language Model-based Artificial Intelligence Agentscited by 31
  10. 2024Application of LLM Agents in Recruitment: A Novel Framework for Resume Screeningcited by 24
  11. 2024Hallucination Detection in Foundation Models for Decision-Making: A Flexible Definition and Review of the State of the Artcited by 17
  12. 2023Ask more, know better: Reinforce-Learned Prompt Questions for Decision Making with Large Language Modelscited by 9
16 more
  1. 2024On the Importance of Uncertainty in Decision-Making with Large Language Modelscited by 9
  2. 2024Self-Evolving GPT: A Lifelong Autonomous Experiential Learnercited by 9
  3. 2023Testing the Depth of ChatGPT's Comprehension via Cross-Modal Tasks Based on ASCII-Art: GPT3.5's Abilities in Regard to Recognizing and Generating ASCII-Art Are Not Totally Lackingcited by 7
  4. 2024UNO Arena for Evaluating Sequential Decision-Making Capability of Large Language Modelscited by 6
  5. 2024LLMs for Robotic Object Disambiguationcited by 4
  6. 2026MemHarness: Memory Is Reconstructed, Not Replayedcited by 4
  7. 2024Mutual Enhancement of Large Language and Reinforcement Learning Models through Bi-Directional Feedback Mechanisms: A Planning Case Studycited by 3
  8. 2024Towards Dialogues for Joint Human-AI Reasoning and Value Alignmentcited by 2
  9. 2025ExpeTrans: LLMs Are Experiential Transfer Learnerscited by 2
  10. 2023LDM2: A Large Decision Model Imitating Human Cognition with Dynamic Memory Enhancementcited by 1
  11. 2024Attaining Human`s Desirable Outcomes in Human-AI Interaction via Structural Causal Gamescited by 1
  12. 2025AutoMedEval: Harnessing Language Models for Automatic Medical Capability Evaluationcited by 1
  13. 2025Intelligent Channel Allocation for IEEE 802.11be Multi-Link Operation: When MAB Meets LLMcited by 1
  14. 2024INACIA: Integrating Large Language Models in Brazilian Audit Courts: Opportunities and Challengescited by 0
  15. 2025Empowering LLMs with Parameterized Skills for Adversarial Long-Horizon Planningcited by 0
  16. 2026LLM-Powered Agentic AI for 5G/6G Networks: A Tutorial and Survey on Architectures, Protocols, and Standardizationcited by 0