Counting to Explore and Generalize in Text-based Games
Not on the map. Why?
Abstract (arXiv)
We propose a recurrent RL agent with an episodic exploration mechanism that helps discovering good policies in text-based game environments. We show promising results on a set of generated text-based games of varying difficulty where the goal is to collect a coin located at the end of a chain of rooms. In contrast to previous text-based RL approaches, we observe that our agent learns policies that generalize to unseen games of greater difficulty.
Key facts. Cited by 36 papers in the map (data through 7 Oct 2026). First posted on arXiv 29 Jun 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2019: 1; 2020: 0; 2021: 9; 2022: 9; 2023: 4; 2024: 5; 2025: 8.
36 papers.
Sort:
By area:
- 2022Pre-Trained Language Models for Interactive Decision-Makingcited by 220
- 2023Retroformer: Retrospective Large Language Agents with Policy Gradient Optimizationcited by 110
- 2024A Survey on Large Language Model-Based Game Agentscited by 106
- 2023Interactive Natural Language Processingcited by 31
- 2024Large Language Models Are Neurosymbolic Reasonerscited by 31
- 2021Neuro-Symbolic Reinforcement Learning with First-Order Logiccited by 30
- 2022Multi-Stage Episodic Control for Strategic Exploration in Text Gamescited by 22
- 2021A Systematic Survey of Text Worlds as Embodied Natural Language Environmentscited by 17
- 2021Towards Socially Intelligent Agents with Mental State Transition and Human Utilitycited by 14
- 2021A Survey of Text Games for Reinforcement Learning informed by Natural Languagecited by 14
- 2024PDDLEGO: Iterative Planning in Textual Environmentscited by 14
- 2022TextWorldExpress: Simulating Text Games at One Million Steps Per Secondcited by 12
24 more
- 2022Learning to Follow Instructions in Text-Based Gamescited by 12
- 2021Generalization in Text-based Games via Hierarchical Reinforcement Learningcited by 11
- 2021Reinforcement Learning with External Knowledge by using Logical Neural Networkscited by 10
- 2022Perceiving the World: Question-guided Reinforcement Learning for Text-based Gamescited by 10
- 2022Behavior Cloned Transformers are Neurosymbolic Reasonerscited by 10
- 2025TALES: Text Adventure Learning Environment Suitecited by 9
- 2019Action Assembly: Sparse Imitation Learning for Text Based Games with Combinatorial Action Spacescited by 7
- 2025Large Language Models Think Too Fast To Explore Effectivelycited by 7
- 2021LOA: Logical Optimal Actions for Text-based Interaction Gamescited by 6
- 2022One-Shot Learning from a Demonstration with Hierarchical Latent Languagecited by 6
- 2024EscapeBench: Towards Advancing Creative Intelligence of Language Model Agentscited by 5
- 2025A Generalist Hanabi Agentcited by 5
- 2023Learning Symbolic Rules over Abstract Meaning Representations for Textual Reinforcement Learningcited by 4
- 2023Simple Embodied Language Learning as a Byproduct of Meta-Reinforcement Learningcited by 3
- 2025Unifying Inference-Time Planning Language Generationcited by 3
- 2025Language Model as Planner and Formalizer under Constraintscited by 3
- 2021Situated Language Learning via Interactive Narrativescited by 2
- 2021Interactive Machine Comprehension with Dynamic Knowledge Graphscited by 2
- 2025GroundAct: Can LLM Agents Ground Actions in Environmental States?cited by 2
- 2022An Analysis of Deep Reinforcement Learning Agents for Text-based Gamescited by 1
- 2024Towards Goal-Oriented Agents for Evolving Problems Observed via Conversationcited by 1
- 2025Iterative Formalization and Planning in Partially Observable Environmentscited by 1
- 2022Learning Invariable Semantical Representation from Language for Extensible Policy Generalizationcited by 0
- 2025ByteSized32Refactored: Towards an Extensible Interactive Text Games Corpus for LLM World Modeling and Evaluationcited by 0
- 2025Language Model as Planner and Formalizer under Constraints7 Oct 2025
- 2025ByteSized32Refactored: Towards an Extensible Interactive Text Games Corpus for LLM World Modeling and Evaluation28 Sep 2025
- 2025GroundAct: Can LLM Agents Ground Actions in Environmental States?7 Aug 2025
- 2025Unifying Inference-Time Planning Language Generation20 May 2025
- 2025Iterative Formalization and Planning in Partially Observable Environments19 May 2025
- 2025TALES: Text Adventure Learning Environment Suite19 Apr 2025
- 2025A Generalist Hanabi Agent17 Mar 2025
- 2025Large Language Models Think Too Fast To Explore Effectively29 Jan 2025
- 2024EscapeBench: Towards Advancing Creative Intelligence of Language Model Agents18 Dec 2024
- 2024PDDLEGO: Iterative Planning in Textual Environments30 May 2024
- 2024A Survey on Large Language Model-Based Game Agents2 Apr 2024
- 2024Large Language Models Are Neurosymbolic Reasoners17 Jan 2024
24 more
- 2024Towards Goal-Oriented Agents for Evolving Problems Observed via Conversation11 Jan 2024
- 2023Retroformer: Retrospective Large Language Agents with Policy Gradient Optimization4 Aug 2023
- 2023Learning Symbolic Rules over Abstract Meaning Representations for Textual Reinforcement Learning5 Jul 2023
- 2023Simple Embodied Language Learning as a Byproduct of Meta-Reinforcement Learning14 Jun 2023
- 2023Interactive Natural Language Processing22 May 2023
- 2022Learning to Follow Instructions in Text-Based Games8 Nov 2022
- 2022Behavior Cloned Transformers are Neurosymbolic Reasoners13 Oct 2022
- 2022An Analysis of Deep Reinforcement Learning Agents for Text-based Games9 Sep 2022
- 2022TextWorldExpress: Simulating Text Games at One Million Steps Per Second1 Aug 2022
- 2022Perceiving the World: Question-guided Reinforcement Learning for Text-based Games20 Mar 2022
- 2022One-Shot Learning from a Demonstration with Hierarchical Latent Language9 Mar 2022
- 2022Pre-Trained Language Models for Interactive Decision-Making3 Feb 2022
- 2022Learning Invariable Semantical Representation from Language for Extensible Policy Generalization26 Jan 2022
- 2022Multi-Stage Episodic Control for Strategic Exploration in Text Games4 Jan 2022
- 2021LOA: Logical Optimal Actions for Text-based Interaction Games21 Oct 2021
- 2021Neuro-Symbolic Reinforcement Learning with First-Order Logic21 Oct 2021
- 2021Generalization in Text-based Games via Hierarchical Reinforcement Learning21 Sep 2021
- 2021A Survey of Text Games for Reinforcement Learning informed by Natural Language20 Sep 2021
- 2021Interactive Machine Comprehension with Dynamic Knowledge Graphs31 Aug 2021
- 2021A Systematic Survey of Text Worlds as Embodied Natural Language Environments8 Jul 2021
- 2021Situated Language Learning via Interactive Narratives18 Mar 2021
- 2021Towards Socially Intelligent Agents with Mental State Transition and Human Utility12 Mar 2021
- 2021Reinforcement Learning with External Knowledge by using Logical Neural Networks3 Mar 2021
- 2019Action Assembly: Sparse Imitation Learning for Text Based Games with Combinatorial Action Spaces23 May 2019
- 2023Retroformer: Retrospective Large Language Agents with Policy Gradient Optimizationcited by 110
- 2024A Survey on Large Language Model-Based Game Agentscited by 106
- 2024EscapeBench: Towards Advancing Creative Intelligence of Language Model Agentscited by 5
- 2025GroundAct: Can LLM Agents Ground Actions in Environmental States?cited by 2
- 2025GroundAct: Can LLM Agents Ground Actions in Environmental States?7 Aug 2025
- 2024EscapeBench: Towards Advancing Creative Intelligence of Language Model Agents18 Dec 2024
- 2024A Survey on Large Language Model-Based Game Agents2 Apr 2024
- 2023Retroformer: Retrospective Large Language Agents with Policy Gradient Optimization4 Aug 2023
- 2024Large Language Models Are Neurosymbolic Reasonerscited by 31
- 2025Large Language Models Think Too Fast To Explore Effectivelycited by 7
- 2025Large Language Models Think Too Fast To Explore Effectively29 Jan 2025
- 2024Large Language Models Are Neurosymbolic Reasoners17 Jan 2024
- 2022Pre-Trained Language Models for Interactive Decision-Makingcited by 220
- 2023Interactive Natural Language Processingcited by 31
- 2021Neuro-Symbolic Reinforcement Learning with First-Order Logiccited by 30
- 2022Multi-Stage Episodic Control for Strategic Exploration in Text Gamescited by 22
- 2021A Systematic Survey of Text Worlds as Embodied Natural Language Environmentscited by 17
- 2021Towards Socially Intelligent Agents with Mental State Transition and Human Utilitycited by 14
- 2021A Survey of Text Games for Reinforcement Learning informed by Natural Languagecited by 14
- 2024PDDLEGO: Iterative Planning in Textual Environmentscited by 14
- 2022TextWorldExpress: Simulating Text Games at One Million Steps Per Secondcited by 12
- 2022Learning to Follow Instructions in Text-Based Gamescited by 12
- 2021Generalization in Text-based Games via Hierarchical Reinforcement Learningcited by 11
- 2021Reinforcement Learning with External Knowledge by using Logical Neural Networkscited by 10
12 most cited of 28 All 28 (JSON)
- 2025Language Model as Planner and Formalizer under Constraints7 Oct 2025
- 2025Unifying Inference-Time Planning Language Generation20 May 2025
- 2025Iterative Formalization and Planning in Partially Observable Environments19 May 2025
- 2025TALES: Text Adventure Learning Environment Suite19 Apr 2025
- 2025A Generalist Hanabi Agent17 Mar 2025
- 2024PDDLEGO: Iterative Planning in Textual Environments30 May 2024
- 2024Towards Goal-Oriented Agents for Evolving Problems Observed via Conversation11 Jan 2024
- 2023Learning Symbolic Rules over Abstract Meaning Representations for Textual Reinforcement Learning5 Jul 2023
- 2023Simple Embodied Language Learning as a Byproduct of Meta-Reinforcement Learning14 Jun 2023
- 2023Interactive Natural Language Processing22 May 2023
- 2022Learning to Follow Instructions in Text-Based Games8 Nov 2022
- 2022Behavior Cloned Transformers are Neurosymbolic Reasoners13 Oct 2022
12 newest of 28 All 28 (JSON)