Language Understanding for Text-based Games Using Deep Reinforcement Learning
Not on the map. Why?
Abstract (arXiv)
In this paper, we consider the task of learning control policies for text-based games. In these games, all interactions in the virtual world are through text and the underlying state is not observed. The resulting language barrier makes such environments challenging for automatic game players. We employ a deep reinforcement learning framework to jointly learn state representations and action policies using game rewards as feedback. This framework enables us to map text descriptions into vector representations that capture the semantics of the game states. We evaluate our approach on two game worlds, comparing against baselines using bag-of-words and bag-of-bigrams for state representations. Our algorithm outperforms the baselines on both worlds demonstrating the importance of learning expressive representations.
Key facts. Cited by 70 papers in the map (data through 7 Oct 2026). First posted on arXiv 30 Jun 2015.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2019: 1; 2020: 0; 2021: 20; 2022: 10; 2023: 16; 2024: 6; 2025: 11; 2026: 6.
70 papers.
Sort:
By area:
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2025Group-in-Group Policy Optimization for LLM Agent Trainingcited by 442
- 2022Pre-Trained Language Models for Interactive Decision-Makingcited by 220
- 2021Alignment of Language Agentscited by 167
- 2025Agentic Reinforced Policy Optimizationcited by 166
- 2023Guiding Large Language Models via Directional Stimulus Promptingcited by 94
- 2023LMRL Gym: Benchmarks for Multi-Turn Reinforcement Learning with Language Modelscited by 84
- 2023Learning to Generate Better Than Your LLMcited by 49
- 2025Agentic Entropy-Balanced Policy Optimizationcited by 39
- 2026Hierarchy-of-Groups Policy Optimization for Long-Horizon Agentic Taskscited by 37
- 2021Efficient (Soft) Q-Learning for Text Generation with Limited Good Datacited by 35
- 2023Inference-Time Policy Adapters (IPA): Tailoring Extreme-Scale LMs without Fine-tuningcited by 33
38 more
- 2021Survey on reinforcement learning for language processingcited by 31
- 2021Learning Knowledge Graph-based World Models of Textual Environmentscited by 31
- 2021Neuro-Symbolic Reinforcement Learning with First-Order Logiccited by 30
- 2023LLF-Bench: Benchmark for Interactive Learning from Language Feedbackcited by 30
- 2023Augmenting Autotelic Agents with Large Language Modelscited by 29
- 2022Multi-Stage Episodic Control for Strategic Exploration in Text Gamescited by 22
- 2025Monte Carlo Planning with Large Language Model for Text-Based Game Agentscited by 22
- 2026AgentOCR: Reimagining Agent History via Optical Self-Compressioncited by 22
- 2021Reading and Acting while Blindfolded: The Need for Semantics in Text Game Agentscited by 20
- 2025debug-gym: A Text-Based Environment for Interactive Debuggingcited by 19
- 2021A Systematic Survey of Text Worlds as Embodied Natural Language Environmentscited by 17
- 2021Towards Socially Intelligent Agents with Mental State Transition and Human Utilitycited by 14
- 2021Training Value-Aligned Reinforcement Learning Agents Using a Normative Priorcited by 14
- 2021A Survey of Text Games for Reinforcement Learning informed by Natural Languagecited by 14
- 2025Reinforcement Learning for Machine Learning Engineering Agentscited by 13
- 2022TextWorldExpress: Simulating Text Games at One Million Steps Per Secondcited by 12
- 2022Learning to Follow Instructions in Text-Based Gamescited by 12
- 2024Babysit A Language Model From Scratch: Interactive Language Learning by Trials and Demonstrationscited by 12
- 2021Generalization in Text-based Games via Hierarchical Reinforcement Learningcited by 11
- 2025STEP: Success-Rate-Aware Trajectory-Efficient Policy Optimizationcited by 11
- 2021Reinforcement Learning with External Knowledge by using Logical Neural Networkscited by 10
- 2022Perceiving the World: Question-guided Reinforcement Learning for Text-based Gamescited by 10
- 2022Reinforcement Learning and Bandits for Speech and Language Processing: Tutorial, Review and Outlookcited by 10
- 2022Improving Policy Learning via Language Dynamics Distillationcited by 9
- 2023Predictive Chemistry Augmented with Text Retrievalcited by 9
- 2024A Survey On Enhancing Reinforcement Learning in Complex Environments: Insights from Human and LLM Feedbackcited by 9
- 2025AuthorMist: Evading AI Text Detectors with Reinforcement Learningcited by 9
- 2025TALES: Text Adventure Learning Environment Suitecited by 9
- 2021Case-based Reasoning for Better Generalization in Textual Reinforcement Learningcited by 8
- 2019Action Assembly: Sparse Imitation Learning for Text Based Games with Combinatorial Action Spacescited by 7
- 2026Group-Graph Policy Optimization for Long-Horizon Agentic Reinforcement Learningcited by 7
- 2021LOA: Logical Optimal Actions for Text-based Interaction Gamescited by 6
- 2023Thespian: Multi-Character Text Role-Playing Game Agentscited by 6
- 2021Designing an Automatic Agent for Repeated Language based Persuasion Gamescited by 5
- 2023Ambient Adventures: Teaching ChatGPT on Developing Complex Storiescited by 5
- 2023An Invitation to Deep Reinforcement Learningcited by 5
- 2026SIRI: Self-Internalizing Reinforcement Learning with Intrinsic Skills for LLM Agent Trainingcited by 5
- 2021Eye of the Beholder: Improved Relation Generalization for Text-based Reinforcement Learning Agentscited by 4
50 most cited of 70 All 70 (JSON)
- 2026Group-Graph Policy Optimization for Long-Horizon Agentic Reinforcement Learning22 Jun 2026
- 2026When Denser Credit Is Not Enough: Evidence-Calibrated Policy Optimization for Long-Horizon LLM Agent Training4 Jun 2026
- 2026SIRI: Self-Internalizing Reinforcement Learning with Intrinsic Skills for LLM Agent Training1 Jun 2026
- 2026AgentOdyssey: Open-Ended Long-Horizon Text Game Generation for Test-Time Continual Learning Agents29 May 2026
- 2026Hierarchy-of-Groups Policy Optimization for Long-Horizon Agentic Tasks26 Feb 2026
- 2026AgentOCR: Reimagining Agent History via Optical Self-Compression8 Jan 2026
- 2025STEP: Success-Rate-Aware Trajectory-Efficient Policy Optimization17 Nov 2025
- 2025Agentic Entropy-Balanced Policy Optimization16 Oct 2025
- 2025ByteSized32Refactored: Towards an Extensible Interactive Text Games Corpus for LLM World Modeling and Evaluation28 Sep 2025
- 2025Reinforcement Learning for Machine Learning Engineering Agents1 Sep 2025
- 2025Agentic Reinforced Policy Optimization26 Jul 2025
- 2025Group-in-Group Policy Optimization for LLM Agent Training16 May 2025
38 more
- 2025Monte Carlo Planning with Large Language Model for Text-Based Game Agents23 Apr 2025
- 2025TALES: Text Adventure Learning Environment Suite19 Apr 2025
- 2025Persona Dynamics: Unveiling the Impact of Personality Traits on Agents in Text-Based Games9 Apr 2025
- 2025debug-gym: A Text-Based Environment for Interactive Debugging27 Mar 2025
- 2025AuthorMist: Evading AI Text Detectors with Reinforcement Learning10 Mar 2025
- 2024A Survey On Enhancing Reinforcement Learning in Complex Environments: Insights from Human and LLM Feedback20 Nov 2024
- 2024Positive Experience Reflection for Agents in Interactive Text Environments4 Nov 2024
- 2024DAVIS: Planning Agent with Knowledge Graph-Powered Inner Monologue11 Oct 2024
- 2024Babysit A Language Model From Scratch: Interactive Language Learning by Trials and Demonstrations22 May 2024
- 2024A Mixture-of-Experts Approach to Few-Shot Task Transfer in Open-Ended Text Worlds9 May 2024
- 2024EXPLORER: Exploration-guided Reasoning for Textual Reinforcement Learning15 Mar 2024
- 2023An Invitation to Deep Reinforcement Learning13 Dec 2023
- 2023LLF-Bench: Benchmark for Interactive Learning from Language Feedback11 Dec 2023
- 2023Predictive Chemistry Augmented with Text Retrieval8 Dec 2023
- 2023LMRL Gym: Benchmarks for Multi-Turn Reinforcement Learning with Language Models30 Nov 2023
- 2023Hierarchical reinforcement learning with natural language subgoals20 Sep 2023
- 2023Thespian: Multi-Character Text Role-Playing Game Agents3 Aug 2023
- 2023Ambient Adventures: Teaching ChatGPT on Developing Complex Stories3 Aug 2023
- 2023ScriptWorld: Text Based Environment For Learning Procedural Knowledge8 Jul 2023
- 2023Learning Symbolic Rules over Abstract Meaning Representations for Textual Reinforcement Learning5 Jul 2023
- 2023Learning to Generate Better Than Your LLM20 Jun 2023
- 2023Simple Embodied Language Learning as a Byproduct of Meta-Reinforcement Learning14 Jun 2023
- 2023Inference-Time Policy Adapters (IPA): Tailoring Extreme-Scale LMs without Fine-tuning24 May 2023
- 2023Augmenting Autotelic Agents with Large Language Models21 May 2023
- 2023Plume: A Framework for High Performance Deep RL Network Controllers via Prioritized Trace Sampling24 Feb 2023
- 2023Guiding Large Language Models via Directional Stimulus Prompting22 Feb 2023
- 2023Learning to Play Text-based Adventure Games with Maximum Entropy Reinforcement Learning21 Feb 2023
- 2022Learning to Follow Instructions in Text-Based Games8 Nov 2022
- 2022lilGym: Natural Language Visual Reasoning with Reinforcement Learning3 Nov 2022
- 2022Reinforcement Learning and Bandits for Speech and Language Processing: Tutorial, Review and Outlook24 Oct 2022
- 2022Revisiting the Roles of "Text" in Text Games15 Oct 2022
- 2022Improving Policy Learning via Language Dynamics Distillation30 Sep 2022
- 2022TextWorldExpress: Simulating Text Games at One Million Steps Per Second1 Aug 2022
- 2022Perceiving the World: Question-guided Reinforcement Learning for Text-based Games20 Mar 2022
- 2022Pre-Trained Language Models for Interactive Decision-Making3 Feb 2022
- 2022Learning Invariable Semantical Representation from Language for Extensible Policy Generalization26 Jan 2022
- 2022Multi-Stage Episodic Control for Strategic Exploration in Text Games4 Jan 2022
- 2021LOA: Logical Optimal Actions for Text-based Interaction Games21 Oct 2021
50 newest of 70 All 70 (JSON)
- 2025Agentic Entropy-Balanced Policy Optimizationcited by 39
- 2023Augmenting Autotelic Agents with Large Language Modelscited by 29
- 2025Monte Carlo Planning with Large Language Model for Text-Based Game Agentscited by 22
- 2026AgentOCR: Reimagining Agent History via Optical Self-Compressioncited by 22
- 2025debug-gym: A Text-Based Environment for Interactive Debuggingcited by 19
- 2025Reinforcement Learning for Machine Learning Engineering Agentscited by 13
- 2026Group-Graph Policy Optimization for Long-Horizon Agentic Reinforcement Learningcited by 7
- 2026SIRI: Self-Internalizing Reinforcement Learning with Intrinsic Skills for LLM Agent Trainingcited by 5
- 2026When Denser Credit Is Not Enough: Evidence-Calibrated Policy Optimization for Long-Horizon LLM Agent Trainingcited by 4
- 2024Positive Experience Reflection for Agents in Interactive Text Environmentscited by 1
- 2026Group-Graph Policy Optimization for Long-Horizon Agentic Reinforcement Learning22 Jun 2026
- 2026When Denser Credit Is Not Enough: Evidence-Calibrated Policy Optimization for Long-Horizon LLM Agent Training4 Jun 2026
- 2026SIRI: Self-Internalizing Reinforcement Learning with Intrinsic Skills for LLM Agent Training1 Jun 2026
- 2026AgentOCR: Reimagining Agent History via Optical Self-Compression8 Jan 2026
- 2025Agentic Entropy-Balanced Policy Optimization16 Oct 2025
- 2025Reinforcement Learning for Machine Learning Engineering Agents1 Sep 2025
- 2025Monte Carlo Planning with Large Language Model for Text-Based Game Agents23 Apr 2025
- 2025debug-gym: A Text-Based Environment for Interactive Debugging27 Mar 2025
- 2024Positive Experience Reflection for Agents in Interactive Text Environments4 Nov 2024
- 2023Augmenting Autotelic Agents with Large Language Models21 May 2023
- 2025Group-in-Group Policy Optimization for LLM Agent Trainingcited by 442
- 2025Agentic Reinforced Policy Optimizationcited by 166
- 2026Hierarchy-of-Groups Policy Optimization for Long-Horizon Agentic Taskscited by 37
- 2022lilGym: Natural Language Visual Reasoning with Reinforcement Learningcited by 3
- 2026Hierarchy-of-Groups Policy Optimization for Long-Horizon Agentic Tasks26 Feb 2026
- 2025Agentic Reinforced Policy Optimization26 Jul 2025
- 2025Group-in-Group Policy Optimization for LLM Agent Training16 May 2025
- 2022lilGym: Natural Language Visual Reasoning with Reinforcement Learning3 Nov 2022
- 2022Pre-Trained Language Models for Interactive Decision-Makingcited by 220
- 2021Alignment of Language Agentscited by 167
- 2023Guiding Large Language Models via Directional Stimulus Promptingcited by 94
- 2023LMRL Gym: Benchmarks for Multi-Turn Reinforcement Learning with Language Modelscited by 84
- 2023Learning to Generate Better Than Your LLMcited by 49
- 2021Efficient (Soft) Q-Learning for Text Generation with Limited Good Datacited by 35
- 2023Inference-Time Policy Adapters (IPA): Tailoring Extreme-Scale LMs without Fine-tuningcited by 33
- 2021Survey on reinforcement learning for language processingcited by 31
- 2021Neuro-Symbolic Reinforcement Learning with First-Order Logiccited by 30
- 2023LLF-Bench: Benchmark for Interactive Learning from Language Feedbackcited by 30
- 2022Multi-Stage Episodic Control for Strategic Exploration in Text Gamescited by 22
- 2021Reading and Acting while Blindfolded: The Need for Semantics in Text Game Agentscited by 20
12 most cited of 50 All 50 (JSON)
- 2026AgentOdyssey: Open-Ended Long-Horizon Text Game Generation for Test-Time Continual Learning Agents29 May 2026
- 2025STEP: Success-Rate-Aware Trajectory-Efficient Policy Optimization17 Nov 2025
- 2025TALES: Text Adventure Learning Environment Suite19 Apr 2025
- 2025Persona Dynamics: Unveiling the Impact of Personality Traits on Agents in Text-Based Games9 Apr 2025
- 2025AuthorMist: Evading AI Text Detectors with Reinforcement Learning10 Mar 2025
- 2024A Survey On Enhancing Reinforcement Learning in Complex Environments: Insights from Human and LLM Feedback20 Nov 2024
- 2024Babysit A Language Model From Scratch: Interactive Language Learning by Trials and Demonstrations22 May 2024
- 2024EXPLORER: Exploration-guided Reasoning for Textual Reinforcement Learning15 Mar 2024
- 2023An Invitation to Deep Reinforcement Learning13 Dec 2023
- 2023LLF-Bench: Benchmark for Interactive Learning from Language Feedback11 Dec 2023
- 2023Predictive Chemistry Augmented with Text Retrieval8 Dec 2023
- 2023LMRL Gym: Benchmarks for Multi-Turn Reinforcement Learning with Language Models30 Nov 2023
12 newest of 50 All 50 (JSON)