PUBG Ally: A Conversational Embodied Agent as an AI Teammate
Not on the map. Why?
Abstract (arXiv)
We introduce PUBG Ally, an embodied agent for PUBG: BATTLEGROUNDS that can reason, act autonomously, and play alongside players as a voice-enabled teammate. Building such a teammate requires combining two difficult capabilities: it must perceive and respond to a constantly changing game world under strict latency constraints while interacting naturally with players, keeping its speech synchronized with its actions. Ally therefore combines agentic tool use with real-time game control. A language-model agent uses a controlled interface to inspect game information, interpret player speech, maintain context, decide what to say, and issue high-level action choices that steer a faster control layer for movement, combat, and recovery. Because the player's and Ally's speech and actions continually shape each other and the course of the match, training requires data from actual gameplay. We therefore collect data across nearly 39k sessions in which real players play alongside Ally, recording gameplay, player speech, agent decisions, tool use, actions, and player feedback, and use these records for iterative training. To evaluate teammate quality, we use player feedback and preference comparisons to identify gaps between offline evaluations and player preferences, and iteratively refine the evaluation criteria. Deploying Ally in live service further requires low-latency on-device execution and safeguards for player-facing communication, which we address through model compression, context compaction, targeted safety training, runtime guardrails, and memory redaction. During the live service, we surveyed players in 141 countries. Among respondents whose play with Ally was confirmed in game records, positive responses exceeded negative responses by 25.1 percentage points when asked whether they would recommend Ally, with players describing Ally not only as a tool but also as a teammate or companion.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 35 of its 129 references that are in the map. First posted on arXiv 24 Sep 2026.
Builds on
35 of 129 references.
References · 35
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
- 2015Distilling the Knowledge in a Neural Networkcited by 10,324
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
- 2019Dota 2 with Large Scale Deep Reinforcement Learningcited by 1,103
- 2024Tulu 3: Pushing Frontiers in Open Language Model Post-Trainingcited by 1,053
- 2025τ2-Bench: Evaluating Conversational Agents in a Dual-Control Environmentcited by 627
- 2026Terminal-Bench: Benchmarking Agents on Hard, Realistic Tasks in Command Line Interfacescited by 585
- 2025GEPA: Reflective Prompt Evolution Can Outperform Reinforcement Learningcited by 542
- 2024AgentBoard: An Analytical Evaluation Board of Multi-turn LLM Agentscited by 339
- 2026Meta-Harness: End-to-End Optimization of Model Harnessescited by 309
23 more
- 2024Deliberative Alignment: Reasoning Enables Safer Language Modelscited by 308
- 2024TextGrad: Automatic "Differentiation" via Textcited by 273
- 2026Gemma 4 Technical Reportcited by 259
- 2022Learning by Distilling Contextcited by 138
- 2026CaP-X: A Framework for Benchmarking and Improving Coding Agents for Robot Manipulationcited by 88
- 2024Scaling Instructable Agents Across Many Simulated Worldscited by 71
- 2025From Hard Refusals to Safe-Completions: Toward Output-Centric Safety Trainingcited by 52
- 2026TCOD: Exploring Temporal Curriculum in On-Policy Distillation for Multi-turn Autonomous Agentscited by 47
- 2025AILuminate: Introducing v1.0 of the AI Risk and Reliability Benchmark from MLCommonscited by 35
- 2025SIMA 2: A Generalist Embodied Agent for Virtual Worldscited by 31
- 2026NitroGen: An Open Foundation Model for Generalist Gaming Agentscited by 27
- 2025Lumine: An Open Recipe for Building Generalist Agents in 3D Open Worldscited by 21
- 2025Imitation Learning for Multi-turn LM Agents via On-policy Expert Correctionscited by 19
- 2026MAD-OPD: Breaking the Ceiling in On-Policy Distillation via Multi-Agent Debatecited by 17
- 2024CHiSafetyBench: A Chinese Hierarchical Safety Benchmark for Large Language Modelscited by 15
- 2026GaP: A Graph-as-Policy Multi-Agent Self-Learning Harness For Variational Automation Taskscited by 14
- 2026WHALE: A Simple Recipe for Joint Harness-Weight Optimizationcited by 11
- 2024ChineseSafe: A Chinese Benchmark for Evaluating Safety in Large Language Modelscited by 7
- 2026Revisiting DAgger in the Era of LLM-Agentscited by 7
- 2026Raon-Speech Technical Reportcited by 7
- 2024Enhancing Human Experience in Human-Agent Collaboration: A Human-Centered Modeling Approach Based on Positive Human Gaincited by 5
- 2025F.A.C.U.L.: Language-Based Interaction with AI Companions in Gamingcited by 2
- 2026Ludiscriptscriptstyle 0.1: An Agentic System for Socially Intelligent Robotscited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Orak: A Foundational Benchmark for Training and Evaluating LLM Agents on Diverse Video Games
- 2026GameWorld: Towards Standardized and Verifiable Evaluation of Multimodal Game Agents
- 2024TeamCraft: A Benchmark for Multi-Modal Multi-Agent Systems in Minecraft
- 2024A Survey on Large Language Model-Based Game Agents
- 2025Collaborating Action by Action: A Multi-agent LLM Framework for Embodied Reasoning
- 2023Cooperation on the Fly: Exploring Language Agents for Ad Hoc Teamwork in the Avalon Game
- 2026CollabBench: Benchmarking and Unleashing Collaborative Ability of LLMs with Diverse Players via Proactive Engagement
- 2024SocialBench: Sociality Evaluation of Role-Playing Conversational Agents