CombatVLA: An Efficient Vision-Language-Action Model for Combat Tasks in 3D Action Role-Playing Games
On the map: Vision-language-action models → Generalist VLA models and benchmarks
Abstract (arXiv)
Recent advances in Vision-Language-Action models (VLAs) have expanded the capabilities of embodied intelligence. However, significant challenges remain in real-time decision-making in complex 3D environments, which demand second-level responses, high-resolution perception, and tactical reasoning under dynamic conditions. To advance the field, we introduce CombatVLA, an efficient VLA model optimized for combat tasks in 3D action role-playing games(ARPGs). Specifically, our CombatVLA is a 3B model trained on video-action pairs collected by an action tracker, where the data is formatted as action-of-thought (AoT) sequences. Thereafter, CombatVLA seamlessly integrates into an action execution framework, allowing efficient inference through our truncated AoT strategy. Experimental results demonstrate that CombatVLA not only outperforms all existing models on the combat understanding benchmark but also achieves a 50-fold acceleration in game combat. Moreover, it has a higher task success rate than human players. We will open-source all resources, including the action tracker, dataset, benchmark, model weights, training code, and the implementation of the framework at https://combatvla.github.io/.
Key facts. Cited by 14 papers in the map (data through 14 Oct 2026). Placed in Generalist VLA models and benchmarks, one of 13 directions in Vision-language-action models. Builds on 37 of its 46 references that are in the map. First posted on arXiv 12 Mar 2025.
Builds on
37 of 46 references.
Closest ancestors · 1
Same direction, newest first
Other references · 36
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2023Improved Baselines with Visual Instruction Tuningcited by 4,418
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
- 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,568
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
- 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,224
- 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,191
- 2023MME: A Comprehensive Evaluation Benchmark for Multimodal Large Language Modelscited by 1,652
- 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scalingcited by 1,599
- 2024Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysiscited by 1,413
24 more
- 2023ChatDev: Communicative Agents for Software Developmentcited by 919
- 2025UI-TARS: Pioneering Automated GUI Interaction with Native Agentscited by 610
- 2023OCRBench: On the Hidden Mystery of OCR in Large Multimodal Modelscited by 476
- 2023A Real-World WebAgent with Planning, Long Context Understanding, and Program Synthesiscited by 353
- 2023Vision-Language Foundation Models as Effective Robot Imitatorscited by 349
- 2024GR-2: A Generative Video-Language-Action Model with Web-Scale Knowledge for Robot Manipulationcited by 296
- 2024Mobile-Agent: Autonomous Multi-Modal Mobile Device Agent with Visual Perceptioncited by 293
- 2023Auto-GPT for Online Decision Making: Benchmarks and Additional Opinionscited by 255
- 2024ShowUI: One Vision-Language-Action Model for GUI Visual Agentcited by 232
- 2024Mobile-Agent-v2: Mobile Device Operation Assistant with Effective Navigation via Multi-Agent Collaborationcited by 189
- 2023JARVIS-1: Open-World Multi-task Agents with Memory-Augmented Multimodal Language Modelscited by 171
- 2024Fine-Tuning Large Vision-Language Models as Decision-Making Agents via Reinforcement Learningcited by 158
- 2022SMACv2: An Improved Benchmark for Cooperative Multi-Agent Reinforcement Learningcited by 122
- 2024DeeR-VLA: Dynamic Inference of Multimodal Large Language Models for Efficient Robot Executioncited by 117
- 2025Improving Vision-Language-Action Model with Online Reinforcement Learningcited by 116
- 2025PointVLA: Injecting the 3D World into Vision-Language-Action Modelscited by 105
- 2023Do LLMs Possess a Personality? Making the MBTI Test an Amazing Evaluation for Large Language Modelscited by 56
- 2025Analyzing and Boosting the Power of Fine-Grained Visual Recognition for Multi-modal Large Language Modelscited by 31
- 2024PokeLLMon: A Human-Parity Agent for Pokemon Battles with Large Language Modelscited by 26
- 2024Can VLMs Play Action Role-Playing Games? Take Black Myth Wukong as a Study Casecited by 24
- 2025HedgeAgents: A Balanced-aware Multi-agent Financial Trading Systemcited by 24
- 2025RTBAgent: A LLM-based Agent System for Real-Time Biddingcited by 14
- 2024Interpretability in Action: Exploratory Analysis of VPT, a Minecraft Agentcited by 4
- 2025"See the World, Discover Knowledge": A Chinese Factuality Evaluation for Large Vision Language Modelscited by 3
Built on by
Citing papers per year: 2025: 7; 2026: 7.
14 papers.
Sort:
By area:
- 2025Vision-Language-Action Models for Robotics: A Review Towards Real-World Applicationscited by 84
- 2025Pure Vision Language Action (VLA) Models: A Comprehensive Surveycited by 49
- 2025JARVIS-VLA: Post-Training Large-Scale Vision Language Models to Play Visual Games with Keyboards and Mousecited by 28
- 2026VLANeXt: Recipes for Building Strong VLA Modelscited by 12
- 2026Scaling Behavior Cloning Improves Causal Reasoning: An Open Model for Real-Time Video Game Playingcited by 11
- 2025OpenHA: A Series of Open-Source Hierarchical Agentic Models in Minecraftcited by 10
- 2025An Anatomy of Vision-Language-Action Models: From Modules to Milestones and Challengescited by 4
- 2026Towards Generalist Game Players: An Investigation of Foundation Models in the Game Multiversecited by 3
- 2026AI for Games in the Foundation Model Eracited by 3
- 2025IPR-1: Interactive Physical Reasonercited by 2
- 2026MAIN-VLA: Modeling Abstraction of Intention and eNvironment for Vision-Language-Action Modelscited by 2
- 2025A Cognitive-Mechanistic Human Reliability Analysis Framework: A Nuclear Power Plant Case Studycited by 1
2 more
- 2026Latent evolving World Action Modelcited by 0
- 2026Triggering Generalist Reasoning via Predictive Uncertainty for Dual-System VLAcited by 0
- 2026Triggering Generalist Reasoning via Predictive Uncertainty for Dual-System VLA4 Oct 2026
- 2026Latent evolving World Action Model23 Sep 2026
- 2026AI for Games in the Foundation Model Era15 Sep 2026
- 2026Towards Generalist Game Players: An Investigation of Foundation Models in the Game Multiverse11 May 2026
- 2026VLANeXt: Recipes for Building Strong VLA Models20 Feb 2026
- 2026MAIN-VLA: Modeling Abstraction of Intention and eNvironment for Vision-Language-Action Models2 Feb 2026
- 2026Scaling Behavior Cloning Improves Causal Reasoning: An Open Model for Real-Time Video Game Playing8 Jan 2026
- 2025An Anatomy of Vision-Language-Action Models: From Modules to Milestones and Challenges12 Dec 2025
- 2025IPR-1: Interactive Physical Reasoner19 Nov 2025
- 2025Vision-Language-Action Models for Robotics: A Review Towards Real-World Applications8 Oct 2025
- 2025Pure Vision Language Action (VLA) Models: A Comprehensive Survey23 Sep 2025
- 2025OpenHA: A Series of Open-Source Hierarchical Agentic Models in Minecraft13 Sep 2025
- 2025Vision-Language-Action Models for Robotics: A Review Towards Real-World Applicationscited by 84
- 2025Pure Vision Language Action (VLA) Models: A Comprehensive Surveycited by 49
- 2025JARVIS-VLA: Post-Training Large-Scale Vision Language Models to Play Visual Games with Keyboards and Mousecited by 28
- 2026VLANeXt: Recipes for Building Strong VLA Modelscited by 12
- 2026VLANeXt: Recipes for Building Strong VLA Models20 Feb 2026
- 2025Vision-Language-Action Models for Robotics: A Review Towards Real-World Applications8 Oct 2025
- 2025Pure Vision Language Action (VLA) Models: A Comprehensive Survey23 Sep 2025
- 2025JARVIS-VLA: Post-Training Large-Scale Vision Language Models to Play Visual Games with Keyboards and Mouse20 Mar 2025
- 2026Triggering Generalist Reasoning via Predictive Uncertainty for Dual-System VLA4 Oct 2026
- 2026MAIN-VLA: Modeling Abstraction of Intention and eNvironment for Vision-Language-Action Models2 Feb 2026
- 2025An Anatomy of Vision-Language-Action Models: From Modules to Milestones and Challenges12 Dec 2025
- 2026AI for Games in the Foundation Model Eracited by 3
- 2025IPR-1: Interactive Physical Reasonercited by 2
- 2026Latent evolving World Action Modelcited by 0
- 2026Latent evolving World Action Model23 Sep 2026
- 2026AI for Games in the Foundation Model Era15 Sep 2026
- 2025IPR-1: Interactive Physical Reasoner19 Nov 2025
Similar, not cited
Close in wording, no citation either way
- 2025V-MAGE: A Game Evaluation Framework for Assessing Vision-Centric Capabilities in Multimodal Large Language Models
- 2025VLA-OS: Structuring and Dissecting Planning Representations and Paradigms in Vision-Language-Action Models
- 2025Cultivating Game Sense for Yourself: Making VLMs Gaming Experts
- 2026NitroGen: An Open Foundation Model for Generalist Gaming Agents
- 2025Vision-Language-Action (VLA) Models: Concepts, Progress, Applications and Challenges
- 2026VLA-ATTC: Adaptive Test-Time Compute for VLA Models with Relative Action Critic Model
- 2026GameWAM: A World Action Model for Video Games
- 2025VideoGameBench: Can Vision-Language Models complete popular video games?