mlsanityData to 14 Oct 2026

CombatVLA: An Efficient Vision-Language-Action Model for Combat Tasks in 3D Action Role-Playing Games

arXiv 2503.09527 ↗First posted 12 Mar 2025cs.CV cs.AIcited by 14

On the map: Vision-language-action models → Generalist VLA models and benchmarks

Abstract (arXiv)

Recent advances in Vision-Language-Action models (VLAs) have expanded the capabilities of embodied intelligence. However, significant challenges remain in real-time decision-making in complex 3D environments, which demand second-level responses, high-resolution perception, and tactical reasoning under dynamic conditions. To advance the field, we introduce CombatVLA, an efficient VLA model optimized for combat tasks in 3D action role-playing games(ARPGs). Specifically, our CombatVLA is a 3B model trained on video-action pairs collected by an action tracker, where the data is formatted as action-of-thought (AoT) sequences. Thereafter, CombatVLA seamlessly integrates into an action execution framework, allowing efficient inference through our truncated AoT strategy. Experimental results demonstrate that CombatVLA not only outperforms all existing models on the combat understanding benchmark but also achieves a 50-fold acceleration in game combat. Moreover, it has a higher task success rate than human players. We will open-source all resources, including the action tracker, dataset, benchmark, model weights, training code, and the implementation of the framework at https://combatvla.github.io/.

Key facts. Cited by 14 papers in the map (data through 14 Oct 2026). Placed in Generalist VLA models and benchmarks, one of 13 directions in Vision-language-action models. Builds on 37 of its 46 references that are in the map. First posted on arXiv 12 Mar 2025.

Builds on

37 of 46 references.

Closest ancestors · 1

Same direction, newest first

  1. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Control28 Jul

Other references · 36

  1. 2017Proximal Policy Optimization Algorithmscited by 15,215
  2. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  3. 2023Improved Baselines with Visual Instruction Tuningcited by 4,418
  4. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
  5. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
  6. 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,568
  7. 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
  8. 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,224
  9. 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,191
  10. 2023MME: A Comprehensive Evaluation Benchmark for Multimodal Large Language Modelscited by 1,652
  11. 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scalingcited by 1,599
  12. 2024Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysiscited by 1,413
24 more
  1. 2023ChatDev: Communicative Agents for Software Developmentcited by 919
  2. 2025UI-TARS: Pioneering Automated GUI Interaction with Native Agentscited by 610
  3. 2023OCRBench: On the Hidden Mystery of OCR in Large Multimodal Modelscited by 476
  4. 2023A Real-World WebAgent with Planning, Long Context Understanding, and Program Synthesiscited by 353
  5. 2023Vision-Language Foundation Models as Effective Robot Imitatorscited by 349
  6. 2024GR-2: A Generative Video-Language-Action Model with Web-Scale Knowledge for Robot Manipulationcited by 296
  7. 2024Mobile-Agent: Autonomous Multi-Modal Mobile Device Agent with Visual Perceptioncited by 293
  8. 2023Auto-GPT for Online Decision Making: Benchmarks and Additional Opinionscited by 255
  9. 2024ShowUI: One Vision-Language-Action Model for GUI Visual Agentcited by 232
  10. 2024Mobile-Agent-v2: Mobile Device Operation Assistant with Effective Navigation via Multi-Agent Collaborationcited by 189
  11. 2023JARVIS-1: Open-World Multi-task Agents with Memory-Augmented Multimodal Language Modelscited by 171
  12. 2024Fine-Tuning Large Vision-Language Models as Decision-Making Agents via Reinforcement Learningcited by 158
  13. 2022SMACv2: An Improved Benchmark for Cooperative Multi-Agent Reinforcement Learningcited by 122
  14. 2024DeeR-VLA: Dynamic Inference of Multimodal Large Language Models for Efficient Robot Executioncited by 117
  15. 2025Improving Vision-Language-Action Model with Online Reinforcement Learningcited by 116
  16. 2025PointVLA: Injecting the 3D World into Vision-Language-Action Modelscited by 105
  17. 2023Do LLMs Possess a Personality? Making the MBTI Test an Amazing Evaluation for Large Language Modelscited by 56
  18. 2025Analyzing and Boosting the Power of Fine-Grained Visual Recognition for Multi-modal Large Language Modelscited by 31
  19. 2024PokeLLMon: A Human-Parity Agent for Pokemon Battles with Large Language Modelscited by 26
  20. 2024Can VLMs Play Action Role-Playing Games? Take Black Myth Wukong as a Study Casecited by 24
  21. 2025HedgeAgents: A Balanced-aware Multi-agent Financial Trading Systemcited by 24
  22. 2025RTBAgent: A LLM-based Agent System for Real-Time Biddingcited by 14
  23. 2024Interpretability in Action: Exploratory Analysis of VPT, a Minecraft Agentcited by 4
  24. 2025"See the World, Discover Knowledge": A Chinese Factuality Evaluation for Large Vision Language Modelscited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 7; 2026: 7.

14 papers.

Sort:

By area:

Similar, not cited

Close in wording, no citation either way

  1. 2025V-MAGE: A Game Evaluation Framework for Assessing Vision-Centric Capabilities in Multimodal Large Language Models
  2. 2025VLA-OS: Structuring and Dissecting Planning Representations and Paradigms in Vision-Language-Action Models
  3. 2025Cultivating Game Sense for Yourself: Making VLMs Gaming Experts
  4. 2026NitroGen: An Open Foundation Model for Generalist Gaming Agents
  5. 2025Vision-Language-Action (VLA) Models: Concepts, Progress, Applications and Challenges
  6. 2026VLA-ATTC: Adaptive Test-Time Compute for VLA Models with Relative Action Critic Model
  7. 2026GameWAM: A World Action Model for Video Games
  8. 2025VideoGameBench: Can Vision-Language Models complete popular video games?