mlsanityData to 14 Oct 2026

MOBA-VL: Event-Localized Multi-Turn Reinforcement Learning for Real-Time MOBA Commentary

arXiv 2609.38428 ↗First posted 29 Sep 2026cs.CVcited by 0

On the map: Deep reinforcement learning methods → RL for robot locomotion and manipulation

Abstract (arXiv)

Real-time commentary for Multiplayer Online Battle Arena (MOBA) esports requires a vision-language model (VLM) to narrate a live match second by second, both fluently and accurately. Existing streaming VLMs sound natural but often miss key events such as kills and objectives. To address this limitation, we use game telemetry, which records exactly when each event occurs, as a supervision signal. We introduce MOBA-VL, a 9B-parameter model trained on this signal with event-localized multi-turn reinforcement learning, which rewards the turns that describe each event. We also collect MOBACast, 860 professional matches (about 460 hours) across three MOBA games with word-level timestamped commentary, and MOBACast-Bench, a benchmark from held-out tournaments. On MOBACast-Bench, MOBA-VL achieves the highest Overall score on full matches (63.25 vs. 55.12 for StreamingVLM) and clips (63.45 vs. 56.22 for DeepSeek-V4.1-Flash). Event-localized credit also raises event recall from 34.5 to 42.1 over supervised fine-tuning. Code and data will be released, and demos are available on an anonymous project page at https://moba-vl.github.io.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in RL for robot locomotion and manipulation, one of 15 directions in Deep reinforcement learning methods. Builds on 5 of its 29 references that are in the map. First posted on arXiv 29 Sep 2026.

Builds on

5 of 29 references.

References · 5

  1. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  2. 2026DeepSeek-V4: Towards Highly Efficient Million-Token Context Intelligencecited by 1,040
  3. 2025OpenHelix: A Short Survey, Empirical Analysis, and Open-Source Dual-System VLA Model for Robotic Manipulationcited by 82
  4. 2026DeepSeek-V4.1-Flash: Pushing the Limits of KV Cache Compressioncited by 76
  5. 2024Game-MUG: Multimodal Oriented Game Situation Understanding and Commentary Generation Datasetcited by 3

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Content Based Video Narration of Gameplay with Vision Language Models
  2. 2024Arena Learning: Build Data Flywheel for LLMs Post-training via Simulated Chatbot Arena
  3. 2026Learning in Dreams, Winning in Reality: A Continuous Dyna Loop for a Ten-Hero MOBA
  4. 2026Scouting By Reward: VLM-TO-IRL-Driven Player Selection For Esports
  5. 2026VLMs for Videogame Data Annotation
  6. 2026EgoEsportsQA: An Egocentric Video Benchmark for Perception and Reasoning in Esports
  7. 2026Training a Conditioned Video Game Agent on a VLM Annotated Dataset
  8. 2025RLinf-VLA: A Unified and Efficient Framework for Reinforcement Learning of Vision-Language-Action Models