mlsanityData to 14 Oct 2026

Open-Ended Video Game Glitch Detection with Agentic Reasoning and Temporal Grounding

arXiv 2604.07818 ↗First posted 9 Apr 2026cs.MAcited by 3

On the map: LLM agents and tool use → Multimodal and embodied agents

Abstract (arXiv)

Open-ended video game glitch detection aims to identify glitches in gameplay videos, describe them in natural language, and localize when they occur. Unlike conventional game glitch understanding tasks which have largely been framed as image-level recognition or closed-form question answering, this task requires reasoning about game-specific dynamics such as mechanics, physics, rendering, animation, and expected state transitions directly over continuous gameplay videos and distinguishing true glitches from unusual but valid in-game events. To support this task, we introduce VideoGlitchBench, the first benchmark for open-ended video game glitch detection with temporal localization. VideoGlitchBench contains 5,238 gameplay videos from 120 games, each annotated with detailed glitch descriptions and precise temporal spans, enabling unified evaluation of semantic understanding and temporal grounding. We further propose GliDe, an agentic framework with three key components: a game-aware contextual memory for informed reasoning, a debate-based reflector for multi-perspective glitch detection and verification, and an event-level grounding module that recovers complete glitch intervals from fragmented temporal evidence. We also design a task-specific evaluation protocol that jointly measures semantic fidelity and temporal accuracy. Experiments show that this task remains highly challenging for current multimodal models, while GliDe achieves substantially stronger performance than corresponding vanilla model baselines.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 21 of its 39 references that are in the map. First posted on arXiv 9 Apr 2026.

Builds on

21 of 39 references.

Closest ancestors · 2

Same direction, newest first

  1. 2025VideoMind: A Chain-of-LoRA Agent for Temporal-Grounded Video Reasoning17 Mar
  2. 2024VideoAgent: Long-form Video Understanding with Large Language Model as Agent15 Mar

Other references · 19

  1. 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,719
  2. 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scalingcited by 1,599
  3. 2018Real-world Anomaly Detection in Surveillance Videoscited by 577
  4. 2019Memorizing Normality to Detect Anomaly: Memory-augmented Deep Autoencoder for Unsupervised Anomaly Detectioncited by 564
  5. 2017Future Frame Prediction for Anomaly Detection -- A New Baselinecited by 391
  6. 2016Learning Temporal Regularity in Video Sequencescited by 254
  7. 2020Not only Look, but also Listen: Learning Multimodal Violence Detection under Weak Supervisioncited by 238
  8. 2024A Survey on Large Language Model-Based Game Agentscited by 112
  9. 2020A Survey of Single-Scene Video Anomaly Detectioncited by 88
  10. 2021Augmenting Automated Game Testing with Deep Reinforcement Learningcited by 38
  11. 2023GlitchBench: Can large multimodal models detect video game glitches?cited by 23
  12. 2019Automated Video Game Testing Using Synthetic and Human-Like Agentscited by 22
7 more
  1. 2024PhysGame: Uncovering Physical Commonsense Violations in Gameplay Videoscited by 22
  2. 2023Dense Video Captioning: A Survey of Techniques, Datasets and Evaluation Protocolscited by 17
  3. 2022CLIP meets GamePhysics: Towards bug identification in gameplay videos using zero-shot transfer learningcited by 15
  4. 2022Large Language Models are Pretty Good Zero-Shot Video Game Bug Detectorscited by 14
  5. 2025VideoGameQA-Bench: Evaluating Vision-Language Models for Video Game Quality Assurancecited by 11
  6. 2022Inspector: Pixel-Based Automated Game Testing via Exploration, Detection, and Investigationcited by 7
  7. 2022Learning to Identify Perceptual Bugs in 3D Video Gamescited by 6

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026TempGlitch: Evaluating Vision-Language Models for Temporal Glitch Detection in Gameplay Videos
  2. 2026RefGlitch-Bench: A Benchmark for Reference-based Gameplay Glitch Detection with Vision-Language Models
  3. 2026How Far Can VLMs Go for Visual Bug Detection? Studying 19,738 Keyframes from 41 Hours of Gameplay Videos
  4. 2026Order from Chaos: Physical World Understanding from Glitchy Gameplay Videos
  5. 2026Video-Arena: A Scalable Agentic Video Benchmark for Spatiotemporal Capability
  6. 2025VideoGameBench: Can Vision-Language Models complete popular video games?
  7. 2026GameplayQA: A Benchmarking Framework for Decision-Dense POV-Synced Multi-Video Understanding of 3D Virtual Agents
  8. 2026Open-o3-Video-v2: Seek, Ground, and Reason with Verifiable Spatio-Temporal Evidence