mlsanityData to 7 Oct 2026

VideoASMR-Bench: Can AI-Generated ASMR Videos Fool VLMs and Humans?

arXiv 2512.13281 ↗First posted 15 Dec 2025cs.CVcited by 2

Not on the map. Why?

Abstract (arXiv)

With AI-generated videos increasingly indistinguishable from reality, current benchmarks primarily focus on broad semantic alignment and basic physical consistency, offering limited discriminative power for evaluating them. To address this, we introduce VideoASMR-Bench, a benchmark based on Autonomous Sensory Meridian Response (ASMR) videos that emphasizes fine-grained audio-visual perception and sensory immersion. This benchmark aims to answer two key questions: (i) Are today's video understanding models (VLMs) sensitive enough to detect AI-generated ASMR videos by recognizing minor visual, physical, or auditory artifacts? (ii) Can today's video generation models (VGMs) produce convincing ASMR videos with immersive experiences? This benchmark comprises a diverse set of 1,500 high-quality real ASMR videos curated from social media, alongside 2,235 synthetic counterparts generated by nine VGMs. Additionally, we open-source an extensible suite of prompts and reference images, enabling the benchmark to scale dynamically with future video models. Moreover, we design an automatic understanding-generation evaluation framework between VGMs and VLMs, where VGMs aim to produce realistic fake videos to fool the VLMs, while the VLMs seek to detect them, forming an adversarial game between the two parties. Our evaluation on VideoASMR-Bench reveals that even state-of-the-art VLMs, such as Gemini-3-Pro, fail to reliably detect AI-generated ASMR videos. Meanwhile, current frontier video generation models can produce ASMR videos that are difficult for VLMs to distinguish from real ones, while humans can still identify them relatively easily.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 19 of its 21 references that are in the map. First posted on arXiv 15 Dec 2025.

Builds on

19 of 21 references.

References · 19

  1. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
  2. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,755
  3. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
  4. 2024Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysiscited by 1,375
  5. 2023MVBench: A Comprehensive Multi-modal Video Understanding Benchmarkcited by 1,086
  6. 2023SEED-Bench: Benchmarking Multimodal LLMs with Generative Comprehensioncited by 929
  7. 2025Qwen2.5-Omni Technical Reportcited by 704
  8. 2024TempCompass: Do Video LLMs Really Understand Videos?cited by 352
  9. 2022MM-Diffusion: Learning Multi-Modal Diffusion Models for Joint Audio and Video Generationcited by 225
  10. 2024VideoPhy: Evaluating Physical Commonsense for Video Generationcited by 215
  11. 2024T2V-CompBench: A Comprehensive Benchmark for Compositional Text-to-video Generationcited by 177
  12. 2024Towards World Simulator: Crafting Physical Commonsense-Based Benchmark for Video Generationcited by 167
7 more
  1. 2025Step-Video-T2V Technical Report: The Practice, Challenges, and Future of Video Foundation Modelcited by 163
  2. 2025Open-Sora 2.0: Training a Commercial-Level Video Generation Model in 200kcited by 157
  3. 2024DeMamba: AI-Generated Video Detection on Million-Scale GenVideo Benchmarkcited by 85
  4. 2024LOKI: A Comprehensive Synthetic Data Detection Benchmark using Large Multimodal Modelscited by 51
  5. 2024AV-DiT: Efficient Audio-Visual Diffusion Transformer for Joint Audio and Video Generationcited by 39
  6. 2025Step-Video-TI2V Technical Report: A State-of-the-Art Text-Driven Image-to-Video Generation Modelcited by 25
  7. 2025Impossible Videoscited by 16

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2023Perception Test: A Diagnostic Benchmark for Multimodal Video Models
  2. 2025Video-Bench: Human-Aligned Video Generation Benchmark
  3. 2026Multimodal Large Language Models as Synthetic Participants in Video-Based Studies: An Evaluation
  4. 2026MVPBench: A Multi-Video Perception Evaluation Benchmark for Multi-Modal Video Understanding
  5. 2026Physics-IQ Verified
  6. 2026AVBench: Human-Aligned and Automated Evaluation Benchmark for Audio-Video Generative Models
  7. 2024MMBench-Video: A Long-Form Multi-Shot Benchmark for Holistic Video Understanding
  8. 2026AVI-Bench: Toward Human-like Audio-Visual Intelligence of Omni-MLLMs