mlsanityData to 14 Oct 2026

MotionAtlas: Detailed Region Captioning for Motion-Centric Videos

arXiv 2606.29531 ↗First posted 28 Jun 2026cs.CV cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

We propose MotionAtlas, a system for detailed captioning of motion-centric videos, comprising (1) a dedicated human-annotated benchmark, (2) a scalable, high-quality pipeline to construct training samples, and (3) a family of powerful Video-MLLMs. Unlike conventional global motion captioning datasets, we focus on region-aware motion captioning: given a video and a spatiotemporal mask, the model generates precise descriptions of motion within the target region, thereby alleviating visual clutter and motion entanglement and enabling reliable, quantifiable evaluation. Concretely, we first build MotionAtlas-Bench, a comprehensive benchmark comprising 2,073 multiple-choice questions, meticulously annotated for a curated set of high-quality, motion-centric videos, to evaluate fine-grained motion understanding of the objects in question. Second, we design a rigorous and scalable data pipeline that leverages self-bootstrap refinement to suppress fine-grained hallucinations, yielding 159k high-quality motion captioning data. Third, we design a tailored training data composition strategy, which achieves consistent and substantial performance gains across diverse baseline Video-MLLMs, including Molmo2 and Qwen3-VL. For instance, MotionAtlas-4B surpasses Qwen3-VL-4B by an average of 5.2 percentage points across general motion benchmarks. The benchmark, dataset, and code have been released.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 44 of its 54 references that are in the map. First posted on arXiv 28 Jun 2026.

Builds on

44 of 54 references.

References · 44

  1. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
  2. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
  3. 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
  4. 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,510
  5. 2024Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysiscited by 1,413
  6. 2023MVBench: A Comprehensive Multi-modal Video Understanding Benchmarkcited by 1,109
  7. 2023SelfCheckGPT: Zero-Resource Black-Box Hallucination Detection for Generative Large Language Modelscited by 810
  8. 2021NExT-QA:Next Phase of Question-Answering to Explaining Temporal Actionscited by 744
  9. 2024LLaVA-Video: Video Instruction Tuning With Synthetic Datacited by 583
  10. 2019ActivityNet-QA: A Dataset for Understanding Complex Web Videos via Question Answeringcited by 561
  11. 2025VideoLLaMA 3: Frontier Multimodal Foundation Models for Image and Video Understandingcited by 518
  12. 2018GOT-10k: A Large High-Diversity Benchmark for Generic Object Tracking in the Wildcited by 475
32 more
  1. 2024VLMEvalKit: An Open-Source Toolkit for Evaluating Large Multi-Modality Modelscited by 455
  2. 2024ShareGPT4Video: Improving Video Understanding and Generation with Better Captionscited by 388
  3. 2024LMMs-Eval: Reality Check on the Evaluation of Large Multimodal Modelscited by 353
  4. 2023GPT4RoI: Instruction Tuning Large Language Model on Region-of-Interestcited by 302
  5. 2025LLaVA-OneVision-1.5: Fully Open Framework for Democratized Multimodal Trainingcited by 244
  6. 2023MeViS: A Large-scale Benchmark for Video Segmentation with Motion Expressionscited by 228
  7. 2021DanceTrack: Multi-Object Tracking in Uniform Appearance and Diverse Motioncited by 217
  8. 2023Osprey: Pixel Understanding with Visual Instruction Tuningcited by 159
  9. 2025Sa2VA: Marrying SAM2 with MLLM for Dense Grounded Understanding of Images and Videoscited by 159
  10. 2020TAO: A Large-Scale Benchmark for Tracking Any Objectcited by 147
  11. 2024Tarsier: Recipes for Training and Evaluating Large Video Description Modelscited by 141
  12. 2024AuroraCap: Efficient, Performant Video Detailed Captioning and a New Benchmarkcited by 140
  13. 2026Molmo2: Open Weights and Data for Vision-Language Models with Video Understanding and Groundingcited by 139
  14. 2024OMG-LLaVA: Bridging Image-level, Object-level, Pixel-level Reasoning and Understandingcited by 127
  15. 2022FineDiving: A Fine-grained Dataset for Procedure-aware Action Quality Assessmentcited by 107
  16. 2025PerceptionLM: Open-Access Data and Models for Detailed Visual Understandingcited by 92
  17. 2025Tarsier2: Advancing Large Vision-Language Models from Detailed Video Description to Comprehensive Video Understandingcited by 81
  18. 2025SpatialVID: A Large-Scale Video Dataset with Spatial Annotationscited by 77
  19. 2024TOMATO: Assessing Visual Temporal Reasoning Capabilities in Multimodal Foundation Modelscited by 73
  20. 2024VideoRefer Suite: Advancing Spatial-Temporal Object Understanding with Video LLMcited by 72
  21. 2024RegionGPT: Towards Region Understanding Vision Language Modelcited by 71
  22. 2025MotionBench: Benchmarking and Improving Fine-grained Video Motion Understanding for Vision Language Modelscited by 70
  23. 2025Perceive Anything: Recognize, Explain, Caption, and Segment Anything in Images and Videoscited by 51
  24. 2025Open-o3-Video: Grounded Video Reasoning with Explicit Spatio-Temporal Evidencecited by 49
  25. 2024Temporal Reasoning Transfer from Text to Videocited by 38
  26. 2025FAVOR-Bench: A Comprehensive Benchmark for Fine-Grained Video Motion Understandingcited by 24
  27. 2025PixelRefer: A Unified Framework for Spatio-Temporal Object Referring with Arbitrary Granularitycited by 21
  28. 2025Grasp Any Region: Towards Precise, Contextual Pixel Understanding for Multimodal LLMscited by 18
  29. 2024ViCaS: A Dataset for Combining Holistic and Pixel-level Video Understanding using Captions with Grounded Segmentationcited by 17
  30. 2025DenseWorld-1M: Towards Detailed Dense Grounded Caption in the Real Worldcited by 16
  31. 2025CaptionQA: Is Your Caption as Useful as the Image Itself?cited by 15
  32. 2025MotionSight: Boosting Fine-Grained Motion Understanding in Multimodal LLMscited by 11

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026KPM-Bench: A Kinematic Parsing Motion Benchmark for Fine-grained Motion-centric Video Understanding
  2. 2024Progress-Aware Video Frame Captioning
  3. 2025OwlCap: Harmonizing Motion-Detail for Video Captioning via HMD-270K and Caption Set Equivalence Reward
  4. 2026HumanMoveVQA: Can Video MLLMs reason about human movement in videos?
  5. 2025FoundationMotion: Auto-Labeling and Reasoning about Spatial Movement in Videos
  6. 2025PixFoundation 2.0: Do Video Multi-Modal LLMs Use Motion in Visual Grounding?
  7. 2026NextMotionQA: Benchmarking and Judging Human Motion Understanding with Vision-Language Models
  8. 2025VCapsBench: A Large-scale Fine-grained Benchmark for Video Caption Quality Evaluation