RoadTones: Tone Controllable Text Generation from Road Event Videos
Not on the map. Why?
Abstract (arXiv)
Existing video-language models can generate factual descriptions of road events but lack control over how these events are expressed: their tone, urgency, or style. This limits deployment in communication-critical settings where the effectiveness of a message depends on both content and presentation, not just factual accuracy. To mitigate this, we introduce a comprehensive dataset-model-evaluation suite for tone-controllable road video captioning. Our human-validated data generation pipeline expands road-video corpora with diverse tonal annotations and multi-tone captions, yielding the RoadTones-51K dataset. We propose RoadTones-VL-CoT, a controllable video-to-text model that also generates tone-conditioned Chain-of-Thought intermediate drafts for interpretability. We also introduce RoadTones-Eval, a new evaluation suite that jointly measures factual consistency and tone adherence. In addition, we conducted a user study whose results validate caption quality, tone control, and factual consistency. Together, these contributions lay the foundation for context-sensitive tone-controllable video captioning.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 24 of its 36 references that are in the map. First posted on arXiv 20 May 2026.
Builds on
24 of 36 references.
References · 24
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
- 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,510
- 2023DriveLM: Driving with Graph Visual Question Answeringcited by 536
- 2025VideoLLaMA 3: Frontier Multimodal Foundation Models for Image and Video Understandingcited by 518
- 2024From Generation to Judgment: Opportunities and Challenges of LLM-as-a-judgecited by 494
- 2018Textual Explanations for Self-Driving Vehiclescited by 226
- 2025MiniCPM-V 4.5: Cooking Efficient MLLMs via Architecture, Data, and Training Recipecited by 186
- 2022DRAMA: Joint Risk Localization and Captioning in Drivingcited by 126
- 2023Dolphins: Multimodal Language Model for Drivingcited by 124
- 2021SUTD-TrafficQA: A Question Answering Benchmark and an Efficient Network for Video Reasoning over Traffic Eventscited by 84
- 2024Embodied Understanding of Driving Scenarioscited by 63
12 more
- 2018Engaging Image Captioning Via Personalitycited by 51
- 2015SentiCap: Generating Image Descriptions with Sentimentscited by 48
- 2019Controllable Video Captioning with POS Sequence Guidance Based on Gated Fusion Networkcited by 48
- 2024RoboTron-Drive: All-in-One Large Multimodal Model for Autonomous Drivingcited by 30
- 2018"Factual" or "Emotional": Stylized Image Captioning with Adaptive Learning and Attentioncited by 26
- 2021O2NA: An Object-Oriented Non-Autoregressive Approach for Controllable Video Captioningcited by 18
- 2025RoadSocial: A Diverse VideoQA Dataset and Benchmark for Road Event Understanding from Social Video Narrativescited by 15
- 2024IDD-X: A Multi-View Dataset for Ego-relative Important Object Localization and Explanation in Dense and Unstructured Trafficcited by 13
- 2021Controllable Video Captioning with an Exemplar Sentencecited by 9
- 2025IntentVCNet: Bridging Spatio-Temporal Gaps for Intention-Oriented Controllable Video Captioningcited by 7
- 2025CaptionSmiths: Flexibly Controlling Language Pattern in Image Captioningcited by 5
- 2024Fine-grained length controllable video captioning with ordinal embeddingscited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025VIBE: Annotation-Free Video-to-Text Information Bottleneck Evaluation for TL;DR
- 2025VCapsBench: A Large-scale Fine-grained Benchmark for Video Caption Quality Evaluation
- 2025CycliST: A Video Language Model Benchmark for Reasoning on Cyclical State Transitions
- 2025VC-Inspector: Advancing Reference-free Evaluation of Video Captions with Factual Analysis
- 2025FIFA: Unified Faithfulness Evaluation Framework for Text-to-Video and Video-to-Text Generation
- 2026Building a Precise Video Language with Human-AI Oversight
- 2025Unblocking Fine-Grained Evaluation of Detailed Captions: An Explaining AutoRater and Critic-and-Revise Pipeline
- 2024Progress-Aware Video Frame Captioning