mlsanityData to 14 Oct 2026

OmniReasoning: Pushing the Limits of Audio-Visual Joint Reasoning

arXiv 2609.39490 ↗First posted 30 Sep 2026cs.CV cs.AIcited by 0

On the map: Knowledge distillation → Multimodal distillation

Abstract (arXiv)

Recent advances have enabled unified omni-modal models in understanding audio, vision, and language. However, existing benchmarks, training data, and learning methods largely treat the modalities independently, leaving the capability of audio-visual joint reasoning poorly evaluated and insufficiently elicited. We address this gap with a benchmark, data engine, and learning method. First, we introduce OmniReasoningBench, a benchmark where both audio and visual evidence are indispensable. It comprises 1,150 multiple-choice and open-ended questions across two tasks, reasoning over video and reasoning beyond video. Second, we develop a data engine OmniQA. It automatically constructs evidence-grounded QA pairs that explicitly necessitate audio-visual joint reasoning, together with time-stamped clue chains that guide the annotation of thinking process. Besides our benchmark, this engine produces training data OmniReasoning-SFT-112K and OmniReasoning-RL-19K. Finally, we propose an on-policy self-distillation method Modality-Factored Self-Distillation (MFSD). It evaluates each sampled response under modality-specific clue contexts, disentangling the contributions of individual clues and their cross-modal interactions for token-level credit assignment. With our training data and learning method, our model OmniReasoning-30B-A3B achieves 50.0% on OmniVideoBench and 42.5% on OmniReasoningBench, improving the base model Qwen3-Omni-30B-A3B-Thinking by 12.8 and 9.3 percentage points, respectively. Moreover, it delivers substantial gains on general and long-video benchmarks, including Video-MME-v2. We hope our work offers a solid step for facilitating future research in omni-modal joint reasoning.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Multimodal distillation, one of 12 directions in Knowledge distillation. Builds on 23 of its 30 references that are in the map. First posted on arXiv 30 Sep 2026.

Builds on

23 of 30 references.

References · 23

  1. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  2. 2025DAPO: An Open-Source LLM Reinforcement Learning System at Scalecited by 2,810
  3. 2025Group Sequence Policy Optimizationcited by 835
  4. 2025Qwen2.5-Omni Technical Reportcited by 736
  5. 2025Qwen3-Omni Technical Reportcited by 497
  6. 2025Video-R1: Reinforcing Video Reasoning in MLLMscited by 484
  7. 2026Self-Distilled Reasoner: On-Policy Self-Distillation for Large Language Modelscited by 455
  8. 2026Reinforcement Learning via Self-Distillationcited by 332
  9. 2026Qwen3.5-Omni Technical Reportcited by 174
  10. 2025WorldSense: Evaluating Real-world Omnimodal Understanding for Multimodal LLMscited by 155
  11. 2026Kimi K3: Open Frontier Intelligencecited by 138
  12. 2026Self-Distilled RLVRcited by 131
11 more
  1. 2025Daily-Omni: Towards Audio-Visual Reasoning with Temporal Alignment across Modalitiescited by 110
  2. 2025OmniVideoBench: Towards Audio-Visual Understanding Evaluation for Omni MLLMscited by 59
  3. 2026Video-MME-v2: Towards the Next Stage in Benchmarks for Comprehensive Video Understandingcited by 55
  4. 2025video-SALMONN 2: Caption-Enhanced Audio-Visual Large Language Modelscited by 47
  5. 2026Nemotron 3 Nano Omni: Efficient and Open Multimodal Intelligencecited by 30
  6. 2026LVOmniBench: Pioneering Long Audio-Video Understanding Evaluation for Omnimodal LLMscited by 24
  7. 2025JointAVBench: A Benchmark for Joint Audio-Visual Reasoning Evaluationcited by 17
  8. 2025AV-Reasoner: Improving and Benchmarking Clue-Grounded Audio-Visual Counting for MLLMscited by 16
  9. 2026OmniVideo-R1: Reinforcing Audio-visual Reasoning with Query Intention and Modality Attentioncited by 11
  10. 2026Video-KTR: Reinforcing Video Reasoning via Key Token Attributioncited by 10
  11. 2026OmniVideo-100K: A Dataset for Audio-Visual Reasoning through Structured Scripts and Evidence Chainscited by 8

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Omni-o3: Deep Nested Omnimodal Deduction for Deliberative Audio-Visual Reasoning
  2. 2026OmniSeek: Native Tool Integration for Multi-turn Audio-Visual Reasoning
  3. 2026Boosting Omni-Modal Language Models: Staged Post-Training with Visually Debiased Evaluation
  4. 2026LatentOmni: Rethinking Omni-Modal Understanding via Unified Audio-Visual Latent Reasoning
  5. 2025AURA: A Fine-Grained Benchmark and Decomposed Metric for Audio-Visual Reasoning
  6. 2026OmniJigsaw: Enhancing Omni-Modal Reasoning via Modality-Orchestrated Reordering
  7. 2026AVRT: Audio-Visual Reasoning Transfer through Single-Modality Teachers
  8. 2025A Benchmark for Omni-Modal Reasoning in Long Videos