mlsanityData to 14 Oct 2026

TLive-Omni: An Omni-Modal Understanding Model for E-Commerce Live Streaming

arXiv 2608.20958 ↗First posted 21 Aug 2026cs.AI cs.CVcited by 2

Not on the map. Why?

Abstract (arXiv)

E-commerce live streaming requires omni-modal understanding of noisy, temporally extended streams, where product facts are distributed across speech, video frames, product images, overlaid text, and user queries. We present TLive-Omni, an omni-modal understanding model tailored to live-commerce scenarios. It maps image, video, audio, and text inputs into a unified representation space. For long-form live streaming analysis, we introduce Per-vGrid, a timestamped token organization that groups each video grid with its temporally corresponding audio within explicit boundary tokens to facilitate temporal alignment. We design a three-stage supervised training recipe that progressively develops live-commerce understanding, from omni-modal perception to instruction-following responses. We then propose Faithful-RFT, a reinforcement fine-tuning stage that further improves answer faithfulness and expression quality while meeting real-time demands, scoring final responses directly with task-verifiable feedback rather than optimizing for reasoning-style exploration during rollout. Moreover, TLive-Omni is supported by a scenario-oriented atomic capability taxonomy and a compact data production engine that converts live-commerce audio, image, and video streams into training signals for speech recognition, speaker analysis, product visual grounding, text recognition, temporal grounding, video dense caption, and omni-modal QA, etc. For scalable training, a synchronized length-grouped sampler reduces padding while preserving comparable workloads across workers, while a lightweight dynamic sampling strategy regenerates rollout groups with near-zero reward variance to maintain meaningful relative advantages for GRPO. Experiments on e-commerce live streaming benchmarks demonstrate strong performance across live-commerce domain tasks, together with excellent generalization on general benchmarks.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 48 of its 65 references that are in the map. First posted on arXiv 21 Aug 2026.

Builds on

48 of 65 references.

References · 48

  1. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  2. 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,944
  3. 2023MMBench: Is Your Multi-modal Model an All-around Player?cited by 2,141
  4. 2023MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGIcited by 2,080
  5. 2023MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contextscited by 1,614
  6. 2024Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysiscited by 1,413
  7. 2019ZeRO: Memory Optimizations Toward Training Trillion Parameter Modelscited by 1,301
  8. 2023MVBench: A Comprehensive Multi-modal Video Understanding Benchmarkcited by 1,109
  9. 2016Modeling Context in Referring Expressionscited by 1,063
  10. 2024Are We on the Right Way for Evaluating Large Vision-Language Models?cited by 914
  11. 2016A Diagram Is Worth A Dozen Imagescited by 804
  12. 2024LongVideoBench: A Benchmark for Long-context Interleaved Video-Language Understandingcited by 665
36 more
  1. 2023HallusionBench: An Advanced Diagnostic Suite for Entangled Language Hallucination and Visual Illusion in Large Vision-Language Modelscited by 583
  2. 2023OCRBench: On the Hidden Mystery of OCR in Large Multimodal Modelscited by 476
  3. 2024LVBench: An Extreme Long Video Understanding Benchmarkcited by 410
  4. 2024LongVILA: Scaling Long-Context Visual Language Models for Long Videoscited by 309
  5. 2025Video-MMMU: Evaluating Knowledge Acquisition from Multi-Discipline Professional Videoscited by 236
  6. 2024CharXiv: Charting Gaps in Realistic Chart Understanding in Multimodal LLMscited by 234
  7. 2025MiniCPM-V 4.5: Cooking Efficient MLLMs via Architecture, Data, and Training Recipecited by 186
  8. 2020TransNet V2: An effective deep network architecture for fast shot transition detectioncited by 171
  9. 2025WorldSense: Evaluating Real-world Omnimodal Understanding for Multimodal LLMscited by 155
  10. 2024DynaMath: A Dynamic Visual Benchmark for Evaluating Mathematical Reasoning Robustness of Vision Language Modelscited by 146
  11. 2025Time-R1: Post-Training Large Vision Language Model for Temporal Video Groundingcited by 146
  12. 2024Kangaroo: A Powerful Video-Language Model Supporting Long-context Video Inputcited by 134
  13. 2025Video-Holmes: Can MLLM Think Like Holmes for Complex Video Reasoning?cited by 118
  14. 2025Daily-Omni: Towards Audio-Visual Reasoning with Temporal Alignment across Modalitiescited by 110
  15. 2025Perception-Aware Policy Optimization for Multimodal Reasoningcited by 99
  16. 2024CC-OCR: A Comprehensive and Challenging OCR Benchmark for Evaluating Large Multimodal Models in Literacycited by 81
  17. 2025SimpleVQA: Multimodal Factuality Evaluation for Multimodal Large Language Modelscited by 66
  18. 2025OmniVideoBench: Towards Audio-Visual Understanding Evaluation for Omni MLLMscited by 59
  19. 2025TimeLens: Rethinking Video Temporal Grounding with Multimodal LLMscited by 50
  20. 2025Video-XL-2: Towards Very Long-Video Understanding Through Task-Aware KV Sparsificationcited by 37
  21. 2025Audio-centric Video Understanding Benchmark without Text Shortcutcited by 36
  22. 2025InteractiveOmni: A Unified Omni-modal Model for Audio-Visual Multi-turn Dialoguecited by 29
  23. 2023MeetEval: A Toolkit for Computation of Word Error Rates for Meeting Transcription Systemscited by 28
  24. 2026VideoChat3: Fully Open Video MLLM for Efficient and Generalist Video Understandingcited by 10
  25. 2026Mage-VL: An Efficient Codec-Native Streaming Multimodal Foundation Modelcited by 10
  26. 2025OmniDPO: A Preference Optimization Framework to Address Omni-Modal Hallucinationcited by 9
  27. 2025Group Relative Policy Optimization for Speech Recognitioncited by 8
  28. 2026LiViBench: An Omnimodal Benchmark for Interactive Livestream Video Understandingcited by 8
  29. 2025MOON: Generative MLLM-based Multimodal Representation Learning for E-commerce Product Understandingcited by 7
  30. 2026FutureOmni: Evaluating Future Forecasting from Omni-Modal Context for Multimodal LLMscited by 7
  31. 2025MOON2.0: Dynamic Modality-balanced Multimodal Representation Learning for E-commerce Product Understandingcited by 5
  32. 2026E-VAds: An E-commerce Short Videos Understanding Benchmark for MLLMscited by 4
  33. 2026MOON3.0: Reasoning-aware Multimodal Representation Learning for E-commerce Product Understandingcited by 4
  34. 2026Disentangling Perception and Reasoning in Multimodal LLMs via Reward Designcited by 3
  35. 2026PDCR: Perception-Decomposed Confidence Reward for Vision-Language Reasoningcited by 3
  36. 2026Valley3: Scaling Omni Foundation Models for E-commercecited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026StreamOV: Streaming Omni-Video Understanding via Evidence-Guided Memory and Response Triggering
  2. 2025A Benchmark for Omni-Modal Reasoning in Long Videos
  3. 2025OmniMMI: A Comprehensive Multi-modal Interaction Benchmark in Streaming Video Contexts
  4. 2026Beyond Single Videos: Benchmarking and Active Evidence Seeking for E-Commerce Cross-Video Reasoning
  5. 2026OmniInteract: Benchmarking Real-World Streaming Interaction for Real-Time Omnimodal Assistants
  6. 2026StreamArena: Toward Continuous, Interactive, and Long-Horizon Agentic Streaming Video Understanding
  7. 2026StreamReady: Learning What to Answer and When in Long Streaming Videos
  8. 2026OmniJigsaw: Enhancing Omni-Modal Reasoning via Modality-Orchestrated Reordering