mlsanityData to 7 Oct 2026

MatchLM2Lite: A Scalable MLLM-to-Lite Framework for Reproduced Content Identification

arXiv 2606.14786 ↗First posted 10 Jun 2026cs.MM cs.AI cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

Content moderation is critical for online video platforms to ensure content safety, protect creators, and sustain positive user experiences. Beyond filtering harmful content, platforms must guarantee content authenticity at scale so that users are exposed to diverse, original videos rather than low-value reproductions. We present MatchLM2Lite, a real-time, production-grade reproduced content identification (RCI) system that leverages the powerful understanding of a multimodal large language model (MLLM) distilled into a small and fast-inference model. Our system jointly models video, audio, and text signals, operating on pairs of videos to produce fine-grained reproduction scores. The system comprises two modules, MatchLM and MatchLite, and a two-stage training recipe. First, our high-capacity MLLM, MatchLM, serves as a teacher model to define the upper bound of RCI performance. Its capabilities are then distilled into a compact student model, MatchLite. This design allows MatchLite to deliver low-latency, high-throughput inference on video pairs while preserving much of MatchLM's accuracy, making it suitable for integration into real-time recommendation systems. MatchLM achieves an F1-score improvement of +8.57 compared to our previous production model. After knowledge distillation, MatchLite retains a +6.55 gain in F1-score while reducing computational cost by 35x. Deployed at scale, MatchLM2Lite enables efficient, pairwise multimodal RCI, stably serving online traffic at high queries per second (QPS) with an end-to-end latency below 30 seconds. This system has reduced the reproduced video view rate on our platform by 2.5% without degrading user engagement, demonstrating its effectiveness in a large-scale production environment.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 35 of its 58 references that are in the map. First posted on arXiv 10 Jun 2026.

Builds on

35 of 58 references.

References · 35

  1. 2015Distilling the Knowledge in a Neural Networkcited by 10,076
  2. 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,243
  3. 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 3,972
  4. 2017Deep reinforcement learning from human preferencescited by 3,846
  5. 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,048
  6. 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,669
  7. 2023Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video Understandingcited by 1,461
  8. 2020MiniLM: Deep Self-Attention Distillation for Task-Agnostic Compression of Pre-Trained Transformerscited by 1,414
  9. 2023Video-LLaVA: Learning United Visual Representation by Alignment Before Projectioncited by 1,385
  10. 2023Safe RLHF: Safe Reinforcement Learning from Human Feedbackcited by 630
  11. 2025Qwen3-Omni Technical Reportcited by 451
  12. 2023Pengi: An Audio Language Model for Audio Taskscited by 217
23 more
  1. 2026Qwen3-VL-Embedding and Qwen3-VL-Reranker: A Unified Framework for State-of-the-Art Multimodal Retrieval and Rankingcited by 211
  2. 2025InternVideo2.5: Empowering Video MLLMs with Long and Rich Context Modelingcited by 203
  3. 2022A New Generation of Perspective API: Efficient Multilingual Character-level Transformerscited by 181
  4. 2024GME: Improving Universal Multimodal Retrieval by Multimodal LLMscited by 166
  5. 2024MM-Embed: Universal Multimodal Retrieval with Multimodal LLMscited by 159
  6. 2025Adaptive Keyframe Sampling for Long Video Understandingcited by 153
  7. 2023Voxtlm: unified decoder-only models for consolidating speech recognition/synthesis and speech/text continuation taskscited by 71
  8. 2024Beyond Answers: Transferring Reasoning Capabilities to Smaller LLMs Using Multi-Teacher Knowledge Distillationcited by 46
  9. 2024NoteLLM-2: Multimodal Large Representation Models for Recommendationcited by 44
  10. 2024LLaVA-MoD: Making LLaVA Tiny via MoE Knowledge Distillationcited by 43
  11. 2021FBERT: A Neural Transformer for Identifying Offensive Contentcited by 30
  12. 2025Policy-as-Prompt: Rethinking Content Moderation in the Age of Large Language Modelscited by 29
  13. 2025VLM as Policy: Common-Law Content Moderation Framework for Short Video Platformcited by 19
  14. 2021Conceptualising Contestability: Perspectives on Contesting Algorithmic Decisionscited by 18
  15. 2022TransVCL: Attention-enhanced Video Copy Localization Network with Flexible Supervisioncited by 15
  16. 2024Perceiving Longer Sequences With Bi-Directional Cross-Attention Transformerscited by 10
  17. 2023The 2023 Video Similarity Dataset and Challengecited by 9
  18. 2025Dynamic Content Moderation in Livestreams: Combining Supervised Classification with MLLM-Boosted Similarity Matchingcited by 4
  19. 2024COEF-VQ: Cost-Efficient Video Quality Understanding through a Cascaded Multimodal LLM Frameworkcited by 3
  20. 2026CAMEL: Confidence-Gated Reflection for Reward Modelingcited by 3
  21. 2024StopHC: A Harmful Content Detection and Mitigation Architecture for Social Media Platformscited by 2
  22. 2025Info-Coevolution: An Efficient Framework for Data Model Coevolutioncited by 2
  23. 2024The Effects of Short Video-Sharing Services on Video Copy Detectioncited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025Filter-And-Refine: A MLLM Based Cascade System for Industrial-Scale Video Content Moderation
  2. 2025FIFA: Unified Faithfulness Evaluation Framework for Text-to-Video and Video-to-Text Generation
  3. 2026MLLM-Guided Semantic Correction for Text-to-Video Generation
  4. 2024LOKI: A Comprehensive Synthetic Data Detection Benchmark using Large Multimodal Models
  5. 2025RO-Bench: Large-scale robustness evaluation of MLLMs with text-driven counterfactual videos
  6. 2026Multimodal Large Language Model-Enabled Video Translation: A Role-Oriented Survey
  7. 2025VideoEraser: Concept Erasure in Text-to-Video Diffusion Models
  8. 2025DIS-CO: Discovering Copyrighted Content in VLMs Training Data