mlsanityData to 14 Oct 2026

Solving Copyright Infringement on Short Video Platforms: Novel Datasets and an Audio Restoration Deep Learning Pipeline

arXiv 2504.21772 ↗First posted 30 Apr 2025cs.MM cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Short video platforms like YouTube Shorts and TikTok face significant copyright compliance challenges, as infringers frequently embed arbitrary background music (BGM) to obscure original soundtracks (OST) and evade content originality detection. To tackle this issue, we propose a novel pipeline that integrates Music Source Separation (MSS) and cross-modal video-music retrieval (CMVMR). Our approach effectively separates arbitrary BGM from the original OST, enabling the restoration of authentic video audio tracks. To support this work, we introduce two domain-specific datasets: OASD-20K for audio separation and OSVAR-160 for pipeline evaluation. OASD-20K contains 20,000 audio clips featuring mixed BGM and OST pairs, while OSVAR-160 is a unique benchmark dataset comprising 1,121 video and mixed-audio pairs, specifically designed for short video restoration tasks. Experimental results demonstrate that our pipeline not only removes arbitrary BGM with high accuracy but also restores OSTs, ensuring content integrity. This approach provides an ethical and scalable solution to copyright challenges in user-generated content on short video platforms.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 14 of its 40 references that are in the map. First posted on arXiv 30 Apr 2025.

Builds on

14 of 40 references.

References · 14

  1. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  2. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
  3. 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,057
  4. 2014CNN Features off-the-shelf: an Astounding Baseline for Recognitioncited by 316
  5. 2017Interpretable 3D Human Action Analysis with Temporal Convolutional Networkscited by 89
  6. 2022Music Source Separation with Band-split RNNcited by 70
  7. 2019Demucs: Deep Extractor for Music Sources with extra unlabeled data remixedcited by 54
  8. 2023Music Source Separation with Band-Split RoPE Transformercited by 37
  9. 2022On loss functions and evaluation metrics for music source separationcited by 17
  10. 2020Multimodal Metric Learning for Tag-based Music Retrievalcited by 14
  11. 2021Cross-Modal Music-Video Recommendation: A Study of Design Choicescited by 11
  12. 2021Cross-modal Variational Auto-encoder for Content-based Micro-video Background Music Recommendationcited by 10
2 more
  1. 2020Audio-based Near-Duplicate Video Retrieval with Audio Similarity Learningcited by 3
  2. 2023Unified Pretraining Target Based Video-music Retrieval With Music Rhythm And Video Optical Flow Informationcited by 2

Built on by

Not cited yet.