mlsanityData to 14 Oct 2026

AlignNet: A Unifying Approach to Audio-Visual Alignment

arXiv 2002.05070 ↗First posted 12 Feb 2020cs.CV cs.LG cs.MMcited by 13

Not on the map. Why?

Abstract (arXiv)

We present AlignNet, a model that synchronizes videos with reference audios under non-uniform and irregular misalignments. AlignNet learns the end-to-end dense correspondence between each frame of a video and an audio. Our method is designed according to simple and well-established principles: attention, pyramidal processing, warping, and affinity function. Together with the model, we release a dancing dataset Dance50 for training and evaluation. Qualitative, quantitative and subjective evaluation results on dance-music alignment and speech-lip alignment demonstrate that our method far outperforms the state-of-the-art methods. Project video and code are available at https://jianrenw.github.io/AlignNet.

Key facts. Cited by 13 papers in the map (data through 14 Oct 2026). First posted on arXiv 12 Feb 2020.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2021: 1; 2022: 4; 2023: 3; 2024: 1; 2025: 3; 2026: 1.

13 papers.

Sort:

  1. 2023Audio-Enhanced Text-to-Video Retrieval using Text-Conditioned Feature Alignmentcited by 21
  2. 2023Long-Term Rhythmic Video Soundtrackercited by 17
  3. 2022TempCLR: Temporal Alignment Representation with Contrastive Learningcited by 15
  4. 2024PEAVS: Perceptual Evaluation of Audio-Visual Synchrony Grounded in Viewers' Opinion Scorescited by 13
  5. 2021TriBERT: Full-body Human-centric Audio-visual Representation Learning for Visual Sound Separationcited by 6
  6. 2025Let Your Video Listen to Your Music!cited by 3
  7. 2022MLink: Linking Black-Box Models from Multiple Domains for Collaborative Inferencecited by 2
  8. 2022Audio-Visual Fusion Layers for Event Type Aware Video Recognitioncited by 1
  9. 2023Video-to-Music Recommendation using Temporal Alignment of Segmentscited by 1
  10. 2025ESG-Net: Event-Aware Semantic Guided Network for Dense Audio-Visual Event Localizationcited by 1
  11. 2026Beyond Time Shifts: Adapting Omni-LLM as a Reference-Free Evaluator for Generative Audio-Visual Modelscited by 1
  12. 2022Learning Music-Dance Representations through Explicit-Implicit Rhythm Synchronizationcited by 0
1 more
  1. 2025Enhancing Explainability with Multimodal Context Representations for Smarter Robotscited by 0