mlsanityData to 14 Oct 2026

Sing it, Narrate it: Quality Musical Lyrics Translation

arXiv 2410.22066 ↗First posted 29 Oct 2024cs.CL cs.AI cs.SDcited by 2

Not on the map. Why?

Abstract (arXiv)

Translating lyrics for musicals presents unique challenges due to the need to ensure high translation quality while adhering to singability requirements such as length and rhyme. Existing song translation approaches often prioritize these singability constraints at the expense of translation quality, which is crucial for musicals. This paper aims to enhance translation quality while maintaining key singability features. Our method consists of three main components. First, we create a dataset to train reward models for the automatic evaluation of translation quality. Second, to enhance both singability and translation quality, we implement a two-stage training process with filtering techniques. Finally, we introduce an inference-time optimization framework for translating entire songs. Extensive experiments, including both automatic and human evaluations, demonstrate significant improvements over baseline methods and validate the effectiveness of each component in our approach.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 10 of its 27 references that are in the map. First posted on arXiv 29 Oct 2024.

Builds on

10 of 27 references.

References · 10

  1. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
  2. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
  3. 2023Efficient and Effective Text Encoding for Chinese LLaMA and Alpacacited by 305
  4. 2023Extrapolating Large Language Models to Non-English by Aligning Languagescited by 69
  5. 2023BigTranslate: Augmenting Large Language Models with Multilingual Translation Capability over 100 Languagescited by 60
  6. 2023TIM: Teaching Large Language Models to Translate with Comparisoncited by 50
  7. 2023Improving Translation Faithfulness of Large Language Models via Augmenting Instructionscited by 28
  8. 2022Automatic Song Translation for Tonal Languagescited by 12
  9. 2023Songs Across Borders: Singable and Controllable Neural Lyric Translationcited by 11
  10. 2023Translate the Beauty in Songs: Jointly Learning to Align Melody and Translate Lyricscited by 6

Built on by

Cited by year

Citing papers per year: 2025: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026VocalParse: Towards Unified and Scalable Singing Voice Transcription with Large Audio Language Models
  2. 2025LeVo: High-Quality Song Generation with Multi-Preference Alignment
  3. 2026Aligning Language Models for Lyric-to-Melody Generation with Rule-Based Musical Constraints
  4. 2026MuseCritic: Learning Multi-Aspect Song Rewards through Natural-Language Aesthetic Critiques
  5. 2026ARIA: Audio-Driven Melody-Tone Relation Modeling for Cantonese Lyric Authoring
  6. 2026SongCraft: Unified Song Generation and Editing with Reconstructive Learning ↗
  7. 2024SongGLM: Lyric-to-Melody Generation with 2D Alignment Encoding and Multi-Task Pre-Training
  8. 2026SegTune: Structured and Fine-Grained Control for Song Generation