mlsanityData to 14 Oct 2026

Source-Grounded Semantic Reinforcement Learning for Low-Resource Target-Language Generation

arXiv 2605.29502 ↗First posted 28 May 2026cs.CL cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Low-resource target-language generation is often limited by scarce parallel data, while high-resource source-language monolingual data is abundant but difficult to use with standard supervised fine-tuning. We propose Source-Grounded Semantic Reinforcement Learning (SG-SRL), a resource-utilization framework that converts source-language monolingual data into cross-lingual semantic supervision for target-language generation. SG-SRL performs reference-free reinforcement learning (RL) on source-language data using a cross-lingual semantic reward model, instantiated by a cross-lingual reranker that scores the semantic relevance between the source input and the target-language generation. While this induces severe verbosity-based reward hacking, a lightweight recovery stage using a small parallel corpus restores fluency, conciseness, and task format while preserving the semantic gains. Experiments on Chinese-to-Thai generation show that SG-SRL improves semantic grounding and factual coverage over cold-start SFT. Additional analyses on long-form transfer and Tibetan embedding-based rewards clarify the generalization behavior of SG-SRL and show that an encoder-based semantic reward can substitute for an LLM-based reranker in a realistic low-resource language setting.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 15 of its 24 references that are in the map. First posted on arXiv 28 May 2026.

Builds on

15 of 24 references.

References · 15

  1. 2022Training language models to follow instructions with human feedbackcited by 15,971
  2. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  3. 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,935
  4. 2020mT5: A massively multilingual pre-trained text-to-text transformercited by 1,818
  5. 2016Concrete Problems in AI Safetycited by 1,642
  6. 2025Understanding R1-Zero-Like Training: A Critical Perspectivecited by 1,345
  7. 2019Passage Re-ranking with BERTcited by 645
  8. 2020Language-agnostic BERT Sentence Embeddingcited by 627
  9. 2024Aya Model: An Instruction Finetuned Open-Access Multilingual Language Modelcited by 295
  10. 2024mGTE: Generalized Long-Context Text Representation and Reranking Models for Multilingual Text Retrievalcited by 236
  11. 2021mMARCO: A Multilingual Version of the MS MARCO Passage Ranking Datasetcited by 116
  12. 2020Extending Multilingual BERT to Low-Resource Languagescited by 88
3 more
  1. 2024Adapting Multilingual LLMs to Low-Resource Languages using Continued Pre-training and Synthetic Corpuscited by 24
  2. 2026Reinforcement Learning with Semantic Rewards Enables Low-Resource Language Expansion without Alignment Taxcited by 3
  3. 2026FTibSuite: A Comprehensive Resource Suite for Tibetan Vision-Language Modelingcited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Reinforcement Learning Elicits Contextual Learning of Unseen Language Translation
  2. 2022Is Reinforcement Learning (Not) for Natural Language Processing: Benchmarks, Baselines, and Building Blocks for Natural Language Policy Optimization
  3. 2026Reference-Free Reinforcement Learning Fine-Tuning for MT: A Seq2Seq Perspective
  4. 2024Improving Sample Efficiency of Reinforcement Learning with Background Knowledge from Large Language Models
  5. 2025Aligning Multilingual Reasoning with Verifiable Semantics from a High-Resource Expert Model
  6. 2025Parent-Guided Semantic Reward Model (PGSRM): Embedding-Based Reward Functions for Reinforcement Learning of Transformer Language Models
  7. 2026Mending the Holes: Mitigating Reward Hacking in Reinforcement Learning for Multilingual Translation
  8. 2025LinguaFluid: Language Guided Fluid Control via Semantic Rewards in Reinforcement Learning