mlsanityData to 14 Oct 2026

G-IdiomAlign: A Gloss-Pivoted Benchmark for Cross-Lingual Idiom Alignment

arXiv 2606.18989 ↗First posted 17 Jun 2026cs.CL cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Idioms are difficult to transfer across languages due to their non-compositionality and weak surface-form grounding, making literal mappings unreliable. We present G-IdiomAlign, a gloss-pivoted benchmark where each idiom is anchored by an English gloss from Wiktionary. We further construct a high-confidence reference alignment set for reproducible evaluation. G-IdiomAlign supports two protocols: (1) a controlled Multiple-Choice Idiom Equivalence with typed distractors for error attribution; and (2) a Gloss-Contrastive Generation contrasting No-gloss and With-gloss inputs to isolate the effect of an explicit semantic pivot. Across diverse LLMs, a bias to literal translation is a dominant failure mode, especially when the target is a low-resource language. Glosses consistently improve Gloss-Contrastive Generation under an embedding-based semantic proxy, but performance remains modest, indicating substantial headroom in the open output space. Subsequent analysis on Qwen3-8B further suggests that cross-condition differences are concentrated more in attention heads than in layers, while better With-gloss generations coincide with stronger gloss anchoring.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 12 of its 33 references that are in the map. First posted on arXiv 17 Jun 2026.

Builds on

12 of 33 references.

References · 12

  1. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
  2. 2020EPIE Dataset: A Corpus For Possible Idiomatic Expressionscited by 24
  3. 2023Translate Meanings, Not Just Words: IdiomKB's Role in Optimizing Idiomatic Translation with Language Modelscited by 24
  4. 2024Improving LLM Abilities in Idiomatic Translationcited by 16
  5. 2018LIDIOMS: A Multilingual Linked Idioms Data Setcited by 15
  6. 2023Crossing the Threshold: Idiomatic Machine Translation through Retrieval Augmentation and Loss Weightingcited by 11
  7. 2024A Hard Nut to Crack: Idiom Detection with Conversational Large Language Modelscited by 11
  8. 2024Rolling the DICE on Idiomaticity: How LLMs Fail to Grasp Contextcited by 11
  9. 2024Comparative Study of Multilingual Idioms and Similes in Large Language Modelscited by 10
  10. 2025Chengyu-Bench: Benchmarking Large Language Models for Chinese Idiom Understanding and Usecited by 8
  11. 2025Probing Semantic Alignment, Lexical Invariance, and Syntactic Influence in LLM Metaphor Processingcited by 5
  12. 2025Evaluating LLMs on Chinese Idiom Translationcited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Evaluating Multilingual and Code-Switched Alignment in LLMs via Synthetic Natural Language Inference
  2. 2024Locally Measuring Cross-lingual Lexical Alignment: A Domain and Word Level Perspective
  3. 2026A Rising Tide Lifts All Boats: MTQE Rewards for Idioms Improve General Translation Quality
  4. 2025Benchmarking Cross-Lingual Semantic Alignment in Multilingual Embeddings
  5. 2026When Meaning Travels: A Granular Lens on Hybrid-MoE's Role in Idiomatic Understanding for Language Models
  6. 2026Soft Token Alignment for Cross-Lingual Reasoning
  7. 2026A Dataset for Probing Translationese Preferences in English-to-Swedish Translation
  8. 2026When Meaning Isn't Literal: Exploring Idiomatic Meaning Across Languages and Modalities