mlsanityData to 7 Oct 2026

M-SQE: Multilingual Skill Quality Estimation for Enhancing Language Equality in Agentic Skill Use

arXiv 2609.18445 ↗First posted 16 Sep 2026cs.CLcited by 0

On the map: LLM agents and tool use → Agent skill learning and evolution

Abstract (arXiv)

Agent skills, reusable procedural documents that extend LLM agents beyond their parametric memory, have become an important interface for deploying agents on real-world tasks. Community-maintained skill libraries built around this interface are growing rapidly. However, this ecosystem remains deeply English-centric: our audit finds that low-resource languages such as Swahili and Hindi have no in-language skill content, so retrieval often returns a skill written in a different language than the query, degrading accuracy and recall. A practical solution is to synthesize in-language skills for retrieval but the quality can be unreliable, so relevance in this setting alone often surfaces a related but unusable candidate. To address this, we propose M-SQE, a post-retrieval Multilingual Skill Quality Estimation framework that scores candidates via a Theory view for intrinsic quality and an Action view for task-grounded utility, unified into a domain-conditioned final score. We evaluate M-SQE across three skill-use domains: general, tool-use, and cultural tasks. Empirically, we build three-layer candidate skill pools mirroring today's ecosystem, where M-SQE's task success exceeds existing baseline's average by at least +3.5 points across three different retrievers. Particularly, M-SQE lifts the lowest-resource languages most (+12.9pp on Hindi and +5.6pp on Swahili) and achieves strong performance across all six culture regions, thereby moving agentic skill use toward linguistic and cultural equality.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Agent skill learning and evolution, one of 16 directions in LLM agents and tool use. Builds on 10 of its 22 references that are in the map. First posted on arXiv 16 Sep 2026.

Builds on

10 of 22 references.

Closest ancestors · 1

Same direction, newest first

  1. 2026SkillsBench: Benchmarking How Well Agent Skills Work Across Diverse Tasks13 Feb

Other references · 9

  1. 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,779
  2. 2020The State and Fate of Linguistic Diversity and Inclusion in the NLP Worldcited by 789
  3. 2023What Makes Good Data for Alignment? A Comprehensive Study of Automatic Data Selection in Instruction Tuningcited by 354
  4. 2024On LLMs-Driven Synthetic Data Generation, Curation, and Evaluation: A Surveycited by 240
  5. 2020Sparse, Dense, and Attentional Representations for Text Retrievalcited by 213
  6. 2021mMARCO: A Multilingual Version of the MS MARCO Passage Ranking Datasetcited by 116
  7. 2024LLMs Beyond English: Scaling the Multilingual Capability of LLMs with Cross-Lingual Feedbackcited by 51
  8. 2026MADE: Beyond Scoring via a Multilingual Agentic Diagnosing Engine for Fine-Grained Evaluation Insightscited by 1
  9. 2026Beyond Monolingual Deep Research: Evaluating Agents and Retrievers with Cross-Lingual BrowseComp-Pluscited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Skill Is Not Document: Query-Conditioned Compatibility for LLM Agent Skill Routing
  2. 2026SkillCorpus: Consolidating and Evaluating the Open Skill Ecosystem for Real-World LLM Agents
  3. 2026SkillAudit: From Fixed-Suite Benchmarking to Skill-Centered Assessment
  4. 2026Imagine Before Retrieval: Prospective Skill Retrieval for LLM Agents
  5. 2026Skill-Use: Can LLMs Actually Use Skills in Agentic Harnesses?
  6. 2026Skill Following: Evaluating Actual Skill Use in Retrieval-Enabled LLM Agents
  7. 2026Skill Coverage: A Test Adequacy Metric for Agent Skills
  8. 2026SkillAxe: Sharpening LLM-Authored Agent Skills Through Evaluation-Guided Self-Refinement