mlsanityData to 7 Oct 2026

Cross-lingual Functional Vectors for Emotion Detection in Large Language Models

arXiv 2608.29613 ↗First posted 30 Aug 2026cs.CL cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Function vectors (FVs) have recently emerged as a promising mechanism for steering the behavior of large language models (LLMs) by injecting task-specific latent direction representations derived from in-context demonstrations. While prior studies have shown that FVs can recover task behavior in structured in-context learning settings, their effectiveness on semantically complex tasks and their ability to generalize across languages remain underexplored. We investigate the cross-lingual transferability of FVs using multilingual multi-label emotion recognition as a challenging semantic classification benchmark. Specifically, we examine whether FVs extracted from a source language can steer task behavior in another language under both standard clean and perturbed zero-shot settings without providing demonstrations during inference. Across diverse cross-lingual settings, applying FVs substantially improves performance, suggesting that FVs capture language-agnostic, task-relevant signals rather than purely language-specific lexical patterns, and highlighting their potential as a lightweight and transferable mechanism for multilingual task adaptation. We observe that each LLM exhibits a relatively stable optimal range of attention heads for constructing effective FVs, and the pattern remains consistent across languages. In addition, FVs can partially replicate the task-steering effects of standard few-shot in-context learning while avoiding the computational overhead of processing multiple demonstrations, making them effective for large-scale practical applications. Our code is available at https://github.com/yingjie7/cross_lingual_fvs.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 14 of its 23 references that are in the map. First posted on arXiv 30 Aug 2026.

Builds on

14 of 23 references.

References · 14

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2022Interpretability in the Wild: a Circuit for Indirect Object Identification in GPT-2 smallcited by 1,130
  3. 2023In-Context Learning Creates Task Vectorscited by 302
  4. 2013Direct and Indirect Effectscited by 276
  5. 2024Do Llamas Work in English? On the Latent Language of Multilingual Transformerscited by 275
  6. 2023In-context Vectors: Making In Context Learning More Effective and Controllable Through Latent Space Steeringcited by 240
  7. 2023Label Words are Anchors: An Information Flow Perspective for Understanding In-Context Learningcited by 235
  8. 2025Do Multilingual LLMs Think In English?cited by 75
  9. 2023How Do Transformers Learn In-Context Beyond Simple Functions? A Case Study on Learning with Representationscited by 72
  10. 2024Converging to a Lingua Franca: Evolution of Linguistic Regions and Semantics Alignment in Multilingual Large Language Modelscited by 22
  11. 2024Evaluating the Capabilities of Large Language Models for Multi-label Emotion Understandingcited by 17
  12. 2025SemEval-2025 Task 11: Bridging the Gap in Text-Based Emotion Detectioncited by 9
2 more
  1. 2025The Transfer Neurons Hypothesis: An Underlying Mechanism for Language Latent Space Transitions in Multilingual LLMscited by 8
  2. 2026Cross-Lingual Activation Steering for Multilingual Language Modelscited by 4

Built on by

Not cited yet.