Cross-lingual Functional Vectors for Emotion Detection in Large Language Models
Not on the map. Why?
Abstract (arXiv)
Function vectors (FVs) have recently emerged as a promising mechanism for steering the behavior of large language models (LLMs) by injecting task-specific latent direction representations derived from in-context demonstrations. While prior studies have shown that FVs can recover task behavior in structured in-context learning settings, their effectiveness on semantically complex tasks and their ability to generalize across languages remain underexplored. We investigate the cross-lingual transferability of FVs using multilingual multi-label emotion recognition as a challenging semantic classification benchmark. Specifically, we examine whether FVs extracted from a source language can steer task behavior in another language under both standard clean and perturbed zero-shot settings without providing demonstrations during inference. Across diverse cross-lingual settings, applying FVs substantially improves performance, suggesting that FVs capture language-agnostic, task-relevant signals rather than purely language-specific lexical patterns, and highlighting their potential as a lightweight and transferable mechanism for multilingual task adaptation. We observe that each LLM exhibits a relatively stable optimal range of attention heads for constructing effective FVs, and the pattern remains consistent across languages. In addition, FVs can partially replicate the task-steering effects of standard few-shot in-context learning while avoiding the computational overhead of processing multiple demonstrations, making them effective for large-scale practical applications. Our code is available at https://github.com/yingjie7/cross_lingual_fvs.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 14 of its 23 references that are in the map. First posted on arXiv 30 Aug 2026.
Builds on
14 of 23 references.
References · 14
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2022Interpretability in the Wild: a Circuit for Indirect Object Identification in GPT-2 smallcited by 1,130
- 2023In-Context Learning Creates Task Vectorscited by 302
- 2013Direct and Indirect Effectscited by 276
- 2024Do Llamas Work in English? On the Latent Language of Multilingual Transformerscited by 275
- 2023In-context Vectors: Making In Context Learning More Effective and Controllable Through Latent Space Steeringcited by 240
- 2023Label Words are Anchors: An Information Flow Perspective for Understanding In-Context Learningcited by 235
- 2025Do Multilingual LLMs Think In English?cited by 75
- 2023How Do Transformers Learn In-Context Beyond Simple Functions? A Case Study on Learning with Representationscited by 72
- 2024Converging to a Lingua Franca: Evolution of Linguistic Regions and Semantics Alignment in Multilingual Large Language Modelscited by 22
- 2024Evaluating the Capabilities of Large Language Models for Multi-label Emotion Understandingcited by 17
- 2025SemEval-2025 Task 11: Bridging the Gap in Text-Based Emotion Detectioncited by 9
Built on by
Not cited yet.