mlsanityData to 7 Oct 2026

Toward Responsible and Epistemically Grounded Multilingual LLMs for Computational Social Science and Humanities

arXiv 2606.00596 ↗First posted 30 May 2026cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Large language models have rapidly evolved in multilingual competence and reasoning capacity, enabling their integration into Social Sciences and Humanities research workflows. Yet existing evaluation paradigms remain anchored in task-based NLP benchmarks and fail to address interpretive validity, cultural situatedness, and epistemic mediation. This paper reconceptualizes multilingual reasoning LLMs as hermeneutic instruments that actively structure meaning production across linguistic and cultural contexts. Drawing on hermeneutics, philosophy of technology, science and technology studies, multilingual NLP research, and computational social science methodology, we develop a theoretically grounded framework for evaluating multilingual reasoning in Social Sciences and Humanities (SSH) research. We articulate a rigorous experimental protocol with operationalized metrics for cultural alignment, cross-lingual stability, and reasoning faithfulness, along with transparency requirements tailored to interpretive research tasks. We illustrate the framework through a concrete application scenario involving multilingual political discourse analysis. The paper contributes a conceptual and methodological foundation for responsible integration of multilingual reasoning LLMs into computational social science infrastructures.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 20 of its 58 references that are in the map. First posted on arXiv 30 May 2026.

Builds on

20 of 58 references.

References · 20

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
  3. 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,304
  4. 2021On the Opportunities and Risks of Foundation Modelscited by 3,961
  5. 2024A Survey on LLM-as-a-Judgecited by 1,384
  6. 2023Language Models Don't Always Say What They Think: Unfaithful Explanations in Chain-of-Thought Promptingcited by 1,081
  7. 2018Model Cards for Model Reportingcited by 1,068
  8. 2018XNLI: Evaluating Cross-lingual Sentence Representationscited by 913
  9. 2023ChatGPT Outperforms Crowd-Workers for Text-Annotation Taskscited by 849
  10. 2020The State and Fate of Linguistic Diversity and Inclusion in the NLP Worldcited by 789
  11. 2022Out of One, Many: Using Language Models to Simulate Human Samplescited by 737
  12. 2024Humans or LLMs as the Judge? A Study on Judgement Biasescited by 314
8 more
  1. 2024Aya Model: An Instruction Finetuned Open-Access Multilingual Language Modelcited by 292
  2. 2021MasakhaNER: Named Entity Recognition for African Languagescited by 155
  3. 2023ChatGPT-4 Outperforms Experts and Crowd Workers in Annotating Political Twitter Messages with Zero-Shot Learningcited by 97
  4. 2020Masakhane -- Machine Translation For Africacited by 48
  5. 2024MBBQ: A Dataset for Cross-Lingual Comparison of Stereotypes in Generative LLMscited by 32
  6. 2024Codebook LLMs: Evaluating LLMs as Measurement Tools for Political Science Conceptscited by 28
  7. 2025An Evaluation of Cultural Value Alignment in LLMcited by 28
  8. 2025On The Origin of Cultural Biases in Language Models: From Pre-training Data to Linguistic Phenomenacited by 21

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026On Epistemic Diversity in Large Language Models
  2. 2025Cross-linguistic disagreement as a conflict of semantic alignment norms in multilingual AI~Linguistic Diversity as a Problem for Philosophy, Cognitive Science, and AI~
  3. 2025CURE: Cultural Understanding and Reasoning Evaluation - A Framework for "Thick" Culture Alignment Evaluation in LLMs
  4. 2025Large Language Models for History, Philosophy, and Sociology of Science: Interpretive Uses, Methodological Challenges, and Critical Perspectives
  5. 2025CRaFT: An Explanation-Based Framework for Evaluating Cultural Reasoning in Multilingual Language Models
  6. 2025Moral Reasoning Across Languages: The Critical Role of Low-Resource Languages in LLMs
  7. 2026XCR-Bench: Benchmarking Cross-Cultural Reasoning in LLMs via Culture-Specific Items and Hall's Triad
  8. 2023Are Multilingual LLMs Culturally-Diverse Reasoners? An Investigation into Multicultural Proverbs and Sayings