mlsanityData to 7 Oct 2026

compar:IA: The French Government's LLM arena to collect French-language human prompts and preference data

arXiv 2602.06669 ↗First posted 6 Feb 2026cs.CL cs.AIcited by 2

On the map: LLM alignment / RLHF / preference optimisation → Human values and AI feedback alignment

Abstract (arXiv)

Large Language Models (LLMs) often show reduced performance, cultural alignment, and safety robustness in non-English languages, partly because English dominates both pre-training data and human preference alignment datasets. Training methods like Reinforcement Learning from Human Feedback (RLHF) and Direct Preference Optimization (DPO) require human preference data, which remains scarce and largely non-public for many languages beyond English. To address this gap, we introduce compar:IA, an open-source digital public service developed inside the French government and designed to collect large-scale human preference data from a predominantly French-speaking general audience. The platform uses a blind pairwise comparison interface to capture unconstrained, real-world prompts and user judgments across a diverse set of language models, while maintaining low participation friction and privacy-preserving automated filtering. As of 2026-02-07, compar:IA has collected over 600,000 free-form prompts and 250,000 preference votes, with approximately 89% of the data in French. We release three complementary datasets -- conversations, votes, and reactions -- under open licenses, and present initial analyses, including a French-language model leaderboard and user interaction patterns. Beyond the French context, compar:IA is evolving toward an international digital public good, offering reusable infrastructure for multilingual model training, evaluation, and the study of human-AI interaction.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Human values and AI feedback alignment, one of 10 directions in LLM alignment / RLHF / preference optimisation. Builds on 14 of its 21 references that are in the map. First posted on arXiv 6 Feb 2026.

Builds on

14 of 21 references.

Closest ancestors · 3

Same direction, newest first

  1. 2025Flattery, Fluff, and Fog: Diagnosing and Mitigating Idiosyncratic Biases in Preference Models5 Jun
  2. 2024The Future of Open Human Feedback15 Aug
  3. 2024Chatbot Arena: An Open Platform for Evaluating LLMs by Human Preference7 Mar

Other references · 11

  1. 2022Training language models to follow instructions with human feedbackcited by 15,712
  2. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
  3. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
  4. 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,907
  5. 2017Deep reinforcement learning from human preferencescited by 3,846
  6. 2023Towards Understanding Sycophancy in Language Modelscited by 988
  7. 2023A Long Way to Go: Investigating Length Correlations in RLHFcited by 285
  8. 2022Challenges and Strategies in Cross-Cultural NLPcited by 216
  9. 2025The Leaderboard Illusioncited by 57
  10. 2024From Lists to Emojis: How Format Bias Affects Model Alignmentcited by 48
  11. 2025Detecting Prefix Bias in LLM-based Reward Modelscited by 11

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2024Optimizing LLMs with Direct Preferences: A Data Efficiency Perspective
  2. 2024A Survey on Human Preference Learning for Large Language Models
  3. 2024Data-Centric Human Preference with Rationales for Direct Preference Alignment
  4. 2026Unpacking Human Preference for LLMs: Demographically Aware Evaluation with the HUMAINE Framework
  5. 2024Towards Data-Centric RLHF: Simple Metrics for Preference Dataset Comparison
  6. 2025WorldPM: Scaling Human Preference Modeling
  7. 2025HelpSteer3-Preference: Open Human-Annotated Preference Data across Diverse Tasks and Languages
  8. 2025COIG-P: A High-Quality and Large-Scale Chinese Preference Dataset for Alignment with Human Values