mlsanityData to 14 Oct 2026

STREAM: Social data and knowledge collective intelligence platform for TRaining Ethical AI Models

arXiv 2310.05563 ↗First posted 9 Oct 2023cs.AIcited by 3

Not on the map. Why?

Abstract (arXiv)

This paper presents Social data and knowledge collective intelligence platform for TRaining Ethical AI Models (STREAM) to address the challenge of aligning AI models with human moral values, and to provide ethics datasets and knowledge bases to help promote AI models "follow good advice as naturally as a stream follows its course". By creating a comprehensive and representative platform that accurately mirrors the moral judgments of diverse groups including humans and AIs, we hope to effectively portray cultural and group variations, and capture the dynamic evolution of moral judgments over time, which in turn will facilitate the Establishment, Evaluation, Embedding, Embodiment, Ensemble, and Evolvement (6Es) of the moral capabilities of AI models. Currently, STREAM has already furnished a comprehensive collection of ethical scenarios, and amassed substantial moral judgment data annotated by volunteers and various popular Large Language Models (LLMs), collectively portraying the moral preferences and performances of both humans and AIs across a range of moral contexts. This paper will outline the current structure and construction of STREAM, explore its potential applications, and discuss its future prospects.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 14 of its 19 references that are in the map. First posted on arXiv 9 Oct 2023.

Builds on

14 of 19 references.

References · 14

  1. 2023GPT-4 Technical Reportcited by 18,396
  2. 2022Training language models to follow instructions with human feedbackcited by 15,971
  3. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
  4. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
  5. 2022Constitutional AI: Harmlessness from AI Feedbackcited by 3,050
  6. 2022GLM-130B: An Open Bilingual Pre-trained Modelcited by 843
  7. 2020Aligning AI With Shared Human Valuescited by 723
  8. 2019Social Bias Frames: Reasoning about Social and Power Implications of Languagecited by 380
  9. 2020Social Chemistry 101: Learning to Reason about Social and Moral Normscited by 255
  10. 2021Can Machines Learn Morality? The Delphi Experimentcited by 141
  11. 2020Moral Stories: Situated Reasoning about Norms, Intents, Actions, and their Consequencescited by 135
  12. 2022The Moral Integrity Corpus: A Benchmark for Ethical Dialogue Systemscited by 93
2 more
  1. 2022When to Make Exceptions: Exploring Language Models as Accounts of Human Moral Judgmentcited by 93
  2. 2023NormBank: A Knowledge Bank of Situational Social Normscited by 60

Built on by

Cited by year

Citing papers per year: 2024: 1; 2025: 2.

3 papers.