mlsanityData to 7 Oct 2026

Social and Ethical Risks Posed by General-Purpose LLMs for Settling Newcomers in Canada

arXiv 2407.20240 ↗First posted 15 Jul 2024cs.CY cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

The non-profit settlement sector in Canada supports newcomers in achieving successful integration. This sector faces increasing operational pressures amidst rising immigration targets, which highlights a need for enhanced efficiency and innovation, potentially through reliable AI solutions. The ad-hoc use of general-purpose generative AI, such as ChatGPT, might become a common practice among newcomers and service providers to address this need. However, these tools are not tailored for the settlement domain and can have detrimental implications for immigrants and refugees. We explore the risks that these tools might pose on newcomers to first, warn against the unguarded use of generative AI, and second, to incentivize further research and development in creating AI literacy programs as well as customized LLMs that are aligned with the preferences of the impacted communities. Crucially, such technologies should be designed to integrate seamlessly into the existing workflow of the settlement sector, ensuring human oversight, trustworthiness, and accountability.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 20 of its 43 references that are in the map. First posted on arXiv 15 Jul 2024.

Builds on

20 of 43 references.

References · 20

  1. 2022Training language models to follow instructions with human feedbackcited by 15,712
  2. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
  3. 2022Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedbackcited by 3,634
  4. 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,155
  5. 2021Ethical and social risks of harm from Language Modelscited by 957
  6. 2020Language (Technology) is Power: A Critical Survey of "Bias" in NLPcited by 951
  7. 2018The Secret Sharer: Evaluating and Testing Unintended Memorization in Neural Networkscited by 847
  8. 2023Check Your Facts and Try Again: Improving Large Language Models with External Knowledge and Automated Feedbackcited by 351
  9. 2023NeMo Guardrails: A Toolkit for Controllable and Safe LLM Applications with Programmable Railscited by 347
  10. 2024Hallucination is Inevitable: An Innate Limitation of Large Language Modelscited by 329
  11. 2023How Language Model Hallucinations Can Snowballcited by 310
  12. 2023Survey on Factuality in Large Language Models: Knowledge, Retrieval and Domain-Specificitycited by 204
8 more
  1. 2023"Kelly is a Warm Person, Joseph is a Role Model": Gender Biases in LLM-Generated Reference Letterscited by 196
  2. 2020Recipes for Safety in Open-domain Chatbotscited by 168
  3. 2023The Participatory Turn in AI Design: Theoretical Foundations and the Current State of Practicecited by 86
  4. 2019Embedding Symbolic Knowledge into Deep Networkscited by 49
  5. 2021Fairness for Unobserved Characteristics: Insights from Technological Impacts on Queer Communitiescited by 40
  6. 2021Envisioning Communities: A Participatory Approach Towards AI for Social Goodcited by 29
  7. 2023Physician Detection of Clinical Harm in Machine Translation: Quality Estimation Aids in Reliance and Backtranslation Identifies Critical Errorscited by 22
  8. 2020WES: Agent-based User Interaction Simulation on Real Infrastructurecited by 8

Built on by

Not cited yet.