mlsanityData to 14 Oct 2026

Whose Journey Matters? Investigating Identity Biases in Large Language Models (LLMs) for Travel Planning Assistance

arXiv 2410.17333 ↗First posted 22 Oct 2024cs.AI cs.CL cs.CYcited by 2

Not on the map. Why?

Abstract (arXiv)

As large language models (LLMs) become increasingly integral to the hospitality and tourism industry, concerns about their fairness in serving diverse identity groups persist. Grounded in social identity theory and sociotechnical systems theory, this study examines ethnic and gender biases in travel recommendations generated by LLMs. Using fairness probing, we analyze outputs from three leading open-source LLMs. The results show that test accuracy for both ethnicity and gender classifiers exceed random chance. Analysis of the most influential features reveals the presence of stereotype bias in LLM-generated recommendations. We also found hallucinations among these features, occurring more frequently in recommendations for minority groups. These findings indicate that LLMs exhibit ethnic and gender bias when functioning as travel planning assistants. This study underscores the need for bias mitigation strategies to improve the inclusivity and reliability of generative AI-driven travel planning assistance.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 24 of its 84 references that are in the map. First posted on arXiv 22 Oct 2024.

Builds on

24 of 84 references.

References · 24

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2022Training language models to follow instructions with human feedbackcited by 15,971
  3. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  4. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
  5. 2022Scaling Instruction-Finetuned Language Modelscited by 3,024
  6. 2022Survey of Hallucination in Natural Language Generationcited by 2,075
  7. 2016Understanding intermediate layers using linear classifier probescited by 1,353
  8. 2018What you can cram into a single vector: Probing sentence embeddings for linguistic propertiescited by 457
  9. 2022Emergent World Representations: Exploring a Sequence Model Trained on a Synthetic Taskcited by 431
  10. 2023"Kelly is a Warm Person, Joseph is a Role Model": Gender Biases in LLM-Generated Reference Letterscited by 199
  11. 2023Gender bias and stereotypes in Large Language Modelscited by 187
  12. 2023Cultural Bias and Cultural Alignment of Large Language Modelscited by 149
12 more
  1. 2021Hallucinated but Factual! Inspecting the Factuality of Hallucinations in Abstractive Summarizationcited by 129
  2. 2023Generative Language Models Exhibit Social Identity Biasescited by 111
  3. 2023The Participatory Turn in AI Design: Theoretical Foundations and the Current State of Practicecited by 87
  4. 2024Evaluating Gender Bias in Large Language Models via Chain-of-Thought Promptingcited by 50
  5. 2023The Unequal Opportunities of Large Language Models: Revealing Demographic Bias through Job Recommendationscited by 41
  6. 2023Probing Explicit and Implicit Gender Bias through LLM Conditional Text Generationcited by 31
  7. 2024Unmasking and Quantifying Racial Bias of Large Language Models in Medical Report Generationcited by 31
  8. 2024The Silicon Ceiling: Auditing GPT's Race and Gender Biases in Hiringcited by 29
  9. 2024Evaluating the Experience of LGBTQ+ People Using Large Language Model Based Chatbots for Mental Health Supportcited by 14
  10. 2023ChatGPT Exhibits Gender and Racial Biases in Acute Coronary Syndrome Managementcited by 3
  11. 2023Fine-tuned LLMs Know More, Hallucinate Less with Few-Shot Sequence-to-Sequence Semantic Parsing over Wikidatacited by 2
  12. 2023Multilingual Tourist Assistance using ChatGPT: Comparing Capabilities in Hindi, Telugu, and Kannadacited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 1.

2 papers.