mlsanityData to 14 Oct 2026

Your AI Travel Agent Would Book You a Bullfight: An Agentic Benchmark for Implicit Animal Welfare in Frontier AI Models

arXiv 2606.18142 ↗First posted 16 Jun 2026cs.AI cs.CL cs.CYcited by 2

On the map: LLM agents and tool use → Social simulation and multi-agent debate

Abstract (arXiv)

Previous research has evaluated animal welfare using question-and-answer benchmarks. This study investigates whether these evaluations also hold in agentic settings. The agents may showcase different behaviors compared to stand-alone large language models, as demonstrated in prior studies. This work introduces textitTAC (Travel Agent Compassion): the first agentic benchmark for assessing animal exploitation. TAC evaluates AI agentic behavior in travel booking scenarios across six animal categories, using thirteen hand-authored scenarios that vary by price, rating, and position, expanded via four augmentation variants into 52 prompts and run for three epochs, giving 156 scored observations per model. Nine frontier models across five model families were evaluated.. The results indicate that models tend to prefer harmful scenarios, performing below the random chance rate of 65% for selecting a neutral booking option, with Claude 4.8 achieving the highest performance at 64.7%. To address this issue, the persona of an ethical-brand identity was infused into the system prompt, resulting in welfare rates increasing from 32 to 80 percentage points, with a mean of 53 across all nine models. No evidence of evaluation awareness affecting the results was found, based on an Inspect Scout audit of 3,120 transcripts. These findings are directly relevant to the EU General-Purpose AI Code of Practice, which identifies non-human welfare as a systemic risk. TAC provides a practical method for measuring this risk.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Social simulation and multi-agent debate, one of 16 directions in LLM agents and tool use. Builds on 14 of its 27 references that are in the map. First posted on arXiv 16 Jun 2026.

Builds on

14 of 27 references.

References · 14

  1. 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,373
  2. 2023Language Models Don't Always Say What They Think: Unfaithful Explanations in Chain-of-Thought Promptingcited by 1,122
  3. 2024Sleeper Agents: Training Deceptive LLMs that Persist Through Safety Trainingcited by 529
  4. 2024The WMDP Benchmark: Measuring and Reducing Malicious Use With Unlearningcited by 509
  5. 2025Large Language Models Often Know When They Are Being Evaluatedcited by 128
  6. 2025Probing and Steering Evaluation Awareness of Language Modelscited by 35
  7. 2026Alignment Pretraining: AI Discourse Causes Self-Fulfilling (Mis)alignmentcited by 33
  8. 2025Why Are Web AI Agents More Vulnerable Than Standalone LLMs? A Security Analysiscited by 27
  9. 2025Evaluation Awareness Scales Predictably in Open-Weights Large Language Modelscited by 14
  10. 2022Speciesist bias in AI -- How AI applications perpetuate discrimination and unfair outcomes against animalscited by 11
  11. 2026In-Context Environments Induce Evaluation-Awareness in Language Modelscited by 5
  12. 2025Speciesism in AI: Evaluating Discrimination Against Animals in Large Language Modelscited by 1
2 more
  1. 2026Untangling Input Language from Reasoning Language: A Diagnostic Framework for Cross-Lingual Moral Alignment in LLMscited by 1
  2. 2026Do LLMs Hold Their Values? MANTA: A Multi-Turn Adversarial Benchmark for Animal Welfare Reasoningcited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Preregistration for Experiments with AI Agents
  2. 2024Towards Full Delegation: Designing Ideal Agentic Behaviors for Travel Planning
  3. 2025CoBRA: Programming Cognitive Bias in Social Agents Using Classic Social Science Experiments
  4. 2025Model Editing as a Double-Edged Sword: Steering Agent Ethical Behavior Toward Beneficence or Harm
  5. 2026How to Dogfood Your AI Chat Agent: A Three-Layer Evaluation Framework with Goal-Directed NPC Simulation
  6. 2025MAEBE: Multi-Agent Emergent Behavior Framework
  7. 2025Aligning LLM agents with human learning and adjustment behavior: a dual agent approach
  8. 2025ESC-Judge: A Framework for Comparing Emotional Support Conversational Agents