mlsanityData to 7 Oct 2026

Expanding the Set of Pragmatic Considerations in Conversational AI

arXiv 2310.18435 ↗First posted 27 Oct 2023cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Despite considerable performance improvements, current conversational AI systems often fail to meet user expectations. We discuss several pragmatic limitations of current conversational AI systems. We illustrate pragmatic limitations with examples that are syntactically appropriate, but have clear pragmatic deficiencies. We label our complaints as "Turing Test Triggers" (TTTs) as they indicate where current conversational AI systems fall short compared to human behavior. We develop a taxonomy of pragmatic considerations intended to identify what pragmatic competencies a conversational AI system requires and discuss implications for the design and evaluation of conversational AI systems.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 27 of its 83 references that are in the map. First posted on arXiv 27 Oct 2023.

Builds on

27 of 83 references.

References · 27

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2020Language Models are Few-Shot Learnerscited by 32,199
  3. 2022Training language models to follow instructions with human feedbackcited by 15,712
  4. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
  5. 2017Deep reinforcement learning from human preferencescited by 3,846
  6. 2022OPT: Open Pre-trained Transformer Language Modelscited by 3,464
  7. 2019Fine-Tuning Language Models from Human Preferencescited by 2,124
  8. 2019Energy and Policy Considerations for Deep Learning in NLPcited by 1,242
  9. 2016ConceptNet 5.5: An Open Multilingual Graph of General Knowledgecited by 1,065
  10. 2019What BERT is not: Lessons from a new suite of psycholinguistic diagnostics for language modelscited by 317
  11. 2022BlenderBot 3: a deployed conversational agent that continually learns to responsibly engagecited by 197
  12. 2022Language models show human-like content effects on reasoning taskscited by 171
15 more
  1. 2020Re-evaluating Evaluation in Text Summarizationcited by 144
  2. 2020MIME: MIMicking Emotions for Empathetic Response Generationcited by 114
  3. 2019Proactive Human-Machine Conversation with Explicit Conversation Goalscited by 87
  4. 2021Language Model Evaluation Beyond Perplexitycited by 77
  5. 2023Prompted LLMs as Chatbot Modules for Long Open-domain Conversationcited by 61
  6. 2021Perspective-taking and Pragmatics for Generating Empathetic Responses Focused on Emotion Causescited by 43
  7. 2021Ask what's missing and what's useful: Improving Clarification Question Generation using Global Knowledgecited by 40
  8. 2021Pragmatic competence of pre-trained language models through the lens of discourse connectivescited by 16
  9. 2020Pragmatic Issue-Sensitive Image Captioningcited by 15
  10. 2022Learning to Mediate Disparities Towards Pragmatic Communicationcited by 14
  11. 2021A recipe for annotating grounded clarificationscited by 13
  12. 2021Calibrate your listeners! Robust communication-based training for pragmatic speakerscited by 9
  13. 2023Long-form analogies generated by chatGPT lack human-like psycholinguistic propertiescited by 8
  14. 2021Improving Social Meaning Detection with Pragmatic Masking and Surrogate Fine-Tuningcited by 5
  15. 2021Deciding Whether to Ask Clarifying Questions in Large-Scale Spoken Language Understandingcited by 5

Built on by

Not cited yet.