AmazonQA: A Review-Based Question Answering Task
Not on the map. Why?
Abstract (arXiv)
Every day, thousands of customers post questions on Amazon product pages. After some time, if they are fortunate, a knowledgeable customer might answer their question. Observing that many questions can be answered based upon the available product reviews, we propose the task of review-based QA. Given a corpus of reviews and a question, the QA system synthesizes an answer. To this end, we introduce a new dataset and propose a method that combines information retrieval techniques for selecting relevant reviews (given a question) and "reading comprehension" models for synthesizing an answer (given a question and review). Our dataset consists of 923k questions, 3.6M answers and 14M reviews across 156k products. Building on the well-known Amazon dataset, we collect additional annotations, marking each question as either answerable or unanswerable based on the available reviews. A deployed system could first classify a question as answerable and then attempt to generate an answer. Notably, unlike many popular QA datasets, here, the questions, passages, and answers are all extracted from real human interactions. We evaluate numerous models for answer generation and propose strong baselines, demonstrating the challenging nature of this new task.
Key facts. Cited by 43 papers in the map (data through 7 Oct 2026). First posted on arXiv 12 Aug 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 5; 2022: 9; 2023: 6; 2024: 9; 2025: 10; 2026: 4.
43 papers.
Sort:
By area:
- 2022One Embedder, Any Task: Instruction-Finetuned Text Embeddingscited by 329
- 2024Nomic Embed: Training a Reproducible Long Context Text Embeddercited by 255
- 2024Generative Representational Instruction Tuningcited by 227
- 2021GALAXY: A Generative Pre-trained Model for Task-Oriented Dialog with Semi-Supervised Learning and Explicit Policy Injectioncited by 102
- 2021QA Dataset Explosion: A Taxonomy of NLP Resources for Question Answering and Reading Comprehensioncited by 91
- 2023Context-faithful Prompting for Large Language Modelscited by 76
- 2024eCeLLM: Generalizing Large Language Models for E-commerce from Large-scale, High-quality Instruction Datacited by 44
- 2022SPACE-3: Unified Dialog Model Pre-training for Task-Oriented Dialog Understanding and Generationcited by 34
- 2022SPACE-2: Tree-Structured Semi-Supervised Contrastive Pre-training for Task-Oriented Dialog Understandingcited by 28
- 2021English Machine Reading Comprehension Datasets: A Surveycited by 26
- 2024Shopping MMLU: A Massive Multi-Task Online Shopping Benchmark for Large Language Modelscited by 20
- 2024Contextual Document Embeddingscited by 19
31 more
- 2021Towards Personalized Answer Generation in E-Commerce via Multi-Perspective Preference Modelingcited by 16
- 2025NeoBERT: A Next-Generation BERTcited by 14
- 2022Match-Prompt: Improving Multi-task Generalization Ability for Neural Text Matching via Prompt Learningcited by 10
- 2023Product Question Answering in E-Commerce: A Surveycited by 10
- 2026F2LLM-v2: Inclusive, Performant, and Efficient Embeddings for a Multilingual Worldcited by 10
- 2025WixQA: A Multi-Dataset Benchmark for Enterprise Retrieval-Augmented Generationcited by 9
- 2025F2LLM Technical Report: Matching SOTA Embedding Performance with 6 Million Open-Source Datacited by 8
- 2024Captions Speak Louder than Images: Generalizing Foundation Models for E-commerce from High-quality Multimodal Instruction Datacited by 6
- 2023QUADRo: Dataset and Models for QUestion-Answer Database Retrievalcited by 5
- 2024Database-Augmented Query Representation for Information Retrievalcited by 5
- 2025EcomMMMU: Strategic Utilization of Visuals for Robust Multimodal E-commerce Modelscited by 5
- 2025AIP: Subverting Retrieval-Augmented Generation via Adversarial Instructional Promptcited by 5
- 2024BSharedRAG: Backbone Shared Retrieval-Augmented Generation for the E-commerce Domaincited by 4
- 2025LEAF: Knowledge Distillation of Text Embedding Models with Teacher-Aligned Representationscited by 4
- 2021Distantly Supervised Transformers For E-Commerce Product QAcited by 3
- 2022PLAtE: A Large-scale Dataset for List Page Web Extractioncited by 3
- 2023UniPCM: Universal Pre-trained Conversation Model with Task-aware Automatic Promptcited by 3
- 2025Generative Representational Learning of Foundation Models for Recommendationcited by 2
- 2025Contextually Aware E-Commerce Product Question Answering using RAGcited by 2
- 2026SAGE: A Self-Evolving Agentic Graph-Memory Engine for Structure-Aware Associative Memorycited by 2
- 2022Comparative Snippet Generationcited by 0
- 2022Mining Duplicate Questions of Stack Overflowcited by 0
- 2022Modular Approach to Machine Reading Comprehension: Mixture of Task-Aware Expertscited by 0
- 2022Answer ranking in Community Question Answering: a deep learning approachcited by 0
- 2023OpinionConv: Conversational Product Search with Grounded Opinionscited by 0
- 2023Answering Subjective Induction Questions on Products by Summarizing Multi-sources Multi-viewpoints Knowledgecited by 0
- 2024Unlocking Markets: A Multilingual Benchmark to Cross-Market Question Answeringcited by 0
- 2025QQSUM: A Novel Task and Model of Quantitative Query-Focused Summarization for Review-based Product Question Answeringcited by 0
- 2025Improving Document Retrieval Coherence for Semantically Equivalent Queriescited by 0
- 2026Adapting Vision-Language Models for E-commerce Understanding at Scalecited by 0
- 2026ML-Embed: Inclusive and Efficient Embeddings for a Multilingual Worldcited by 0
- 2026ML-Embed: Inclusive and Efficient Embeddings for a Multilingual World14 May 2026
- 2026SAGE: A Self-Evolving Agentic Graph-Memory Engine for Structure-Aware Associative Memory12 May 2026
- 2026F2LLM-v2: Inclusive, Performant, and Efficient Embeddings for a Multilingual World19 Mar 2026
- 2026Adapting Vision-Language Models for E-commerce Understanding at Scale12 Feb 2026
- 2025F2LLM Technical Report: Matching SOTA Embedding Performance with 6 Million Open-Source Data2 Oct 2025
- 2025AIP: Subverting Retrieval-Augmented Generation via Adversarial Instructional Prompt18 Sep 2025
- 2025LEAF: Knowledge Distillation of Text Embedding Models with Teacher-Aligned Representations16 Sep 2025
- 2025EcomMMMU: Strategic Utilization of Visuals for Robust Multimodal E-commerce Models21 Aug 2025
- 2025Improving Document Retrieval Coherence for Semantically Equivalent Queries11 Aug 2025
- 2025Contextually Aware E-Commerce Product Question Answering using RAG4 Aug 2025
- 2025Generative Representational Learning of Foundation Models for Recommendation13 Jun 2025
- 2025QQSUM: A Novel Task and Model of Quantitative Query-Focused Summarization for Review-based Product Question Answering4 Jun 2025
31 more
- 2025WixQA: A Multi-Dataset Benchmark for Enterprise Retrieval-Augmented Generation13 May 2025
- 2025NeoBERT: A Next-Generation BERT26 Feb 2025
- 2024Shopping MMLU: A Massive Multi-Task Online Shopping Benchmark for Large Language Models28 Oct 2024
- 2024Captions Speak Louder than Images: Generalizing Foundation Models for E-commerce from High-quality Multimodal Instruction Data22 Oct 2024
- 2024Contextual Document Embeddings3 Oct 2024
- 2024BSharedRAG: Backbone Shared Retrieval-Augmented Generation for the E-commerce Domain30 Sep 2024
- 2024Unlocking Markets: A Multilingual Benchmark to Cross-Market Question Answering24 Sep 2024
- 2024Database-Augmented Query Representation for Information Retrieval23 Jun 2024
- 2024Generative Representational Instruction Tuning15 Feb 2024
- 2024eCeLLM: Generalizing Large Language Models for E-commerce from Large-scale, High-quality Instruction Data13 Feb 2024
- 2024Nomic Embed: Training a Reproducible Long Context Text Embedder2 Feb 2024
- 2023UniPCM: Universal Pre-trained Conversation Model with Task-aware Automatic Prompt20 Sep 2023
- 2023Answering Subjective Induction Questions on Products by Summarizing Multi-sources Multi-viewpoints Knowledge12 Sep 2023
- 2023OpinionConv: Conversational Product Search with Grounded Opinions8 Aug 2023
- 2023QUADRo: Dataset and Models for QUestion-Answer Database Retrieval30 Mar 2023
- 2023Context-faithful Prompting for Large Language Models20 Mar 2023
- 2023Product Question Answering in E-Commerce: A Survey16 Feb 2023
- 2022One Embedder, Any Task: Instruction-Finetuned Text Embeddings19 Dec 2022
- 2022Answer ranking in Community Question Answering: a deep learning approach16 Oct 2022
- 2022Modular Approach to Machine Reading Comprehension: Mixture of Task-Aware Experts4 Oct 2022
- 2022Mining Duplicate Questions of Stack Overflow4 Oct 2022
- 2022SPACE-3: Unified Dialog Model Pre-training for Task-Oriented Dialog Understanding and Generation14 Sep 2022
- 2022SPACE-2: Tree-Structured Semi-Supervised Contrastive Pre-training for Task-Oriented Dialog Understanding14 Sep 2022
- 2022Comparative Snippet Generation11 Jun 2022
- 2022PLAtE: A Large-scale Dataset for List Page Web Extraction24 May 2022
- 2022Match-Prompt: Improving Multi-task Generalization Ability for Neural Text Matching via Prompt Learning6 Apr 2022
- 2021Towards Personalized Answer Generation in E-Commerce via Multi-Perspective Preference Modeling27 Dec 2021
- 2021GALAXY: A Generative Pre-trained Model for Task-Oriented Dialog with Semi-Supervised Learning and Explicit Policy Injection29 Nov 2021
- 2021QA Dataset Explosion: A Taxonomy of NLP Resources for Question Answering and Reading Comprehension27 Jul 2021
- 2021Distantly Supervised Transformers For E-Commerce Product QA7 Apr 2021
- 2021English Machine Reading Comprehension Datasets: A Survey25 Jan 2021
- 2025WixQA: A Multi-Dataset Benchmark for Enterprise Retrieval-Augmented Generationcited by 9
- 2025AIP: Subverting Retrieval-Augmented Generation via Adversarial Instructional Promptcited by 5
- 2024BSharedRAG: Backbone Shared Retrieval-Augmented Generation for the E-commerce Domaincited by 4
- 2025Contextually Aware E-Commerce Product Question Answering using RAGcited by 2
- 2025AIP: Subverting Retrieval-Augmented Generation via Adversarial Instructional Prompt18 Sep 2025
- 2025Contextually Aware E-Commerce Product Question Answering using RAG4 Aug 2025
- 2025WixQA: A Multi-Dataset Benchmark for Enterprise Retrieval-Augmented Generation13 May 2025
- 2024BSharedRAG: Backbone Shared Retrieval-Augmented Generation for the E-commerce Domain30 Sep 2024
- 2025NeoBERT: A Next-Generation BERTcited by 14
- 2025NeoBERT: A Next-Generation BERT26 Feb 2025
- 2022One Embedder, Any Task: Instruction-Finetuned Text Embeddingscited by 329
- 2024Nomic Embed: Training a Reproducible Long Context Text Embeddercited by 255
- 2024Generative Representational Instruction Tuningcited by 227
- 2021GALAXY: A Generative Pre-trained Model for Task-Oriented Dialog with Semi-Supervised Learning and Explicit Policy Injectioncited by 102
- 2021QA Dataset Explosion: A Taxonomy of NLP Resources for Question Answering and Reading Comprehensioncited by 91
- 2023Context-faithful Prompting for Large Language Modelscited by 76
- 2024eCeLLM: Generalizing Large Language Models for E-commerce from Large-scale, High-quality Instruction Datacited by 44
- 2022SPACE-3: Unified Dialog Model Pre-training for Task-Oriented Dialog Understanding and Generationcited by 34
- 2022SPACE-2: Tree-Structured Semi-Supervised Contrastive Pre-training for Task-Oriented Dialog Understandingcited by 28
- 2021English Machine Reading Comprehension Datasets: A Surveycited by 26
- 2024Shopping MMLU: A Massive Multi-Task Online Shopping Benchmark for Large Language Modelscited by 20
- 2024Contextual Document Embeddingscited by 19
12 most cited of 36 All 36 (JSON)
- 2026ML-Embed: Inclusive and Efficient Embeddings for a Multilingual World14 May 2026
- 2026F2LLM-v2: Inclusive, Performant, and Efficient Embeddings for a Multilingual World19 Mar 2026
- 2025F2LLM Technical Report: Matching SOTA Embedding Performance with 6 Million Open-Source Data2 Oct 2025
- 2025LEAF: Knowledge Distillation of Text Embedding Models with Teacher-Aligned Representations16 Sep 2025
- 2025EcomMMMU: Strategic Utilization of Visuals for Robust Multimodal E-commerce Models21 Aug 2025
- 2025Improving Document Retrieval Coherence for Semantically Equivalent Queries11 Aug 2025
- 2025Generative Representational Learning of Foundation Models for Recommendation13 Jun 2025
- 2025QQSUM: A Novel Task and Model of Quantitative Query-Focused Summarization for Review-based Product Question Answering4 Jun 2025
- 2024Shopping MMLU: A Massive Multi-Task Online Shopping Benchmark for Large Language Models28 Oct 2024
- 2024Captions Speak Louder than Images: Generalizing Foundation Models for E-commerce from High-quality Multimodal Instruction Data22 Oct 2024
- 2024Contextual Document Embeddings3 Oct 2024
- 2024Unlocking Markets: A Multilingual Benchmark to Cross-Market Question Answering24 Sep 2024
12 newest of 36 All 36 (JSON)