The TechQA Dataset
Not on the map. Why?
Abstract (arXiv)
We introduce TechQA, a domain-adaptation question answering dataset for the technical support domain. The TechQA corpus highlights two real-world issues from the automated customer support domain. First, it contains actual questions posed by users on a technical forum, rather than questions generated specifically for a competition or a task. Second, it has a real-world size -- 600 training, 310 dev, and 490 evaluation question/answer pairs -- thus reflecting the cost of creating large labeled datasets with actual data. Consequently, TechQA is meant to stimulate research in domain adaptation rather than being a resource to build QA systems from scratch. The dataset was obtained by crawling the IBM Developer and IBM DeveloperWorks forums for questions with accepted answers that appear in a published IBM Technote---a technical document that addresses a specific technical issue. We also release a collection of the 801,998 publicly available Technotes as of April 4, 2019 as a companion resource that might be used for pretraining, to learn representations of the IT domain language.
Key facts. Cited by 30 papers in the map (data through 14 Oct 2026). First posted on arXiv 8 Nov 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 5; 2022: 1; 2023: 4; 2024: 7; 2025: 8; 2026: 5.
30 papers.
Sort:
By area:
- 2024RAGBench: Explainable Benchmark for Retrieval-Augmented Generation Systemscited by 117
- 2021QA Dataset Explosion: A Taxonomy of NLP Resources for Question Answering and Reading Comprehensioncited by 91
- 2025GFM-RAG: Graph Foundation Model for Retrieval Augmented Generationcited by 40
- 2025CARROT: A Cost Aware Rate Optimal Routercited by 39
- 2025Text Data Augmentation for Large Language Models: A Comprehensive Survey of Methods, Challenges, and Opportunitiescited by 22
- 2021Question Answering over Electronic Devices: A New Benchmark Dataset and a Multi-Task Learning based QA Frameworkcited by 21
- 2025Rethinking Chunk Size For Long-Document Retrieval: A Multi-Dataset Analysiscited by 17
- 2024Retrieval-Augmented Data Augmentation for Low-Resource Domain Taskscited by 12
- 2022CS1QA: A Dataset for Assisting Code-based Question Answering in an Introductory Programming Coursecited by 11
- 2023MPMQA: Multimodal Question Answering on Product Manualscited by 10
- 2023Can LLMs Augment Low-Resource Reading Comprehension Datasets? Opportunities and Challengescited by 9
- 2021Cheap and Good? Simple and Effective Data Augmentation for Low Resource Machine Readingcited by 7
18 more
- 2025Automatic Dataset Generation for Knowledge Intensive Question Answering Taskscited by 7
- 2026Corpus2Skill: Distilling Enterprise Knowledge into Navigable Agent Skills for QA and RAGcited by 7
- 2026Cartridges at Scale: Training Modular KV Caches over Large Document Collectionscited by 6
- 2021A Neural Question Answering System for Basic Questions about Subroutinescited by 5
- 2024Luna: An Evaluation Foundation Model to Catch Language Model Hallucinations with High Accuracy and Low Costcited by 5
- 2024PAGED: A Benchmark for Procedural Graphs Extraction from Documentscited by 4
- 2025Adapting Large Language Models for Multi-Domain Retrieval-Augmented-Generationcited by 3
- 2023Mitigating Data Scarcity for Large Language Modelscited by 2
- 2024ProSwitch: Knowledge-Guided Instruction Tuning to Switch Between Professional and Non-Professional Responsescited by 2
- 2024Exploring Language Model Generalization in Low-Resource Extractive QAcited by 2
- 2025How Accurate Are LLMs at Multi-Question Answering on Conversational Transcripts?cited by 2
- 2026Retrieving Minimal and Sufficient Reasoning Subgraphs with Graph Foundation Models for Path-aware GraphRAGcited by 2
- 2024Towards Efficient Methods in Medical Question Answering using Knowledge Graph Embeddingscited by 1
- 2025PrismRAG: Boosting RAG Factuality with Distractor Resilience and Strategized Reasoningcited by 1
- 2021VAULT: VAriable Unified Long Text Representation for Machine Reading Comprehensioncited by 0
- 2023FastDoc: Domain-Specific Fast Continual Pre-training Technique using Document-Level Metadata and Taxonomycited by 0
- 2026GLM-RAG: Graph Language Models for Graph-Based Retrieval-Augmented Generationcited by 0
- 2026Blocking at the Boundary: Auditing Long-Horizon Agents against Staged Prompt Injectioncited by 0
- 2026Blocking at the Boundary: Auditing Long-Horizon Agents against Staged Prompt Injection4 Oct 2026
- 2026GLM-RAG: Graph Language Models for Graph-Based Retrieval-Augmented Generation30 Jul 2026
- 2026Cartridges at Scale: Training Modular KV Caches over Large Document Collections3 Jun 2026
- 2026Corpus2Skill: Distilling Enterprise Knowledge into Navigable Agent Skills for QA and RAG16 Apr 2026
- 2026Retrieving Minimal and Sufficient Reasoning Subgraphs with Graph Foundation Models for Path-aware GraphRAG7 Mar 2026
- 2025How Accurate Are LLMs at Multi-Question Answering on Conversational Transcripts?26 Sep 2025
- 2025PrismRAG: Boosting RAG Factuality with Distractor Resilience and Strategized Reasoning25 Jul 2025
- 2025Rethinking Chunk Size For Long-Document Retrieval: A Multi-Dataset Analysis27 May 2025
- 2025Automatic Dataset Generation for Knowledge Intensive Question Answering Tasks20 May 2025
- 2025Adapting Large Language Models for Multi-Domain Retrieval-Augmented-Generation3 Apr 2025
- 2025CARROT: A Cost Aware Rate Optimal Router5 Feb 2025
- 2025GFM-RAG: Graph Foundation Model for Retrieval Augmented Generation3 Feb 2025
18 more
- 2025Text Data Augmentation for Large Language Models: A Comprehensive Survey of Methods, Challenges, and Opportunities31 Jan 2025
- 2024Exploring Language Model Generalization in Low-Resource Extractive QA27 Sep 2024
- 2024PAGED: A Benchmark for Procedural Graphs Extraction from Documents7 Aug 2024
- 2024RAGBench: Explainable Benchmark for Retrieval-Augmented Generation Systems25 Jun 2024
- 2024Luna: An Evaluation Foundation Model to Catch Language Model Hallucinations with High Accuracy and Low Cost3 Jun 2024
- 2024ProSwitch: Knowledge-Guided Instruction Tuning to Switch Between Professional and Non-Professional Responses14 Mar 2024
- 2024Retrieval-Augmented Data Augmentation for Low-Resource Domain Tasks21 Feb 2024
- 2024Towards Efficient Methods in Medical Question Answering using Knowledge Graph Embeddings15 Jan 2024
- 2023Can LLMs Augment Low-Resource Reading Comprehension Datasets? Opportunities and Challenges21 Sep 2023
- 2023FastDoc: Domain-Specific Fast Continual Pre-training Technique using Document-Level Metadata and Taxonomy9 Jun 2023
- 2023MPMQA: Multimodal Question Answering on Product Manuals19 Apr 2023
- 2023Mitigating Data Scarcity for Large Language Models3 Feb 2023
- 2022CS1QA: A Dataset for Assisting Code-based Question Answering in an Introductory Programming Course26 Oct 2022
- 2021Question Answering over Electronic Devices: A New Benchmark Dataset and a Multi-Task Learning based QA Framework13 Sep 2021
- 2021QA Dataset Explosion: A Taxonomy of NLP Resources for Question Answering and Reading Comprehension27 Jul 2021
- 2021Cheap and Good? Simple and Effective Data Augmentation for Low Resource Machine Reading8 Jun 2021
- 2021VAULT: VAriable Unified Long Text Representation for Machine Reading Comprehension7 May 2021
- 2021A Neural Question Answering System for Basic Questions about Subroutines11 Jan 2021
- 2024RAGBench: Explainable Benchmark for Retrieval-Augmented Generation Systemscited by 117
- 2025GFM-RAG: Graph Foundation Model for Retrieval Augmented Generationcited by 40
- 2025Rethinking Chunk Size For Long-Document Retrieval: A Multi-Dataset Analysiscited by 17
- 2024Retrieval-Augmented Data Augmentation for Low-Resource Domain Taskscited by 12
- 2026Corpus2Skill: Distilling Enterprise Knowledge into Navigable Agent Skills for QA and RAGcited by 7
- 2025Adapting Large Language Models for Multi-Domain Retrieval-Augmented-Generationcited by 3
- 2026Retrieving Minimal and Sufficient Reasoning Subgraphs with Graph Foundation Models for Path-aware GraphRAGcited by 2
- 2026GLM-RAG: Graph Language Models for Graph-Based Retrieval-Augmented Generationcited by 0
- 2026GLM-RAG: Graph Language Models for Graph-Based Retrieval-Augmented Generation30 Jul 2026
- 2026Corpus2Skill: Distilling Enterprise Knowledge into Navigable Agent Skills for QA and RAG16 Apr 2026
- 2026Retrieving Minimal and Sufficient Reasoning Subgraphs with Graph Foundation Models for Path-aware GraphRAG7 Mar 2026
- 2025Rethinking Chunk Size For Long-Document Retrieval: A Multi-Dataset Analysis27 May 2025
- 2025Adapting Large Language Models for Multi-Domain Retrieval-Augmented-Generation3 Apr 2025
- 2025GFM-RAG: Graph Foundation Model for Retrieval Augmented Generation3 Feb 2025
- 2024RAGBench: Explainable Benchmark for Retrieval-Augmented Generation Systems25 Jun 2024
- 2024Retrieval-Augmented Data Augmentation for Low-Resource Domain Tasks21 Feb 2024
- 2021QA Dataset Explosion: A Taxonomy of NLP Resources for Question Answering and Reading Comprehensioncited by 91
- 2025CARROT: A Cost Aware Rate Optimal Routercited by 39
- 2025Text Data Augmentation for Large Language Models: A Comprehensive Survey of Methods, Challenges, and Opportunitiescited by 22
- 2021Question Answering over Electronic Devices: A New Benchmark Dataset and a Multi-Task Learning based QA Frameworkcited by 21
- 2022CS1QA: A Dataset for Assisting Code-based Question Answering in an Introductory Programming Coursecited by 11
- 2023MPMQA: Multimodal Question Answering on Product Manualscited by 10
- 2023Can LLMs Augment Low-Resource Reading Comprehension Datasets? Opportunities and Challengescited by 9
- 2021Cheap and Good? Simple and Effective Data Augmentation for Low Resource Machine Readingcited by 7
- 2025Automatic Dataset Generation for Knowledge Intensive Question Answering Taskscited by 7
- 2021A Neural Question Answering System for Basic Questions about Subroutinescited by 5
- 2024Luna: An Evaluation Foundation Model to Catch Language Model Hallucinations with High Accuracy and Low Costcited by 5
- 2024PAGED: A Benchmark for Procedural Graphs Extraction from Documentscited by 4
12 most cited of 19 All 19 (JSON)
- 2025How Accurate Are LLMs at Multi-Question Answering on Conversational Transcripts?26 Sep 2025
- 2025Automatic Dataset Generation for Knowledge Intensive Question Answering Tasks20 May 2025
- 2025CARROT: A Cost Aware Rate Optimal Router5 Feb 2025
- 2025Text Data Augmentation for Large Language Models: A Comprehensive Survey of Methods, Challenges, and Opportunities31 Jan 2025
- 2024Exploring Language Model Generalization in Low-Resource Extractive QA27 Sep 2024
- 2024PAGED: A Benchmark for Procedural Graphs Extraction from Documents7 Aug 2024
- 2024Luna: An Evaluation Foundation Model to Catch Language Model Hallucinations with High Accuracy and Low Cost3 Jun 2024
- 2024ProSwitch: Knowledge-Guided Instruction Tuning to Switch Between Professional and Non-Professional Responses14 Mar 2024
- 2024Towards Efficient Methods in Medical Question Answering using Knowledge Graph Embeddings15 Jan 2024
- 2023Can LLMs Augment Low-Resource Reading Comprehension Datasets? Opportunities and Challenges21 Sep 2023
- 2023FastDoc: Domain-Specific Fast Continual Pre-training Technique using Document-Level Metadata and Taxonomy9 Jun 2023
- 2023MPMQA: Multimodal Question Answering on Product Manuals19 Apr 2023
12 newest of 19 All 19 (JSON)