KTRL+F: Knowledge-Augmented In-Document Search
Not on the map. Why?
Abstract (arXiv)
We introduce a new problem KTRL+F, a knowledge-augmented in-document search task that necessitates real-time identification of all semantic targets within a document with the awareness of external sources through a single natural query. KTRL+F addresses following unique challenges for in-document search: 1)utilizing knowledge outside the document for extended use of additional information about targets, and 2) balancing between real-time applicability with the performance. We analyze various baselines in KTRL+F and find limitations of existing models, such as hallucinations, high latency, or difficulties in leveraging external knowledge. Therefore, we propose a Knowledge-Augmented Phrase Retrieval model that shows a promising balance between speed and performance by simply augmenting external knowledge in phrase embedding. We also conduct a user study to verify whether solving KTRL+F can enhance search experience for users. It demonstrates that even with our simple model, users can reduce the time for searching with less queries and reduced extra visits to other sources for collecting evidence. We encourage the research community to work on KTRL+F to enhance more efficient in-document information access.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 35 of its 53 references that are in the map. First posted on arXiv 14 Nov 2023.
Builds on
35 of 53 references.
References · 35
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
- 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,944
- 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,148
- 2017TriviaQA: A Large Scale Distantly Supervised Challenge Dataset for Reading Comprehensioncited by 2,955
- 2018Know What You Don't Know: Unanswerable Questions for SQuADcited by 1,554
- 2021DeBERTaV3: Improving DeBERTa using ELECTRA-Style Pre-Training with Gradient-Disentangled Embedding Sharingcited by 1,254
- 2020Leveraging Passage Retrieval with Generative Models for Open Domain Question Answeringcited by 1,210
- 2020ColBERT: Efficient and Effective Passage Search via Contextualized Late Interaction over BERTcited by 1,178
- 2020How Much Knowledge Can You Pack Into the Parameters of a Language Model?cited by 719
23 more
- 2023In-Context Retrieval-Augmented Language Modelscited by 702
- 2019ERNIE: Enhanced Language Representation with Informative Entitiescited by 528
- 2021A Dataset of Information-Seeking Questions and Answers Anchored in Research Paperscited by 486
- 2021ColBERTv2: Effective and Efficient Retrieval via Lightweight Late Interactioncited by 476
- 2023Check Your Facts and Try Again: Improving Large Language Models with External Knowledge and Automated Feedbackcited by 353
- 2016NewsQA: A Machine Comprehension Datasetcited by 331
- 2020K-Adapter: Infusing Knowledge into Pre-Trained Models with Adapterscited by 319
- 2022Generate rather than Retrieve: Large Language Models are Strong Context Generatorscited by 298
- 2019Knowledge Enhanced Contextual Word Representationscited by 296
- 2019MRQA 2019 Shared Task: Evaluating Generalization in Reading Comprehensioncited by 184
- 2023Unlimiformer: Long-Range Transformers with Unlimited Length Inputcited by 128
- 2019Pretrained Encyclopedia: Weakly Supervised Knowledge-Pretrained Language Modelcited by 102
- 2019Quoref: A Reading Comprehension Dataset with Questions Requiring Coreferential Reasoningcited by 100
- 2020Entities as Experts: Sparse Memory Access with Entity Supervisioncited by 100
- 2019E-BERT: Efficient-Yet-Effective Entity Embeddings for BERTcited by 96
- 2020Learning Dense Representations of Phrases at Scalecited by 91
- 2018RecipeQA: A Challenge Dataset for Multimodal Comprehension of Cooking Recipescited by 74
- 2019SenseBERT: Driving Some Sense into BERTcited by 73
- 2019Real-Time Open-Domain Question Answering with Dense-Sparse Phrase Indexcited by 64
- 2020IIRC: A Dataset of Incomplete Information Reading Comprehension Questionscited by 53
- 2016The Amazing Mysteries of the Gutter: Drawing Inferences Between Panels in Comic Book Narrativescited by 42
- 2022RoMQA: A Benchmark for Robust, Multi-evidence, Multi-answer Question Answeringcited by 19
- 2022Aggretriever: A Simple Approach to Aggregate Textual Representations for Robust Dense Passage Retrievalcited by 12
Built on by
Citing papers per year: 2024: 2; 2025: 0; 2026: 1.
3 papers.
- 2024Generative Prompt Internalizationcited by 8
- 2024Structured List-Grounded Question Answeringcited by 0
- 2026DocQAC: Adaptive Trie-Guided Decoding for Effective In-Document Query Auto-Completioncited by 0
- 2026DocQAC: Adaptive Trie-Guided Decoding for Effective In-Document Query Auto-Completion20 Apr 2026
- 2024Generative Prompt Internalization24 Nov 2024
- 2024Structured List-Grounded Question Answering4 Oct 2024