mlsanityData to 14 Oct 2026

KTRL+F: Knowledge-Augmented In-Document Search

arXiv 2311.08329 ↗First posted 14 Nov 2023cs.CLcited by 3

Not on the map. Why?

Abstract (arXiv)

We introduce a new problem KTRL+F, a knowledge-augmented in-document search task that necessitates real-time identification of all semantic targets within a document with the awareness of external sources through a single natural query. KTRL+F addresses following unique challenges for in-document search: 1)utilizing knowledge outside the document for extended use of additional information about targets, and 2) balancing between real-time applicability with the performance. We analyze various baselines in KTRL+F and find limitations of existing models, such as hallucinations, high latency, or difficulties in leveraging external knowledge. Therefore, we propose a Knowledge-Augmented Phrase Retrieval model that shows a promising balance between speed and performance by simply augmenting external knowledge in phrase embedding. We also conduct a user study to verify whether solving KTRL+F can enhance search experience for users. It demonstrates that even with our simple model, users can reduce the time for searching with less queries and reduced extra visits to other sources for collecting evidence. We encourage the research community to work on KTRL+F to enhance more efficient in-document information access.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 35 of its 53 references that are in the map. First posted on arXiv 14 Nov 2023.

Builds on

35 of 53 references.

References · 35

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2020Language Models are Few-Shot Learnerscited by 32,419
  3. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  4. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
  5. 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,944
  6. 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,148
  7. 2017TriviaQA: A Large Scale Distantly Supervised Challenge Dataset for Reading Comprehensioncited by 2,955
  8. 2018Know What You Don't Know: Unanswerable Questions for SQuADcited by 1,554
  9. 2021DeBERTaV3: Improving DeBERTa using ELECTRA-Style Pre-Training with Gradient-Disentangled Embedding Sharingcited by 1,254
  10. 2020Leveraging Passage Retrieval with Generative Models for Open Domain Question Answeringcited by 1,210
  11. 2020ColBERT: Efficient and Effective Passage Search via Contextualized Late Interaction over BERTcited by 1,178
  12. 2020How Much Knowledge Can You Pack Into the Parameters of a Language Model?cited by 719
23 more
  1. 2023In-Context Retrieval-Augmented Language Modelscited by 702
  2. 2019ERNIE: Enhanced Language Representation with Informative Entitiescited by 528
  3. 2021A Dataset of Information-Seeking Questions and Answers Anchored in Research Paperscited by 486
  4. 2021ColBERTv2: Effective and Efficient Retrieval via Lightweight Late Interactioncited by 476
  5. 2023Check Your Facts and Try Again: Improving Large Language Models with External Knowledge and Automated Feedbackcited by 353
  6. 2016NewsQA: A Machine Comprehension Datasetcited by 331
  7. 2020K-Adapter: Infusing Knowledge into Pre-Trained Models with Adapterscited by 319
  8. 2022Generate rather than Retrieve: Large Language Models are Strong Context Generatorscited by 298
  9. 2019Knowledge Enhanced Contextual Word Representationscited by 296
  10. 2019MRQA 2019 Shared Task: Evaluating Generalization in Reading Comprehensioncited by 184
  11. 2023Unlimiformer: Long-Range Transformers with Unlimited Length Inputcited by 128
  12. 2019Pretrained Encyclopedia: Weakly Supervised Knowledge-Pretrained Language Modelcited by 102
  13. 2019Quoref: A Reading Comprehension Dataset with Questions Requiring Coreferential Reasoningcited by 100
  14. 2020Entities as Experts: Sparse Memory Access with Entity Supervisioncited by 100
  15. 2019E-BERT: Efficient-Yet-Effective Entity Embeddings for BERTcited by 96
  16. 2020Learning Dense Representations of Phrases at Scalecited by 91
  17. 2018RecipeQA: A Challenge Dataset for Multimodal Comprehension of Cooking Recipescited by 74
  18. 2019SenseBERT: Driving Some Sense into BERTcited by 73
  19. 2019Real-Time Open-Domain Question Answering with Dense-Sparse Phrase Indexcited by 64
  20. 2020IIRC: A Dataset of Incomplete Information Reading Comprehension Questionscited by 53
  21. 2016The Amazing Mysteries of the Gutter: Drawing Inferences Between Panels in Comic Book Narrativescited by 42
  22. 2022RoMQA: A Benchmark for Robust, Multi-evidence, Multi-answer Question Answeringcited by 19
  23. 2022Aggretriever: A Simple Approach to Aggregate Textual Representations for Robust Dense Passage Retrievalcited by 12

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 2; 2025: 0; 2026: 1.

3 papers.