TREC iKAT 2023: The Interactive Knowledge Assistance Track Overview
Not on the map. Why?
Abstract (arXiv)
Conversational Information Seeking has evolved rapidly in the last few years with the development of Large Language Models providing the basis for interpreting and responding in a naturalistic manner to user requests. iKAT emphasizes the creation and research of conversational search agents that adapt responses based on the user's prior interactions and present context. This means that the same question might yield varied answers, contingent on the user's profile and preferences. The challenge lies in enabling Conversational Search Agents (CSA) to incorporate personalized context to effectively guide users through the relevant information to them. iKAT's first year attracted seven teams and a total of 24 runs. Most of the runs leveraged Large Language Models (LLMs) in their pipelines, with a few focusing on a generate-then-retrieve approach.
Key facts. Cited by 15 papers in the map (data through 7 Oct 2026). Builds on 0 of its 15 references that are in the map. First posted on arXiv 2 Jan 2024.
Builds on
0 of 15 references.
No references here yet.
Built on by
Citing papers per year: 2024: 6; 2025: 8; 2026: 1.
15 papers.
Sort:
By area:
- 2025Deep Research Agents: A Systematic Examination And Roadmapcited by 122
- 2024Ragnar"ok: A Reusable RAG Framework and Baselines for TREC 2024 Retrieval-Augmented Generation Trackcited by 31
- 2025A Survey of Large Language Model Empowered Agents for Recommendation and Search: Towards Next-Generation Information Retrievalcited by 31
- 2024A Survey of Conversational Searchcited by 22
- 2024Can We Use Large Language Models to Fill Relevance Judgment Holes?cited by 17
- 2024TREC iKAT 2023: A Test Collection for Evaluating Conversational and Interactive Knowledge Assistantscited by 16
- 2024How to Leverage Personal Textual Knowledge for Personalized Conversational Information Retrievalcited by 10
- 2024Synthetic Data Generation with Large Language Models for Personalized Community Question Answeringcited by 8
- 2025Conversational Gold: Evaluating Personalized Conversational Search System using Gold Nuggetscited by 8
- 2026A Picture of Agentic Searchcited by 1
- 2025Passage Query Methods for Retrieval and Reranking in Conversational Agentscited by 0
- 2025Second SIGIR Workshop on Simulations for Information Access (Sim4IA 2025)cited by 0
3 more
- 2025Dagstuhl Perspectives Workshop 24352 -- Conversational Agents: A Framework for Evaluation (CAFE): Manifestocited by 0
- 2025Adaptive Personalized Conversational Information Retrievalcited by 0
- 2025CFDA & CLIP at TREC iKAT 2025: Enhancing Personalized Conversational Search via Query Reformulation and Rank Fusioncited by 0
- 2026A Picture of Agentic Search19 Feb 2026
- 2025CFDA & CLIP at TREC iKAT 2025: Enhancing Personalized Conversational Search via Query Reformulation and Rank Fusion19 Sep 2025
- 2025Adaptive Personalized Conversational Information Retrieval12 Aug 2025
- 2025Deep Research Agents: A Systematic Examination And Roadmap22 Jun 2025
- 2025Dagstuhl Perspectives Workshop 24352 -- Conversational Agents: A Framework for Evaluation (CAFE): Manifesto8 Jun 2025
- 2025Second SIGIR Workshop on Simulations for Information Access (Sim4IA 2025)16 May 2025
- 2025Conversational Gold: Evaluating Personalized Conversational Search System using Gold Nuggets12 Mar 2025
- 2025A Survey of Large Language Model Empowered Agents for Recommendation and Search: Towards Next-Generation Information Retrieval7 Mar 2025
- 2025Passage Query Methods for Retrieval and Reranking in Conversational Agents28 Feb 2025
- 2024Synthetic Data Generation with Large Language Models for Personalized Community Question Answering29 Oct 2024
- 2024A Survey of Conversational Search21 Oct 2024
- 2024How to Leverage Personal Textual Knowledge for Personalized Conversational Information Retrieval23 Jul 2024
3 more
- 2024Ragnar"ok: A Reusable RAG Framework and Baselines for TREC 2024 Retrieval-Augmented Generation Track24 Jun 2024
- 2024Can We Use Large Language Models to Fill Relevance Judgment Holes?9 May 2024
- 2024TREC iKAT 2023: A Test Collection for Evaluating Conversational and Interactive Knowledge Assistants4 May 2024
- 2025Deep Research Agents: A Systematic Examination And Roadmapcited by 122
- 2025A Survey of Large Language Model Empowered Agents for Recommendation and Search: Towards Next-Generation Information Retrievalcited by 31
- 2026A Picture of Agentic Searchcited by 1
- 2025Passage Query Methods for Retrieval and Reranking in Conversational Agentscited by 0
- 2026A Picture of Agentic Search19 Feb 2026
- 2025Deep Research Agents: A Systematic Examination And Roadmap22 Jun 2025
- 2025A Survey of Large Language Model Empowered Agents for Recommendation and Search: Towards Next-Generation Information Retrieval7 Mar 2025
- 2025Passage Query Methods for Retrieval and Reranking in Conversational Agents28 Feb 2025
- 2024A Survey of Conversational Searchcited by 22
- 2024Can We Use Large Language Models to Fill Relevance Judgment Holes?cited by 17
- 2024TREC iKAT 2023: A Test Collection for Evaluating Conversational and Interactive Knowledge Assistantscited by 16
- 2024How to Leverage Personal Textual Knowledge for Personalized Conversational Information Retrievalcited by 10
- 2025Second SIGIR Workshop on Simulations for Information Access (Sim4IA 2025)cited by 0
- 2025Dagstuhl Perspectives Workshop 24352 -- Conversational Agents: A Framework for Evaluation (CAFE): Manifestocited by 0
- 2025Adaptive Personalized Conversational Information Retrievalcited by 0
- 2025CFDA & CLIP at TREC iKAT 2025: Enhancing Personalized Conversational Search via Query Reformulation and Rank Fusioncited by 0
- 2025CFDA & CLIP at TREC iKAT 2025: Enhancing Personalized Conversational Search via Query Reformulation and Rank Fusion19 Sep 2025
- 2025Adaptive Personalized Conversational Information Retrieval12 Aug 2025
- 2025Dagstuhl Perspectives Workshop 24352 -- Conversational Agents: A Framework for Evaluation (CAFE): Manifesto8 Jun 2025
- 2025Second SIGIR Workshop on Simulations for Information Access (Sim4IA 2025)16 May 2025
- 2024A Survey of Conversational Search21 Oct 2024
- 2024How to Leverage Personal Textual Knowledge for Personalized Conversational Information Retrieval23 Jul 2024
- 2024Can We Use Large Language Models to Fill Relevance Judgment Holes?9 May 2024
- 2024TREC iKAT 2023: A Test Collection for Evaluating Conversational and Interactive Knowledge Assistants4 May 2024