mlsanityData to 7 Oct 2026

CIKMar: A Dual-Encoder Approach to Prompt-Based Reranking in Educational Dialogue Systems

arXiv 2408.08805 ↗First posted 16 Aug 2024cs.CL cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

In this study, we introduce CIKMar, an efficient approach to educational dialogue systems powered by the Gemma Language model. By leveraging a Dual-Encoder ranking system that incorporates both BERT and SBERT model, we have designed CIKMar to deliver highly relevant and accurate responses, even with the constraints of a smaller language model size. Our evaluation reveals that CIKMar achieves a robust recall and F1-score of 0.70 using BERTScore metrics. However, we have identified a significant challenge: the Dual-Encoder tends to prioritize theoretical responses over practical ones. These findings underscore the potential of compact and efficient models like Gemma in democratizing access to advanced educational AI systems, ensuring effective and contextually appropriate responses.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 22 of its 45 references that are in the map. First posted on arXiv 16 Aug 2024.

Builds on

22 of 45 references.

References · 22

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2020Language Models are Few-Shot Learnerscited by 32,199
  3. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
  4. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
  5. 2021Evaluating Large Language Models Trained on Codecited by 8,053
  6. 2020Measuring Massive Multitask Language Understandingcited by 7,768
  7. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
  8. 2022Large Language Models are Zero-Shot Reasonerscited by 4,323
  9. 2022OPT: Open Pre-trained Transformer Language Modelscited by 3,464
  10. 2015A Diversity-Promoting Objective Function for Neural Conversation Modelscited by 1,068
  11. 2023Better Zero-Shot Reasoning with Role-Play Promptingcited by 220
  12. 2022Thinking about GPT-3 In-Context Learning for Biomedical IE? Think Againcited by 83
10 more
  1. 2020Dialogue Response Ranking Training with Large-Scale Human Feedback Datacited by 68
  2. 2022Prompt-and-Rerank: A Method for Zero-Shot and Few-Shot Arbitrary Textual Style Transfer with Small Language Modelscited by 49
  3. 2023Hierarchical Prompting Assists Large Language Model on Web Navigationcited by 36
  4. 2023The BEA 2023 Shared Task on Generating AI Teacher Responses in Educational Dialoguescited by 27
  5. 2023The Efficiency Spectrum of Large Language Models: An Algorithmic Surveycited by 25
  6. 2023New Era of Artificial Intelligence in Education: Towards a Sustainable Multifaceted Revolutioncited by 20
  7. 2023Injecting the BM25 Score as Text Improves BERT-Based Re-rankerscited by 17
  8. 2021CCQA: A New Web-Scale Question Answering Dataset for Model Pre-Trainingcited by 13
  9. 2023Assessing the efficacy of large language models in generating accurate teacher responsescited by 6
  10. 2023The ADAIO System at the BEA-2023 Shared Task on Generating AI Teacher Responses in Educational Dialoguescited by 2

Built on by

Not cited yet.