mlsanityData to 7 Oct 2026

Towards Developing a Multimodal Chat Assistant for University Stakeholders: RAG-based Approach

arXiv 2607.01115 ↗First posted 1 Jul 2026cs.CL cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

University stakeholders often face difficulties in accessing timely and reliable information, especially in developing countries, where there are very few intelligent support systems. Existing rule-based chatbots are unable to handle complex, domain-specific queries and are not well-equipped to adapt to evolving institutional policies. As a fill-in-the-gap solution, we present the multimodal university chatbot with retrieval-augmented generation. The system combines the large language model with semantic retrieval to produce context-based responses from institution-centric resources, such as the university handbook. The system accepts text and image queries through the vision-language model and applies quantized inference for rapid deployment on constrained hardware. A scalable backend built with FastAPI, adjoined with a responsive frontend developed with Next.js, ensures real-time usability. Our multimodal evaluation demonstrates that the system maintains strong satisfaction scores across both text and image queries, despite increased response time for visual inputs. Furthermore, quantitative evaluation shows that hallucination is reduced from 31.7% to 6.6% in our proposed RAG-based system, confirming the effectiveness of retrieval grounding.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 4 of its 18 references that are in the map. First posted on arXiv 1 Jul 2026.

Builds on

4 of 18 references.

References · 4

  1. 2024A Survey on Hallucination in Large Vision-Language Modelscited by 352
  2. 2024From Questions to Insightful Answers: Building an Informed Chatbot for University Resourcescited by 11
  3. 2025A Structured Dataset of Disease-Symptom Associations to Improve Diagnostic Accuracycited by 6
  4. 2026Bridging the Gap in Bangla Healthcare: Machine Learning Based Disease Prediction Using a Symptoms-Disease Datasetcited by 4

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025HybridRAG: A Practical LLM-based ChatBot Framework based on Pre-Generated Q&A over Raw Unstructured Documents
  2. 2025From Textbook to Talkbot: A Case Study of a Greek-Language RAG-Based Chatbot in Higher Education
  3. 2025URAG: Implementing a Unified Hybrid RAG for Precise Answers in University Admission Chatbots -- A Case Study at HCMUT
  4. 2025A Knowledge Graph and a Tripartite Evaluation Framework Make Retrieval-Augmented Generation Scalable and Transparent
  5. 2024MuRAR: A Simple and Effective Multimodal Retrieval and Answer Refinement Framework for Multimodal Question Answering
  6. 2024Comparing the Utility, Preference, and Performance of Course Material Search Functionality and Retrieval-Augmented Generation Large Language Model (RAG-LLM) AI Chatbots in Information-Seeking Tasks
  7. 2024Retrieval Meets Reasoning: Even High-school Textbook Knowledge Benefits Multimodal Reasoning
  8. 2024Unimib Assistant: designing a student-friendly RAG-based chatbot for all their needs