GigaPevt: Multimodal Medical Assistant
Not on the map. Why?
Abstract (arXiv)
Building an intelligent and efficient medical assistant is still a challenging AI problem. The major limitation comes from the data modality scarceness, which reduces comprehensive patient perception. This demo paper presents the GigaPevt, the first multimodal medical assistant that combines the dialog capabilities of large language models with specialized medical models. Such an approach shows immediate advantages in dialog quality and metric performance, with a 1.18% accuracy improvement in the question-answering task.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 13 of its 22 references that are in the map. First posted on arXiv 26 Feb 2024.
Builds on
13 of 22 references.
References · 13
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
- 2023Retrieval-Augmented Generation for Large Language Models: A Surveycited by 2,185
- 2017VGGFace2: A dataset for recognising faces across pose and agecited by 911
- 2017AffectNet: A Database for Facial Expression, Valence, and Arousal Computing in the Wildcited by 490
- 2017Age Progression/Regression by Conditional Adversarial Autoencodercited by 426
- 2023Chain of Code: Reasoning with a Language Model-Augmented Code Emulatorcited by 120
- 2022rPPG-Toolbox: Deep Remote PPG Toolboxcited by 63
- 2021Facial expression and attributes recognition based on multi-task learning of lightweight neural networkscited by 40
- 2022RuMedBench: A Russian Medical Language Understanding Benchmarkcited by 10
Built on by
Not cited yet.