Effects of Transcript Compression on LLM-based Medical Misinformation Detection in Japanese YouTube Videos
Not on the map. Why?
Abstract (arXiv)
Large language models (LLMs) are increasingly used to assess long-form medical videos, but their effectiveness may depend on whether transcripts are provided in full or compressed through summarization, retrieval, or claim screening. This study examines how such transcript compression affects LLM-based veracity classification of Japanese medical YouTube videos. We compare four transcript input designs: full transcripts, LLM-generated summaries, RAPTOR-based retrievalaugmented generation (RAG), and Screening, which extracts candidate medical and health-related sentences. Using 74 long-form videos labeled as Real or Fake, we evaluate classification performance and analyze linguistic changes using J-LIWC, hedge expressions, and institutional or technical terms. The full-transcript Baseline achieved the best performance, whereas all compressed inputs increased false negatives, meaning that Fake videos were more likely to be misclassified as Real. Summary caused the largest performance drop, while Screening performed best among the compressed inputs but still omitted many medically relevant sentences. Linguistic analyses showed that these errors were not explained by a simple increase in certainty. Instead, Summary reduced affective, social, temporal, cognitive, and conversational cues, while Summary and RAG made institutional and technical terms more salient. These findings suggest that transcript compression can represent Fake videos as more coherent and authoritative inputs, thereby weakening cues needed for misinformation detection
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 15 of its 31 references that are in the map. First posted on arXiv 25 Sep 2026.
Builds on
15 of 31 references.
References · 15
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 4,057
- 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,455
- 2024Qwen2 Technical Reportcited by 2,120
- 2024RAPTOR: Recursive Abstractive Processing for Tree-Organized Retrievalcited by 532
- 2023LongLLMLingua: Accelerating and Enhancing LLMs in Long Context Scenarios via Prompt Compressioncited by 453
- 2023LLMLingua: Compressing Prompts for Accelerated Inference of Large Language Modelscited by 287
- 2023Fake News in Sheep's Clothing: Robust Fake News Detection Against LLM-Empowered Style Attackscited by 70
- 2020ReCOVery: A Multimodal Repository for COVID-19 News Credibility Researchcited by 44
- 2024Long2RAG: Evaluating Long-Context & Long-Form Retrieval-Augmented Generation with Key Point Recallcited by 32
- 2024Long Context vs. RAG for LLMs: An Evaluation and Revisitscited by 26
- 2019Towards Automatic Detection of Misinformation in Online Medical Videoscited by 22
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025An Audit and Analysis of LLM-Assisted Health Misinformation Jailbreaks Against LLMs
- 2025Susceptibility of Large Language Models to User-Driven Factors in Medical Queries
- 2026Probing Multimodal Large Language Models on Cognitive Biases in Chinese Short-Video Misinformation
- 2023Minimizing Factual Inconsistency and Hallucination in Large Language Models
- 2026JMedEthicBench: A Multi-Turn Conversational Benchmark for Evaluating Medical Safety in Japanese Large Language Models
- 2025Improving Reliability and Explainability of Medical Question Answering through Atomic Fact Checking in Retrieval-Augmented LLMs
- 2026When Retrieval Helps and Distracts: Evaluating Evidence-Generating LLMs for Biomedical Claim Verification
- 2024Harnessing LLMs for Automated Video Content Analysis: An Exploratory Workflow of Short Videos on Depression