mlsanityData to 14 Oct 2026

Effects of Transcript Compression on LLM-based Medical Misinformation Detection in Japanese YouTube Videos

arXiv 2609.30882 ↗First posted 25 Sep 2026cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Large language models (LLMs) are increasingly used to assess long-form medical videos, but their effectiveness may depend on whether transcripts are provided in full or compressed through summarization, retrieval, or claim screening. This study examines how such transcript compression affects LLM-based veracity classification of Japanese medical YouTube videos. We compare four transcript input designs: full transcripts, LLM-generated summaries, RAPTOR-based retrievalaugmented generation (RAG), and Screening, which extracts candidate medical and health-related sentences. Using 74 long-form videos labeled as Real or Fake, we evaluate classification performance and analyze linguistic changes using J-LIWC, hedge expressions, and institutional or technical terms. The full-transcript Baseline achieved the best performance, whereas all compressed inputs increased false negatives, meaning that Fake videos were more likely to be misclassified as Real. Summary caused the largest performance drop, while Screening performed best among the compressed inputs but still omitted many medically relevant sentences. Linguistic analyses showed that these errors were not explained by a simple increase in certainty. Instead, Summary reduced affective, social, temporal, cognitive, and conversational cues, while Summary and RAG made institutional and technical terms more salient. These findings suggest that transcript compression can represent Fake videos as more coherent and authoritative inputs, thereby weakening cues needed for misinformation detection

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 15 of its 31 references that are in the map. First posted on arXiv 25 Sep 2026.

Builds on

15 of 31 references.

References · 15

  1. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  2. 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 4,057
  3. 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,455
  4. 2024Qwen2 Technical Reportcited by 2,120
  5. 2024RAPTOR: Recursive Abstractive Processing for Tree-Organized Retrievalcited by 532
  6. 2023LongLLMLingua: Accelerating and Enhancing LLMs in Long Context Scenarios via Prompt Compressioncited by 453
  7. 2023LLMLingua: Compressing Prompts for Accelerated Inference of Large Language Modelscited by 287
  8. 2023Fake News in Sheep's Clothing: Robust Fake News Detection Against LLM-Empowered Style Attackscited by 70
  9. 2020ReCOVery: A Multimodal Repository for COVID-19 News Credibility Researchcited by 44
  10. 2024Long2RAG: Evaluating Long-Context & Long-Form Retrieval-Augmented Generation with Key Point Recallcited by 32
  11. 2024Long Context vs. RAG for LLMs: An Evaluation and Revisitscited by 26
  12. 2019Towards Automatic Detection of Misinformation in Online Medical Videoscited by 22
3 more
  1. 2023Emotion Detection for Misinformation: A Reviewcited by 22
  2. 2024Generative Large Language Models in Automated Fact-Checking: A Surveycited by 19
  3. 2023Identifying Misinformation on YouTube through Transcript Contextual Analysis with Transformer Modelscited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025An Audit and Analysis of LLM-Assisted Health Misinformation Jailbreaks Against LLMs
  2. 2025Susceptibility of Large Language Models to User-Driven Factors in Medical Queries
  3. 2026Probing Multimodal Large Language Models on Cognitive Biases in Chinese Short-Video Misinformation
  4. 2023Minimizing Factual Inconsistency and Hallucination in Large Language Models
  5. 2026JMedEthicBench: A Multi-Turn Conversational Benchmark for Evaluating Medical Safety in Japanese Large Language Models
  6. 2025Improving Reliability and Explainability of Medical Question Answering through Atomic Fact Checking in Retrieval-Augmented LLMs
  7. 2026When Retrieval Helps and Distracts: Evaluating Evidence-Generating LLMs for Biomedical Claim Verification
  8. 2024Harnessing LLMs for Automated Video Content Analysis: An Exploratory Workflow of Short Videos on Depression