mlsanityData to 14 Oct 2026

Towards Efficient Multimodal and Multilingual Opinion Extraction for STI: A QLoRA-Based Fine-Tuning Approach

arXiv 2608.14152 ↗First posted 14 Aug 2026cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Recent advances in large language models (LLMs) have reshaped semantic analysis. Opinion Extraction (OE) for Science and Technology Intelligence (STI) requires concise core opinions from large information streams. Off-the-shelf models struggle to filter noise from these streams and show limited structured-output reliability in zero-shot multilingual and multi-modal settings. To address information overload and extraction defocus, this study proposes a multimodal core-opinion extraction framework in which visual evidence serves as a contextual anchor for textual judgment. Using VideoLLaMA2 (VL2) and VideoLLaMA2.1 (VL2.1) as the base models, we apply Quantized Low-Rank Adaptation (QLoRA) fine-tuning on a curated dataset of 2,194 multilingual and multimodal samples. Under the selected Image-Augmented setting, fine-tuned VL2.1 generates structured JSON core-opinion outputs, achieving 64.98% Precision, 42.15% Recall, 51.14% F1-score, and 74.00% sample-level accuracy. Relative to the zero-shot VL2.1 setting, it raises the F1-scores of Spanish and Russian from 4.83% and 0.45% to 46.05% and 51.93%, respectively. The framework further incorporates a Fuzzy Cumulative Prospect Theory-based post-extraction triage module for case-level value assessment, providing a case-level value signal for downstream STI screening.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 3 of its 35 references that are in the map. First posted on arXiv 14 Aug 2026.

Builds on

3 of 35 references.

References · 3

  1. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  2. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
  3. 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,418

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025LinguaMark: Do Multimodal Models Speak Fairly? A Benchmark-Based Evaluation
  2. 2024ViLBias: Detecting and Reasoning about Bias in Multimodal Content
  3. 2024WisdoM: Improving Multimodal Sentiment Analysis by Fusing Contextual World Knowledge
  4. 2025UPME: An Unsupervised Peer Review Framework for Multimodal Large Language Model Evaluation
  5. 2025SO-Bench: A Structural Output Evaluation of Multimodal LLMs
  6. 2025Grounding Multilingual Multimodal LLMs With Cultural Knowledge
  7. 2025MAC: A Live Benchmark for Multimodal Large Language Models in Scientific Understanding
  8. 2026Measuring What Matters Beyond Text: Evaluating Multimodal Summaries by Quality, Alignment, and Diversity