mlsanityData to 14 Oct 2026

SciQNet: Two-Stage Multimodal Adaptation for Scientific Image Quality Assessment

arXiv 2608.05691 ↗First posted 6 Aug 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Scientific images are essential for communicating experimental observations, quantitative evidence and conceptual knowledge. Unlike natural images, their quality depends on both visual clarity and scientific informativeness, making assessment challenging. In this work, we present SciQNet, a two-stage multimodal adaptation framework for scientific image quality assessment. The first stage performs domain-adaptive pretraining on scientific document images and the second stage conducts task-specific fine-tuning with joint scoring and understanding supervision. For scoring-oriented supervision, we combine instruction tuning with a Huber loss derived from rating-word logits, while understanding-oriented supervision is formulated as multiple-choice visual question answering. Experiments show that using a 40% stratified subset of the domain-adaptive data gives the best performance among the evaluated pretraining fractions, suggesting that pretraining-data relevance may be as important as pretraining-data scale. The final model achieves an SIQA-S score of 92.21, an SIQA-U score of 47.38 and a combined score of 69.80. This work presents our solution to the ICME 2026 Scientific Image Quality Assessment Challenge, which ranked 2nd in the scoring track.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 8 of its 14 references that are in the map. First posted on arXiv 6 Aug 2026.

Builds on

8 of 14 references.

References · 8

  1. 2023Qwen Technical Reportcited by 3,344
  2. 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,565
  3. 2019KonIQ-10k: An ecologically valid database for deep learning of blind image quality assessmentcited by 355
  4. 2019Blind Image Quality Assessment Using A Deep Bilinear Convolutional Neural Networkcited by 302
  5. 2015Massive Online Crowdsourced Study of Subjective and Objective Picture Qualitycited by 209
  6. 2023mPLUG-PaperOwl: Scientific Diagram Analysis with the Multimodal Large Language Modelcited by 32
  7. 2026SIQA: Toward Reliable Scientific Image Quality Assessmentcited by 4
  8. 2026EffiMiniVLM: A Compact Dual-Encoder Regression Frameworkcited by 1

Built on by

Not cited yet.