mlsanityData to 7 Oct 2026

Decoupling Semantics from Distortions: Multi-Scale Two-Stream Vision-Language Alignment for AI-Generated Image Quality Assessment

arXiv 2606.16799 ↗First posted 15 Jun 2026cs.CV cs.AIcited by 4

On the map: Multimodal LLMs / vision-language models → Image editing and quality assessment

Abstract (arXiv)

Existing vision-language model (VLM)-based AI-generated image quality assessment (AIGIQA) methods suffer from a fundamental semantic-distortion dimensional conflict: monolithic representations optimized for semantic discrimination inherently entangle compositional understanding with low-level perceptual sensitivity, rendering them blind to fine-grained quality degradations. We introduce MST-CLIPIQA, a multi-scale two-stream framework that achieves hierarchical vision-language alignment through explicit representational decoupling. Our architecture leverages dual CLIP encoders with complementary patch granularities: coarse-grained streams capture global semantic coherence while fine-grained streams preserve textural signatures and artifact patterns. An information bottleneck-inspired gated fusion mechanism performs adaptive cross-scale distillation, with optional cross-attention enabling prompt-anchored correspondence evaluation when generation prompts are available. Extensive experiments across five benchmarks establish new state-of-the-art results, achieving average improvements of 1.11 percent SRCC on quality and 2.35 percent SRCC on text-image correspondence prediction, while maintaining efficiency with only 0.8M trainable parameters. Our project is available at https://github.com/YMlinfeng/MST-CLIPIQA.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Placed in Image editing and quality assessment, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 24 of its 31 references that are in the map. First posted on arXiv 15 Jun 2026.

Builds on

24 of 31 references.

References · 24

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  3. 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,388
  4. 2021MUSIQ: Multi-scale Image Quality Transformercited by 1,058
  5. 2023ImageReward: Learning and Evaluating Human Preferences for Text-to-Image Generationcited by 1,010
  6. 2022Exploring CLIP for Assessing the Look and Feel of Imagescited by 974
  7. 2023Pick-a-Pic: An Open Dataset of User Preferences for Text-to-Image Generationcited by 950
  8. 2022MANIQA: Multi-dimension Attention Network for No-Reference Image Quality Assessmentcited by 514
  9. 2023Blind Image Quality Assessment via Vision-Language Correspondence: A Multitask Learning Perspectivecited by 276
  10. 2023TOPIQ: A Top-down Approach from Semantics to Distortions for Image Quality Assessmentcited by 220
  11. 2023AGIQA-3K: An Open Database for AI-Generated Image Quality Assessmentcited by 142
  12. 2023AIGCIQA2023: A Large-scale Image Quality Assessment Database for AI Generated Images: from the Perspectives of Quality, Authenticity and Correspondencecited by 61
12 more
  1. 2020Norm-in-Norm Loss with Faster Convergence and Better Performance for Image Quality Assessmentcited by 54
  2. 2023A Perceptual Quality Assessment Exploration for AIGC Imagescited by 54
  3. 2024AIGIQA-20K: A Large Database for AI-Generated Image Quality Assessmentcited by 33
  4. 2024Quality-Aware Image-Text Alignment for Opinion-Unaware Image Quality Assessmentcited by 31
  5. 2024Large Multi-modality Model Assisted AI-Generated Image Quality Assessmentcited by 24
  6. 2024CLIP-AGIQA: Boosting the Performance of AI-Generated Image Quality Assessment with CLIPcited by 14
  7. 2024Bringing Textual Prompt to AI-Generated Image Quality Assessmentcited by 12
  8. 2024Adaptive Mixed-Scale Feature Fusion Network for Blind AI-Generated Image Quality Assessmentcited by 10
  9. 2025SynPo: Boosting Training-Free Few-Shot Medical Segmentation via High-Quality Negative Promptscited by 9
  10. 2026ARGUS: Stacked Multi-View Identity Mosaic Injection for Subject-Preserving Video Generationcited by 7
  11. 2026OmniDirector: General Multi-Shot Camera Cloning without Cross-Paired Datacited by 6
  12. 2024ATTIQA: Generalizable Image Quality Feature Extractor using Attribute-aware Pretrainingcited by 5

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 4.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Text-Visual Semantic Constrained AI-Generated Image Quality Assessment
  2. 2026Revisiting Compositionality in Dual-Encoder Vision-Language Models: The Role of Inference
  3. 2025Language-Guided Visual Perception Disentanglement for Image Quality Assessment and Conditional Image Generation
  4. 2025Investigate the Low-level Visual Perception in Vision-Language based Image Quality Assessment
  5. 2025Segmenting and Understanding: Region-aware Semantic Attention for Fine-grained Image Quality Assessment with Large Language Models
  6. 2025Building Reasonable Inference for Vision-Language Models in Blind Image Quality Assessment
  7. 2026Parameter-Efficient Adaptation of a Multi-Stream Vision-Language Framework for Blind Image Quality Assessment
  8. 2022Single-Stream Multi-Level Alignment for Vision-Language Pretraining