Decoupling Semantics from Distortions: Multi-Scale Two-Stream Vision-Language Alignment for AI-Generated Image Quality Assessment
On the map: Multimodal LLMs / vision-language models → Image editing and quality assessment
Abstract (arXiv)
Existing vision-language model (VLM)-based AI-generated image quality assessment (AIGIQA) methods suffer from a fundamental semantic-distortion dimensional conflict: monolithic representations optimized for semantic discrimination inherently entangle compositional understanding with low-level perceptual sensitivity, rendering them blind to fine-grained quality degradations. We introduce MST-CLIPIQA, a multi-scale two-stream framework that achieves hierarchical vision-language alignment through explicit representational decoupling. Our architecture leverages dual CLIP encoders with complementary patch granularities: coarse-grained streams capture global semantic coherence while fine-grained streams preserve textural signatures and artifact patterns. An information bottleneck-inspired gated fusion mechanism performs adaptive cross-scale distillation, with optional cross-attention enabling prompt-anchored correspondence evaluation when generation prompts are available. Extensive experiments across five benchmarks establish new state-of-the-art results, achieving average improvements of 1.11 percent SRCC on quality and 2.35 percent SRCC on text-image correspondence prediction, while maintaining efficiency with only 0.8M trainable parameters. Our project is available at https://github.com/YMlinfeng/MST-CLIPIQA.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Placed in Image editing and quality assessment, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 24 of its 31 references that are in the map. First posted on arXiv 15 Jun 2026.
Builds on
24 of 31 references.
References · 24
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,388
- 2021MUSIQ: Multi-scale Image Quality Transformercited by 1,058
- 2023ImageReward: Learning and Evaluating Human Preferences for Text-to-Image Generationcited by 1,010
- 2022Exploring CLIP for Assessing the Look and Feel of Imagescited by 974
- 2023Pick-a-Pic: An Open Dataset of User Preferences for Text-to-Image Generationcited by 950
- 2022MANIQA: Multi-dimension Attention Network for No-Reference Image Quality Assessmentcited by 514
- 2023Blind Image Quality Assessment via Vision-Language Correspondence: A Multitask Learning Perspectivecited by 276
- 2023TOPIQ: A Top-down Approach from Semantics to Distortions for Image Quality Assessmentcited by 220
- 2023AGIQA-3K: An Open Database for AI-Generated Image Quality Assessmentcited by 142
- 2023AIGCIQA2023: A Large-scale Image Quality Assessment Database for AI Generated Images: from the Perspectives of Quality, Authenticity and Correspondencecited by 61
12 more
- 2020Norm-in-Norm Loss with Faster Convergence and Better Performance for Image Quality Assessmentcited by 54
- 2023A Perceptual Quality Assessment Exploration for AIGC Imagescited by 54
- 2024AIGIQA-20K: A Large Database for AI-Generated Image Quality Assessmentcited by 33
- 2024Quality-Aware Image-Text Alignment for Opinion-Unaware Image Quality Assessmentcited by 31
- 2024Large Multi-modality Model Assisted AI-Generated Image Quality Assessmentcited by 24
- 2024CLIP-AGIQA: Boosting the Performance of AI-Generated Image Quality Assessment with CLIPcited by 14
- 2024Bringing Textual Prompt to AI-Generated Image Quality Assessmentcited by 12
- 2024Adaptive Mixed-Scale Feature Fusion Network for Blind AI-Generated Image Quality Assessmentcited by 10
- 2025SynPo: Boosting Training-Free Few-Shot Medical Segmentation via High-Quality Negative Promptscited by 9
- 2026ARGUS: Stacked Multi-View Identity Mosaic Injection for Subject-Preserving Video Generationcited by 7
- 2026OmniDirector: General Multi-Shot Camera Cloning without Cross-Paired Datacited by 6
- 2024ATTIQA: Generalizable Image Quality Feature Extractor using Attribute-aware Pretrainingcited by 5
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026OmniDrive: An LLM-Choreographed Multi-Agent World Model with Unified Latent Co-Compression for Multi-View Driving Video Generationcited by 2
- 2026TRIDENT: Breaking the Hybrid-Safety-Physics Coupling for Provably Safe Multi-Agent Reinforcement Learningcited by 2
- 2026Binding Multiple Modalities via Multimodal Wasserstein Barycentercited by 1
- 2026Bridging Adversarial and Collaborative Learning for AI-Generated Image Quality Assessmentcited by 0
- 2026Binding Multiple Modalities via Multimodal Wasserstein Barycenter27 Sep 2026
- 2026Bridging Adversarial and Collaborative Learning for AI-Generated Image Quality Assessment25 Aug 2026
- 2026TRIDENT: Breaking the Hybrid-Safety-Physics Coupling for Provably Safe Multi-Agent Reinforcement Learning16 Jun 2026
- 2026OmniDrive: An LLM-Choreographed Multi-Agent World Model with Unified Latent Co-Compression for Multi-View Driving Video Generation16 Jun 2026
Similar, not cited
Close in wording, no citation either way
- 2025Text-Visual Semantic Constrained AI-Generated Image Quality Assessment
- 2026Revisiting Compositionality in Dual-Encoder Vision-Language Models: The Role of Inference
- 2025Language-Guided Visual Perception Disentanglement for Image Quality Assessment and Conditional Image Generation
- 2025Investigate the Low-level Visual Perception in Vision-Language based Image Quality Assessment
- 2025Segmenting and Understanding: Region-aware Semantic Attention for Fine-grained Image Quality Assessment with Large Language Models
- 2025Building Reasonable Inference for Vision-Language Models in Blind Image Quality Assessment
- 2026Parameter-Efficient Adaptation of a Multi-Stream Vision-Language Framework for Blind Image Quality Assessment
- 2022Single-Stream Multi-Level Alignment for Vision-Language Pretraining