Bridging the Perceptual Gap: Residual-Enhanced Downscaling and Manifold-Aware Perception Alignment Adaptation for NR-IQA
On the map: Multimodal LLMs / vision-language models → Image editing and quality assessment
Abstract (arXiv)
Leveraging Large Vision-Language Models like CLIP has recently set new benchmarks for No-Reference Image Quality Assessment (NR-IQA). However, the contrastive pretraining of CLIP inherently prioritizes semantic invariance, which often suppresses subtle perceptual signals, a phenomenon we term perceptual submergence. Furthermore, standard preprocessing techniques (e.g., cropping and interpolation) further exacerbate the loss of critical high-frequency quality cues. In this paper, we propose the Cross-modal Perception Alignment Adapter (CMPA), a manifold-aware framework designed to disentangle perceptual distortions from dominant semantics. CMPA introduces a Perception-Sensitive Feature Extractor (PFE) that projects CLIP features into a compact, low-dimensional subspace, explicitly magnifying distortion-induced off-manifold deviations. Subsequently, a Cross-Modal Perception Alignment Injector (PAI) aligns these features with quality-aware text anchors and re-injects them into the backbone. To ensure input fidelity, we also devise a Residual-enhanced Perceptual Downscaling strategy that adaptively compensates for resolution-induced information loss using Just Noticeable Difference (JND) guided frequency re-injection. Extensive evaluations on several benchmark datasets demonstrate that our approach significantly outperforms state-of-the-art methods, effectively recovering the perceptual signals submerged in semantic-dense representations.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Image editing and quality assessment, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 33 of its 53 references that are in the map. First posted on arXiv 15 Sep 2026.
Builds on
33 of 53 references.
Closest ancestors · 1
Same direction, newest first
Other references · 32
- 2017Attention Is All You Needcited by 59,932
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2021Learning to Prompt for Vision-Language Modelscited by 2,269
- 2021MUSIQ: Multi-scale Image Quality Transformercited by 1,058
- 2021CLIP-Adapter: Better Vision-Language Models with Feature Adapterscited by 1,021
- 2022Exploring CLIP for Assessing the Look and Feel of Imagescited by 974
- 2022AdaptFormer: Adapting Vision Transformers for Scalable Visual Recognitioncited by 714
- 2023Scaling Vision Transformers to 22 Billion Parameterscited by 690
- 2022MANIQA: Multi-dimension Attention Network for No-Reference Image Quality Assessmentcited by 514
- 2020Meta Pseudo Labelscited by 372
20 more
- 2019KonIQ-10k: An ecologically valid database for deep learning of blind image quality assessmentcited by 351
- 2019Blind Image Quality Assessment Using A Deep Bilinear Convolutional Neural Networkcited by 301
- 2023Blind Image Quality Assessment via Vision-Language Correspondence: A Multitask Learning Perspectivecited by 276
- 2015Massive Online Crowdsourced Study of Subjective and Objective Picture Qualitycited by 208
- 2022FAST-VQA: Efficient End-to-end Video Quality Assessment with Fragment Samplingcited by 179
- 2020Patch-VQ: 'Patching Up' the Video Quality Problemcited by 147
- 2020MetaIQA: Deep Meta-learning for No-Reference Image Quality Assessmentcited by 144
- 2022FacT: Factor-Tuning for Lightweight Adaptation on Vision Transformercited by 133
- 2022Convolutional Bypasses Are Better Vision Transformer Adapterscited by 120
- 2023Re-IQA: Unsupervised Learning for Image Quality Assessment in the Wildcited by 97
- 2021Image Quality Assessment using Contrastive Learningcited by 95
- 2020Norm-in-Norm Loss with Faster Convergence and Better Performance for Image Quality Assessmentcited by 54
- 2023Data-Efficient Image Quality Assessment with Attention-Panel Decodercited by 49
- 2024Quality-Aware Image-Text Alignment for Opinion-Unaware Image Quality Assessmentcited by 31
- 2024Scaling and Masking: A New Paradigm of Data Sampling for Image and Video Quality Assessmentcited by 13
- 2023CLiF-VQA: Enhancing Video Quality Assessment by Incorporating High-Level Semantic Information related to Human Feelingscited by 11
- 2024QMamba: On First Exploration of Vision Mamba for Image Quality Assessmentcited by 8
- 2025MVQA: Mamba with Unified Sampling for Efficient Video Quality Assessmentcited by 2
- 2025Uniform Resampling vs. Image Blur: Aliasing Approximation via Isotropic Gaussian Filteringcited by 1
- 2026Unleashing Vision Transformer Potential In Image Quality Assessment via Global-Local Adaptive Interactioncited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Investigate the Low-level Visual Perception in Vision-Language based Image Quality Assessment
- 2025Segmenting and Understanding: Region-aware Semantic Attention for Fine-grained Image Quality Assessment with Large Language Models
- 2023Learning Generalizable Perceptual Representations for Data-Efficient No-Reference Image Quality Assessment
- 2024Mitigating Perception Bias: A Training-Free Approach to Enhance LMM for Image Quality Assessment
- 2026Decoupling Semantics from Distortions: Multi-Scale Two-Stream Vision-Language Alignment for AI-Generated Image Quality Assessment
- 2025Non-Aligned Reference Image Quality Assessment for Novel View Synthesis
- 2025Latent Guidance in Diffusion Models for Perceptual Evaluations
- 2025Post-pre-training for Modality Alignment in Vision-Language Foundation Models