Panoptic Pairwise Distortion Graph
Not on the map. Why?
Abstract (arXiv)
In this work, we introduce a new perspective on comparative image assessment by representing an image pair as a structured composition of its regions. In contrast, existing methods focus on whole image analysis, while implicitly relying on region-level understanding. We extend the intra-image notion of a scene graph to inter-image, and propose a novel task of Distortion Graph (DG). DG treats paired images as a structured topology grounded in regions, and represents dense degradation information such as distortion type, severity, comparison and quality score in a compact interpretable graph structure. To realize the task of learning a distortion graph, we contribute (i) a region-level dataset, PandaSet, (ii) a benchmark suite, PandaBench, with varying region-level difficulty, and (iii) an efficient architecture, Panda, to generate distortion graphs. We demonstrate that PandaBench poses a significant challenge for state-of-the-art multimodal large language models (MLLMs) as they fail to understand region-level degradations even when fed with explicit region cues. We show that training on PandaSet or prompting with DG elicits region-wise distortion understanding, opening a new direction for fine-grained, structured pairwise image assessment.
Key facts. No citing papers in the map yet (data through 13 Oct 2026). Builds on 51 of its 68 references that are in the map. First posted on arXiv 13 Apr 2026.
Builds on
51 of 68 references.
References · 51
- 2017Attention Is All You Needcited by 60,106
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,043
- 2014Microsoft COCO: Common Objects in Contextcited by 17,550
- 2023Segment Anythingcited by 8,195
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,857
- 2023Visual Instruction Tuningcited by 7,827
- 2020End-to-End Object Detection with Transformerscited by 7,396
- 2016Layer Normalizationcited by 5,624
- 2024GPT-4o System Cardcited by 4,536
- 2023Improved Baselines with Visual Instruction Tuningcited by 4,389
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,714
- 2016Gaussian Error Linear Units (GELUs)cited by 3,472
38 more
- 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,068
- 2016Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image Annotationscited by 2,649
- 2025Gemma 3 Technical Reportcited by 1,748
- 2022Exploring CLIP for Assessing the Look and Feel of Imagescited by 980
- 2025Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scalingcited by 799
- 2025SFT Memorizes, RL Generalizes: A Comparative Study of Foundation Model Post-trainingcited by 663
- 2024BLINK: Multimodal Large Language Models Can See but Not Perceivecited by 534
- 2023Q-Align: Teaching LMMs for Visual Scoring via Discrete Text-Defined Levelscited by 495
- 2023ConceptGraphs: Open-Vocabulary 3D Scene Graphs for Perception and Planningcited by 359
- 2024mPLUG-Owl3: Towards Long Image-Sequence Understanding in Multi-Modal Large Language Modelscited by 289
- 2023Q-Bench: A Benchmark for General-Purpose Foundation Models on Low-level Visioncited by 248
- 2024VideoTree: Adaptive Tree-based Video Representation for LLM Reasoning on Long Videoscited by 245
- 2023TOPIQ: A Top-down Approach from Semantics to Distortions for Image Quality Assessmentcited by 226
- 2024MANTIS: Interleaved Multi-Image Instruction Tuningcited by 214
- 2017DesnowNet: Context-Aware Deep Network for Snow Removalcited by 200
- 2023Compositional Chain-of-Thought Prompting for Large Multimodal Modelscited by 163
- 2023Q-Instruct: Improving Low-level Visual Abilities for Multi-modality Foundation Modelscited by 152
- 2023The All-Seeing Project: Towards Panoptic Visual Recognition and Understanding of the Open Worldcited by 115
- 2022Panoptic Scene Graph Generationcited by 114
- 2023Depicting Beyond Scores: Advancing Image Quality Assessment through Multi-modal Language Modelscited by 104
- 2025Q-Insight: Understanding Image Quality via Visual Reinforcement Learningcited by 94
- 2024OneRestore: A Universal Restoration Framework for Composite Degradationcited by 92
- 2023ARNIQA: Learning Distortion Manifold for Image Quality Assessmentcited by 88
- 2024Towards Open-ended Visual Quality Comparisoncited by 85
- 2022Scene Graph Generation: A Comprehensive Surveycited by 73
- 2023Towards General Visual-Linguistic Face Forgery Detectioncited by 45
- 2023Exploring Memorization in Fine-tuned Language Modelscited by 45
- 2024Q-Ground: Image Quality Grounding with Large Multi-modality Modelscited by 30
- 2025Omni-RGPT: Unifying Image and Video Region-level Understanding via Token Markscited by 17
- 2025Video Action Differencingcited by 14
- 2025Scalpel vs. Hammer: GRPO Amplifies Existing Capabilities, SFT Replaces Themcited by 14
- 2024SEAGULL: No-reference Image Quality Assessment for Regions of Interest via Vision-Language Instruction Tuningcited by 13
- 2025Q-SiT: Teaching LMMs for Image Quality Scoring and Interpretingcited by 13
- 2024Grounding-IQA: Grounding Multimodal Language Model for Image Quality Assessmentcited by 12
- 2023Learning Pairwise Interaction for Generalizable DeepFake Detectioncited by 11
- 2025RGB-Event ISP: The Dataset and Benchmarkcited by 6
- 2022Learning Structured Representations of Visual Scenescited by 2
- 2025REEF: Relevance-Aware and Efficient LLM Adapter for Video Understandingcited by 2
50 most cited of 51 All 51 (JSON)
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026DistortBench: Benchmarking Vision Language Models on Image Distortion Identification
- 2025PairBench: Are Vision-Language Models Reliable at Comparing What They See?
- 2025Open World Scene Graph Generation using Vision Language Models
- 2025Measuring Image-Relation Alignment: Reference-Free Evaluation of VLMs and Synthetic Pre-training for Open-Vocabulary Scene Graph Generation
- 2025SPADE: Spatial-Aware Denoising Network for Open-vocabulary Panoptic Scene Graph Generation with Long- and Local-range Context Reasoning
- 2024LLaVA-SpaceSGG: Visual Instruct Tuning for Open-vocabulary Scene Graph Generation with Enhanced Spatial Relations
- 2025Investigate the Low-level Visual Perception in Vision-Language based Image Quality Assessment
- 2026Scene Graph Thinking: Reinforcing Structured Visual Reasoning for Multimodal Large Language Models