mlsanityData to 13 Oct 2026

Panoptic Pairwise Distortion Graph

arXiv 2604.11004 ↗First posted 13 Apr 2026cs.CV cs.AI cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

In this work, we introduce a new perspective on comparative image assessment by representing an image pair as a structured composition of its regions. In contrast, existing methods focus on whole image analysis, while implicitly relying on region-level understanding. We extend the intra-image notion of a scene graph to inter-image, and propose a novel task of Distortion Graph (DG). DG treats paired images as a structured topology grounded in regions, and represents dense degradation information such as distortion type, severity, comparison and quality score in a compact interpretable graph structure. To realize the task of learning a distortion graph, we contribute (i) a region-level dataset, PandaSet, (ii) a benchmark suite, PandaBench, with varying region-level difficulty, and (iii) an efficient architecture, Panda, to generate distortion graphs. We demonstrate that PandaBench poses a significant challenge for state-of-the-art multimodal large language models (MLLMs) as they fail to understand region-level degradations even when fed with explicit region cues. We show that training on PandaSet or prompting with DG elicits region-wise distortion understanding, opening a new direction for fine-grained, structured pairwise image assessment.

Key facts. No citing papers in the map yet (data through 13 Oct 2026). Builds on 51 of its 68 references that are in the map. First posted on arXiv 13 Apr 2026.

Builds on

51 of 68 references.

References · 51

  1. 2017Attention Is All You Needcited by 60,106
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,043
  3. 2014Microsoft COCO: Common Objects in Contextcited by 17,550
  4. 2023Segment Anythingcited by 8,195
  5. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,857
  6. 2023Visual Instruction Tuningcited by 7,827
  7. 2020End-to-End Object Detection with Transformerscited by 7,396
  8. 2016Layer Normalizationcited by 5,624
  9. 2024GPT-4o System Cardcited by 4,536
  10. 2023Improved Baselines with Visual Instruction Tuningcited by 4,389
  11. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,714
  12. 2016Gaussian Error Linear Units (GELUs)cited by 3,472
38 more
  1. 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,068
  2. 2016Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image Annotationscited by 2,649
  3. 2025Gemma 3 Technical Reportcited by 1,748
  4. 2022Exploring CLIP for Assessing the Look and Feel of Imagescited by 980
  5. 2025Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scalingcited by 799
  6. 2025SFT Memorizes, RL Generalizes: A Comparative Study of Foundation Model Post-trainingcited by 663
  7. 2024BLINK: Multimodal Large Language Models Can See but Not Perceivecited by 534
  8. 2023Q-Align: Teaching LMMs for Visual Scoring via Discrete Text-Defined Levelscited by 495
  9. 2023ConceptGraphs: Open-Vocabulary 3D Scene Graphs for Perception and Planningcited by 359
  10. 2024mPLUG-Owl3: Towards Long Image-Sequence Understanding in Multi-Modal Large Language Modelscited by 289
  11. 2023Q-Bench: A Benchmark for General-Purpose Foundation Models on Low-level Visioncited by 248
  12. 2024VideoTree: Adaptive Tree-based Video Representation for LLM Reasoning on Long Videoscited by 245
  13. 2023TOPIQ: A Top-down Approach from Semantics to Distortions for Image Quality Assessmentcited by 226
  14. 2024MANTIS: Interleaved Multi-Image Instruction Tuningcited by 214
  15. 2017DesnowNet: Context-Aware Deep Network for Snow Removalcited by 200
  16. 2023Compositional Chain-of-Thought Prompting for Large Multimodal Modelscited by 163
  17. 2023Q-Instruct: Improving Low-level Visual Abilities for Multi-modality Foundation Modelscited by 152
  18. 2023The All-Seeing Project: Towards Panoptic Visual Recognition and Understanding of the Open Worldcited by 115
  19. 2022Panoptic Scene Graph Generationcited by 114
  20. 2023Depicting Beyond Scores: Advancing Image Quality Assessment through Multi-modal Language Modelscited by 104
  21. 2025Q-Insight: Understanding Image Quality via Visual Reinforcement Learningcited by 94
  22. 2024OneRestore: A Universal Restoration Framework for Composite Degradationcited by 92
  23. 2023ARNIQA: Learning Distortion Manifold for Image Quality Assessmentcited by 88
  24. 2024Towards Open-ended Visual Quality Comparisoncited by 85
  25. 2022Scene Graph Generation: A Comprehensive Surveycited by 73
  26. 2023Towards General Visual-Linguistic Face Forgery Detectioncited by 45
  27. 2023Exploring Memorization in Fine-tuned Language Modelscited by 45
  28. 2024Q-Ground: Image Quality Grounding with Large Multi-modality Modelscited by 30
  29. 2025Omni-RGPT: Unifying Image and Video Region-level Understanding via Token Markscited by 17
  30. 2025Video Action Differencingcited by 14
  31. 2025Scalpel vs. Hammer: GRPO Amplifies Existing Capabilities, SFT Replaces Themcited by 14
  32. 2024SEAGULL: No-reference Image Quality Assessment for Regions of Interest via Vision-Language Instruction Tuningcited by 13
  33. 2025Q-SiT: Teaching LMMs for Image Quality Scoring and Interpretingcited by 13
  34. 2024Grounding-IQA: Grounding Multimodal Language Model for Image Quality Assessmentcited by 12
  35. 2023Learning Pairwise Interaction for Generalizable DeepFake Detectioncited by 11
  36. 2025RGB-Event ISP: The Dataset and Benchmarkcited by 6
  37. 2022Learning Structured Representations of Visual Scenescited by 2
  38. 2025REEF: Relevance-Aware and Efficient LLM Adapter for Video Understandingcited by 2

50 most cited of 51 All 51 (JSON)

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026DistortBench: Benchmarking Vision Language Models on Image Distortion Identification
  2. 2025PairBench: Are Vision-Language Models Reliable at Comparing What They See?
  3. 2025Open World Scene Graph Generation using Vision Language Models
  4. 2025Measuring Image-Relation Alignment: Reference-Free Evaluation of VLMs and Synthetic Pre-training for Open-Vocabulary Scene Graph Generation
  5. 2025SPADE: Spatial-Aware Denoising Network for Open-vocabulary Panoptic Scene Graph Generation with Long- and Local-range Context Reasoning
  6. 2024LLaVA-SpaceSGG: Visual Instruct Tuning for Open-vocabulary Scene Graph Generation with Enhanced Spatial Relations
  7. 2025Investigate the Low-level Visual Perception in Vision-Language based Image Quality Assessment
  8. 2026Scene Graph Thinking: Reinforcing Structured Visual Reasoning for Multimodal Large Language Models