Embodied Image Quality Assessment for Robotic Intelligence
Not on the map. Why?
Abstract (arXiv)
Image Quality Assessment (IQA) of User-Generated Content (UGC) is a critical technique for human Quality of Experience (QoE). However, does the the image quality of Robot-Generated Content (RGC) demonstrate traits consistent with the Moravec paradox, potentially conflicting with human perceptual norms? Human subjective scoring is more based on the attractiveness of the image. Embodied agent are required to interact and perceive in the environment, and finally perform specific tasks. Visual images as inputs directly influence downstream tasks. In this paper, we explore the perception mechanism of embodied robots for image quality. We propose the first Embodied Preference Database (EPD), which contains 12,500 distorted image annotations. We establish assessment metrics based on the downstream tasks of robot. In addition, there is a gap between UGC and RGC. To address this, we propose a novel Multi-scale Attention Embodied Image Quality Assessment called MA-EIQA. For the proposed EPD dataset, this is the first no-reference IQA model designed for embodied robot. Finally, the performance of mainstream IQA algorithms on EPD dataset is verified. The experiments demonstrate that quality assessment of embodied images is different from that of humans. We sincerely hope that the EPD can contribute to the development of embodied AI by focusing on image quality assessment. The benchmark is available at https://github.com/Jianbo-maker/EPD_benchmark.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 35 of its 69 references that are in the map. First posted on arXiv 25 Dec 2024.
Builds on
35 of 69 references.
References · 35
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2018Soft Actor-Critic: Off-Policy Maximum Entropy Deep Reinforcement Learning with a Stochastic Actorcited by 4,885
- 2018CBAM: Convolutional Block Attention Modulecited by 2,477
- 2019Habitat: A Platform for Embodied AI Researchcited by 1,191
- 2021Isaac Gym: High Performance GPU-Based Physics Simulation For Robot Learningcited by 998
- 2022Exploring CLIP for Assessing the Look and Feel of Imagescited by 991
- 2017AI2-THOR: An Interactive 3D Environment for Visual AIcited by 869
- 2020Image Quality Assessment: Unifying Structure and Texture Similaritycited by 811
- 2018Path Aggregation Network for Instance Segmentationcited by 798
- 2020SAPIEN: A SimulAted Part-based Interactive ENvironmentcited by 595
23 more
- 2022MANIQA: Multi-dimension Attention Network for No-Reference Image Quality Assessmentcited by 522
- 2023TD-MPC2: Scalable, Robust World Models for Continuous Controlcited by 512
- 2019KonIQ-10k: An ecologically valid database for deep learning of blind image quality assessmentcited by 355
- 2019Blind Image Quality Assessment Using A Deep Bilinear Convolutional Neural Networkcited by 302
- 2024ManiSkill3: GPU Parallelized Robotics Simulation and Rendering for Generalizable Embodied AIcited by 229
- 2023TOPIQ: A Top-down Approach from Semantics to Distortions for Image Quality Assessmentcited by 226
- 2016Deep Neural Networks for No-Reference and Full-Reference Image Quality Assessmentcited by 225
- 2015Massive Online Crowdsourced Study of Subjective and Objective Picture Qualitycited by 209
- 2013Gradient Magnitude Similarity Deviation: A Highly Efficient Perceptual Image Quality Indexcited by 195
- 2024Aligning Cyber Space with Physical World: A Comprehensive Survey on Embodied AIcited by 179
- 2018PieAPP: Perceptual Image-Error Assessment through Pairwise Preferencecited by 160
- 2020MetaIQA: Deep Meta-learning for No-Reference Image Quality Assessmentcited by 144
- 2023AGIQA-3K: An Open Database for AI-Generated Image Quality Assessmentcited by 142
- 2022Attentions Help CNNs See Better: Attention-based Hybrid Image Quality Assessment Networkcited by 57
- 2021Perceptual Image Quality Assessment with Transformerscited by 54
- 2021Learning Conditional Knowledge Distillation for Degraded-Reference Image Quality Assessmentcited by 41
- 2024A-Bench: Are LMMs Masters at Evaluating AI-generated Images?cited by 39
- 2024Quality-Aware Image-Text Alignment for Opinion-Unaware Image Quality Assessmentcited by 32
- 2024R-Bench: Are your Large Multimodal Model Robust to Real-world Corruptions?cited by 30
- 2023Scientific Exploration of Challenging Planetary Analog Environments with a Team of Legged Robotscited by 20
- 2023Dual Degradation Representation for Joint Deraining and Low-Light Enhancement in the Darkcited by 9
- 2024CMC-Bench: Towards a New Paradigm of Visual Signal Compressioncited by 6
- 2023Blind Image Quality Assessment via Transformer Predicted Error Map and Perceptual Quality Tokencited by 5
Built on by
Citing papers per year: 2025: 1; 2026: 1.
2 papers.