Loss Functions for Neural Networks for Image Processing
Not on the map. Why?
Abstract (arXiv)
Neural networks are becoming central in several areas of computer vision and image processing and different architectures have been proposed to solve specific problems. The impact of the loss layer of neural networks, however, has not received much attention in the context of image processing: the default and virtually only choice is L2. In this paper, we bring attention to alternative choices for image restoration. In particular, we show the importance of perceptually-motivated losses when the resulting image is to be evaluated by a human observer. We compare the performance of several losses, and propose a novel, differentiable error function. We show that the quality of the results improves significantly with better loss functions, even when the network architecture is left unchanged.
Key facts. Cited by 41 papers in the map (data through 14 Oct 2026). First posted on arXiv 28 Nov 2015.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2019: 1; 2020: 0; 2021: 14; 2022: 9; 2023: 4; 2024: 8; 2025: 3; 2026: 2.
41 papers.
Sort:
By area:
- 2021Deep learning-based synthetic-CT generation in radiotherapy and PET: a reviewcited by 28
- 2021SurfaceNet: Adversarial SVBRDF Estimation from a Single Imagecited by 25
- 2021Anomaly Detection via Self-organizing Mapcited by 18
- 2022Facial Action Unit Detection and Intensity Estimation from Self-supervised Representationcited by 16
- 2021Trusted Artificial Intelligence: Towards Certification of Machine Learning Applicationscited by 13
- 2022Semi-Supervised Learning with Mutual Distillation for Monocular Depth Estimationcited by 10
- 2021Functional Neural Networks for Parametric Image Restoration Problemscited by 9
- 2019Model-based Behavioral Cloning with Future Image Similarity Learningcited by 8
- 2021Selective Pseudo-label Clusteringcited by 8
- 2022Computing Multiple Image Reconstructions with a Single Hypernetworkcited by 8
- 2024Generating Counterfactual Trajectories with Latent Diffusion Models for Concept Discoverycited by 8
- 2021On the Sins of Image Synthesis Loss for Self-supervised Depth Estimationcited by 7
29 more
- 2024Multi-scale Restoration of Missing Data in Optical Time-series Images with Masked Spatial-Temporal Attention Networkcited by 7
- 2023Vision Learners Meet Web Image-Text Pairscited by 6
- 2024Imaging foundation model for universal enhancement of non-ideal measurement CTcited by 6
- 2025UltraFast-LiNET: Light-weight multi-scale shift convolutional network for real-time low-light image enhancementcited by 5
- 2021Ada-VSR: Adaptive Video Super-Resolution with Meta-Learningcited by 3
- 2021FAMINet: Learning Real-time Semi-supervised Video Object Segmentation with Steepest Optimized Optical Flowcited by 3
- 2025HiFi-Mamba: Dual-Stream W-Laplacian Enhanced Mamba for High-Fidelity MRI Reconstructioncited by 3
- 2023An Unsupervised Framework for Joint MRI Super Resolution and Gibbs Artifact Removalcited by 2
- 2023Hard-normal Example-aware Template Mutual Matching for Industrial Anomaly Detectioncited by 2
- 2024MCU-Net: A Multi-prior Collaborative Deep Unfolding Network with Gates-controlled Spatial Attention for Accelerated MR Image Reconstructioncited by 2
- 2026SPACE-CLIP: Spatial Perception via Adaptive CLIP Embeddings for Monocular Depth Estimationcited by 2
- 2021Multitask Learning for VVC Quality Enhancement and Super-Resolutioncited by 1
- 2021Robotic Inspection of Underground Utilities for Construction Survey Using a Ground Penetrating Radarcited by 1
- 2022Image quality measurements and denoising using Fourier Ring Correlationscited by 1
- 2022RSINet: Inpainting Remotely Sensed Images Using Triple GAN Frameworkcited by 1
- 2022Attention-based Knowledge Distillation in Multi-attention Tasks: The Impact of a DCT-driven Losscited by 1
- 2022Deep Learning Techniques for Visual Countingcited by 1
- 2022VoloGAN: Adversarial Domain Adaptation for Synthetic Depth Datacited by 1
- 2022Audio Denoising for Robust Audio Fingerprintingcited by 1
- 2024Geometric Constraints in Deep Learning Frameworks: A Surveycited by 1
- 2025HiFi-MambaV2: Hierarchical Shared-Routed MoE for High-Fidelity MRI Reconstructioncited by 1
- 2021Deep Learning strategies for ProtoDUNE raw data denoisingcited by 0
- 2021Physics Driven Deep Retinex Fusion for Adaptive Infrared and Visible Image Fusioncited by 0
- 2021Attention based Broadly Self-guided Network for Low light Image Enhancementcited by 0
- 2023Self-Supervised Versus Supervised Training for Segmentation of Organoid Imagescited by 0
- 2024ReWiTe: Realistic Wide-angle and Telephoto Dual Camera Fusion Dataset via Beam Splitter Camera Rigcited by 0
- 2024ATAC-Net: Zoomed view works better for Anomaly Detectioncited by 0
- 2024LightPure: Realtime Adversarial Image Purification for Mobile Devices Using Diffusion Modelscited by 0
- 2026Alternate loss functions and regression models that achieve robustness to outliers by modulating the learning ratecited by 0
- 2026Alternate loss functions and regression models that achieve robustness to outliers by modulating the learning rate20 Jun 2026
- 2026SPACE-CLIP: Spatial Perception via Adaptive CLIP Embeddings for Monocular Depth Estimation25 Jan 2026
- 2025UltraFast-LiNET: Light-weight multi-scale shift convolutional network for real-time low-light image enhancement2 Dec 2025
- 2025HiFi-MambaV2: Hierarchical Shared-Routed MoE for High-Fidelity MRI Reconstruction23 Nov 2025
- 2025HiFi-Mamba: Dual-Stream W-Laplacian Enhanced Mamba for High-Fidelity MRI Reconstruction7 Aug 2025
- 2024Imaging foundation model for universal enhancement of non-ideal measurement CT2 Oct 2024
- 2024LightPure: Realtime Adversarial Image Purification for Mobile Devices Using Diffusion Models31 Aug 2024
- 2024ATAC-Net: Zoomed view works better for Anomaly Detection20 Jun 2024
- 2024Multi-scale Restoration of Missing Data in Optical Time-series Images with Masked Spatial-Temporal Attention Network19 Jun 2024
- 2024ReWiTe: Realistic Wide-angle and Telephoto Dual Camera Fusion Dataset via Beam Splitter Camera Rig16 Apr 2024
- 2024Generating Counterfactual Trajectories with Latent Diffusion Models for Concept Discovery16 Apr 2024
- 2024Geometric Constraints in Deep Learning Frameworks: A Survey19 Mar 2024
29 more
- 2024MCU-Net: A Multi-prior Collaborative Deep Unfolding Network with Gates-controlled Spatial Attention for Accelerated MR Image Reconstruction4 Feb 2024
- 2023Self-Supervised Versus Supervised Training for Segmentation of Organoid Images19 Nov 2023
- 2023Hard-normal Example-aware Template Mutual Matching for Industrial Anomaly Detection28 Mar 2023
- 2023An Unsupervised Framework for Joint MRI Super Resolution and Gibbs Artifact Removal6 Feb 2023
- 2023Vision Learners Meet Web Image-Text Pairs17 Jan 2023
- 2022Audio Denoising for Robust Audio Fingerprinting21 Dec 2022
- 2022Facial Action Unit Detection and Intensity Estimation from Self-supervised Representation28 Oct 2022
- 2022VoloGAN: Adversarial Domain Adaptation for Synthetic Depth Data19 Jul 2022
- 2022Deep Learning Techniques for Visual Counting7 Jun 2022
- 2022Attention-based Knowledge Distillation in Multi-attention Tasks: The Impact of a DCT-driven Loss4 May 2022
- 2022Semi-Supervised Learning with Mutual Distillation for Monocular Depth Estimation18 Mar 2022
- 2022Computing Multiple Image Reconstructions with a Single Hypernetwork22 Feb 2022
- 2022RSINet: Inpainting Remotely Sensed Images Using Triple GAN Framework12 Feb 2022
- 2022Image quality measurements and denoising using Fourier Ring Correlations11 Jan 2022
- 2021Attention based Broadly Self-guided Network for Low light Image Enhancement12 Dec 2021
- 2021Physics Driven Deep Retinex Fusion for Adaptive Infrared and Visible Image Fusion6 Dec 2021
- 2021FAMINet: Learning Real-time Semi-supervised Video Object Segmentation with Steepest Optimized Optical Flow20 Nov 2021
- 2021Functional Neural Networks for Parametric Image Restoration Problems30 Oct 2021
- 2021On the Sins of Image Synthesis Loss for Self-supervised Depth Estimation13 Sep 2021
- 2021Ada-VSR: Adaptive Video Super-Resolution with Meta-Learning5 Aug 2021
- 2021SurfaceNet: Adversarial SVBRDF Estimation from a Single Image23 Jul 2021
- 2021Selective Pseudo-label Clustering22 Jul 2021
- 2021Anomaly Detection via Self-organizing Map21 Jul 2021
- 2021Robotic Inspection of Underground Utilities for Construction Survey Using a Ground Penetrating Radar3 Jun 2021
- 2021Multitask Learning for VVC Quality Enhancement and Super-Resolution16 Apr 2021
- 2021Trusted Artificial Intelligence: Towards Certification of Machine Learning Applications31 Mar 2021
- 2021Deep Learning strategies for ProtoDUNE raw data denoising2 Mar 2021
- 2021Deep learning-based synthetic-CT generation in radiotherapy and PET: a review4 Feb 2021
- 2019Model-based Behavioral Cloning with Future Image Similarity Learning8 Oct 2019
- 2021Deep learning-based synthetic-CT generation in radiotherapy and PET: a reviewcited by 28
- 2021SurfaceNet: Adversarial SVBRDF Estimation from a Single Imagecited by 25
- 2021Anomaly Detection via Self-organizing Mapcited by 18
- 2022Facial Action Unit Detection and Intensity Estimation from Self-supervised Representationcited by 16
- 2021Trusted Artificial Intelligence: Towards Certification of Machine Learning Applicationscited by 13
- 2022Semi-Supervised Learning with Mutual Distillation for Monocular Depth Estimationcited by 10
- 2021Functional Neural Networks for Parametric Image Restoration Problemscited by 9
- 2021Selective Pseudo-label Clusteringcited by 8
- 2022Computing Multiple Image Reconstructions with a Single Hypernetworkcited by 8
- 2021On the Sins of Image Synthesis Loss for Self-supervised Depth Estimationcited by 7
- 2024Multi-scale Restoration of Missing Data in Optical Time-series Images with Masked Spatial-Temporal Attention Networkcited by 7
- 2023Vision Learners Meet Web Image-Text Pairscited by 6
12 most cited of 35 All 35 (JSON)
- 2026Alternate loss functions and regression models that achieve robustness to outliers by modulating the learning rate20 Jun 2026
- 2026SPACE-CLIP: Spatial Perception via Adaptive CLIP Embeddings for Monocular Depth Estimation25 Jan 2026
- 2025UltraFast-LiNET: Light-weight multi-scale shift convolutional network for real-time low-light image enhancement2 Dec 2025
- 2024Imaging foundation model for universal enhancement of non-ideal measurement CT2 Oct 2024
- 2024ATAC-Net: Zoomed view works better for Anomaly Detection20 Jun 2024
- 2024Multi-scale Restoration of Missing Data in Optical Time-series Images with Masked Spatial-Temporal Attention Network19 Jun 2024
- 2024ReWiTe: Realistic Wide-angle and Telephoto Dual Camera Fusion Dataset via Beam Splitter Camera Rig16 Apr 2024
- 2024Geometric Constraints in Deep Learning Frameworks: A Survey19 Mar 2024
- 2024MCU-Net: A Multi-prior Collaborative Deep Unfolding Network with Gates-controlled Spatial Attention for Accelerated MR Image Reconstruction4 Feb 2024
- 2023Self-Supervised Versus Supervised Training for Segmentation of Organoid Images19 Nov 2023
- 2023Hard-normal Example-aware Template Mutual Matching for Industrial Anomaly Detection28 Mar 2023
- 2023An Unsupervised Framework for Joint MRI Super Resolution and Gibbs Artifact Removal6 Feb 2023
12 newest of 35 All 35 (JSON)