Holistically-Nested Edge Detection
Not on the map. Why?
Cited by 110 in Diffusion models, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
We develop a new edge detection algorithm that tackles two important issues in this long-standing vision problem: (1) holistic image training and prediction; and (2) multi-scale and multi-level feature learning. Our proposed method, holistically-nested edge detection (HED), performs image-to-image prediction by means of a deep learning model that leverages fully convolutional neural networks and deeply-supervised nets. HED automatically learns rich hierarchical representations (guided by deep supervision on side responses) that are important in order to approach the human ability resolve the challenging ambiguity in edge and object boundary detection. We significantly advance the state-of-the-art on the BSD500 dataset (ODS F-score of .782) and the NYU Depth dataset (ODS F-score of .746), and do so with an improved speed (0.4 second per image) that is orders of magnitude faster than some recent CNN-based edge detection algorithms.
Key facts. Cited by 590 papers in the map (data through 7 Oct 2026). First posted on arXiv 24 Apr 2015.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 107; 2022: 99; 2023: 113; 2024: 133; 2025: 89; 2026: 49.
590 papers.
Sort:
By area:
- 2023Segment Anythingcited by 8,158
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
- 2023PixArt-α: Fast Training of Diffusion Transformer for Photorealistic Text-to-Image Synthesiscited by 854
- 2023Visual ChatGPT: Talking, Drawing and Editing with Visual Foundation Modelscited by 659
- 2023Uni-ControlNet: All-in-One Control to Text-to-Image Diffusion Modelscited by 358
- 2023Fast Segment Anythingcited by 286
- 2025Video models are zero-shot learners and reasonerscited by 208
- 2023UniControl: A Unified Diffusion Model for Controllable Visual Generation In the Wildcited by 197
- 2021Conditional Image Generation with Score-Based Diffusion Modelscited by 195
- 2021Unsupervised Semantic Segmentation by Contrasting Object Mask Proposalscited by 190
- 2021Visual Saliency Transformercited by 175
- 2021Pixel Difference Networks for Efficient Edge Detectioncited by 167
38 more
- 2022Pretraining is All You Need for Image-to-Image Translationcited by 160
- 2023StyleDiffusion: Controllable Disentangled Style Transfer via Diffusion Modelscited by 154
- 2024ControlNet++: Improving Conditional Controls with Efficient Consistency Feedbackcited by 153
- 2022FILM: Frame Interpolation for Large Motioncited by 149
- 2023RAPHAEL: Text-to-Image Generation via Large Mixture of Diffusion Pathscited by 141
- 2023Make Pixels Dance: High-Dynamic Video Generationcited by 140
- 2021Salient Object Detection via Integrity Learningcited by 133
- 2023Patch Diffusion: Faster and More Data-Efficient Training of Diffusion Modelscited by 131
- 2021A Comprehensive Survey of Scene Graphs: Generation and Applicationcited by 125
- 2024One-Step Image Translation with Text-to-Image Modelscited by 111
- 2022Highly Accurate Dichotomous Image Segmentationcited by 110
- 2024GARField: Group Anything with Radiance Fieldscited by 108
- 2021Mutual Graph Learning for Camouflaged Object Detectioncited by 103
- 2023In-Context Learning Unlocked for Diffusion Modelscited by 103
- 2021Repurposing GANs for One-shot Semantic Part Segmentationcited by 88
- 2025SANA-Sprint: One-Step Diffusion with Continuous-Time Consistency Distillationcited by 85
- 2022Learning to generate line drawings that convey geometry and semanticscited by 82
- 2023AVID: Any-Length Video Inpainting with Diffusion Modelcited by 81
- 2021Multimodal Conditional Image Synthesis with Product-of-Experts GANscited by 75
- 2021Line Segment Detection Using Transformers without Edgescited by 73
- 2024Instruct-Imagen: Image Generation with Multi-modal Instructioncited by 65
- 2022CLIPascene: Scene Sketching with Different Types and Levels of Abstractioncited by 63
- 2023Text + Sketch: Image Compression at Ultra Low Ratescited by 63
- 2024StyleShot: A Snapshot on Any Stylecited by 60
- 2021Applications of Deep Learning in Fundus Images: A Reviewcited by 59
- 2022CamoFormer: Masked Separable Attention for Camouflaged Object Detectioncited by 58
- 2022Few Shot Generative Model Adaption via Relaxed Spatial Structural Alignmentcited by 54
- 2023DiffSketcher: Text Guided Vector Sketch Synthesis through Latent Diffusion Modelscited by 54
- 2024CRS-Diff: Controllable Remote Sensing Image Generation with Diffusion Modelcited by 54
- 2023Readout Guidance: Learning Control from Diffusion Featurescited by 52
- 2024Still-Moving: Customized Video Generation without Customized Video Datacited by 49
- 2021Enhanced Boundary Learning for Glass-like Object Segmentationcited by 48
- 2022Tree Energy Loss: Towards Sparsely Annotated Semantic Segmentationcited by 47
- 2023Advances in Deep Concealed Scene Understandingcited by 47
- 2023Breathing Life Into Sketches Using Text-to-Video Priorscited by 47
- 2024AnimateDiff-Lightning: Cross-Model Diffusion Distillationcited by 47
- 2022A Survey on Label-efficient Deep Image Segmentation: Bridging the Gap between Weak Supervision and Dense Predictioncited by 46
- 2023Control-A-Video: Controllable Text-to-Video Diffusion Models with Motion Prior and Reward Feedback Learningcited by 46
50 most cited of 590 All 590 (JSON)
- 2026DRHeC: Differentiable Rendering for Hand-Eye Calibration with RGB-Based Gradients29 Sep 2026
- 2026OmniVBench: A Benchmark and Large-Scale Dataset for Omni Reference-to-Video Generation18 Sep 2026
- 2026DERA: Detached Edge-Residual Adaptation for Prohibited item Detection11 Sep 2026
- 2026ReaDiT Guidance: Control for Image and Video Generation using Diffusion Transformer Features4 Sep 2026
- 2026RealOOB: A Definition-Consistent Real-World Oriented Occlusion Boundary Benchmark31 Aug 2026
- 2026Chat-Edit-3D++: Interactive 3D and 4D Scene Editing via Large Language Models29 Aug 2026
- 2026Enhancing MRI Brain Tumor Edge Detection: A Hybrid Preprocessing Approach Utilizing CLAHE27 Aug 2026
- 2026Scale-Separated Conditioning for Style-Encoder-Free Diffusion Stylization20 Aug 2026
- 2026Unlocking the Potential of Image Editing via Concept Scaling and Dense Supervision17 Aug 2026
- 2026Depth-Dominant Skeleton Detection for Natural Scenes17 Aug 2026
- 2026Surg-UniWorld: A Unified Surgical World Model with Multimodal Control Experts7 Aug 2026
- 2026FlowForm: Synergizing Fluid Physics with Topological Consistency for Satellite Flood Synthesis4 Aug 2026
38 more
- 2026Investigating the Visual Cues of CNNs for Vascular Segmentation: A Case Study in Microscopy and Fundus Imaging25 Jul 2026
- 2026Fashion-3DLR: A Controllable 3D Garment Generation Using Pairwise Fashion Elements for Intelligent Design25 Jul 2026
- 2026An Integrated Deep Learning and Statistical Framework for Whole-Network Gene--Environment Association with Leaf Vascular Architecture23 Jul 2026
- 2026FSB-Net: Frequency-Spatial Boundary Network for Brain Stroke Lesion Segmentation in Non-Contrast CT23 Jul 2026
- 2026Multi-Conditioned Diffusion Synthesis of Sand Boils for Low-Resource Earthen-Levee Inspection8 Jul 2026
- 2026Optimized Instance Alteration for Explaining and Assessing Robustness of Classifiers7 Jul 2026
- 2026Streaming Neural Speech Codecs through Time-Invariant Representations6 Jul 2026
- 2026InstanceControl: Controllable Complex Image Generation without Instance Labeling30 Jun 2026
- 2026GeoEdit: Geometry-Aware Object Editing via Dual-Branch Denoising29 Jun 2026
- 2026FlowBender: Feedback-Aware Training for Self-Correcting Conditional Flows18 Jun 2026
- 2026Rate-optimal neural boundary detection from unlabeled noisy images30 May 2026
- 2026Rethinking Efficient Crack Segmentation with Task-Aligned Structural-Directional Modeling29 May 2026
- 2026Semi-LAR: Semi-supervised Contrastive Learning with Linear Attention for Removal of Nighttime Flares18 May 2026
- 2026AtteConDA: Attention-Based Conflict Suppression in Multi-Condition Diffusion Models and Synthetic Data Augmentation10 May 2026
- 2026LightAVSeg: Lightweight Audio-Visual Segmentation9 May 2026
- 2026Improved monocular depth prediction using distance transform over pre-semantic contours with self-supervised neural networks8 May 2026
- 2026Active Sampling for Ultra-Low-Bit-Rate Video Compression via Conditional Controlled Diffusion4 May 2026
- 2026Topology-Aware Skeleton Detection via Lighthouse-Guided Structured Inference22 Apr 2026
- 2026From Boundaries to Semantics: Prompt-Guided Multi-Task Learning for Petrographic Thin-section Segmentation16 Apr 2026
- 2026ViSAGE @ NTIRE 2026 Challenge on Video Saliency Prediction9 Apr 2026
- 2026StereoVGGT: A Training-Free Visual Geometry Transformer for Stereo Vision31 Mar 2026
- 2026Amped: Adaptive Multi-stage Non-edge Pruning for Edge Detection29 Mar 2026
- 2026LEMMA: Laplacian pyramids for Efficient Marine SeMAntic Segmentation26 Mar 2026
- 2026MEMO: Human-like Crisp Edge Detection Using Masked Edge Prediction21 Mar 2026
- 2026RSGen: Enhancing Layout-Driven Remote Sensing Image Generation with Diverse Edge Guidance16 Mar 2026
- 2026Enhancing Image Aesthetics with Dual-Conditioned Diffusion Models Guided by Multimodal Perception12 Mar 2026
- 2026Sketch It Out: Exploring Label-Free Structural Cues for Multimodal Gait Recognition4 Mar 2026
- 2026LEAR: Learning Edge-Aware Representations for Event-to-LiDAR Localization2 Mar 2026
- 2026MatchED: Crisp Edge Detection Using End-to-End, Matching-based Supervision24 Feb 2026
- 2026Contour Refinement using Discrete Diffusion in Low Data Regime5 Feb 2026
- 2026Rule-Based Spatial Mixture-of-Experts U-Net for Explainable Edge Detection4 Feb 2026
- 2026Fluxamba: Topology-Aware Anisotropic State Space Models for Geological Lineament Segmentation in Multi-Source Remote Sensing24 Jan 2026
- 2026LoD Sketch Extraction from Architectural Models Using Generative AI: Dataset Construction for Multi-Level Architectural Design Generation23 Jan 2026
- 2026Deep Sketch-Based 3D Modeling: A Survey22 Jan 2026
- 2026SPOT-Face: Forensic Face Identification using Attention Guided Optimal Transport14 Jan 2026
- 2026TokenSeg: Efficient 3D Medical Image Segmentation via Hierarchical Visual Token Compression8 Jan 2026
- 2026LION-DG: Layer-Informed Initialization with Deep Gradient Protocols for Accelerated Neural Network Training5 Jan 2026
- 2025Edge-Aware and Content-Adaptive Infrared Gas Leak Detection for Industrial Safety Monitoring29 Dec 2025
50 newest of 590 All 590 (JSON)
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
- 2023PixArt-α: Fast Training of Diffusion Transformer for Photorealistic Text-to-Image Synthesiscited by 854
- 2023Uni-ControlNet: All-in-One Control to Text-to-Image Diffusion Modelscited by 358
- 2023UniControl: A Unified Diffusion Model for Controllable Visual Generation In the Wildcited by 197
- 2021Conditional Image Generation with Score-Based Diffusion Modelscited by 195
- 2022Pretraining is All You Need for Image-to-Image Translationcited by 160
- 2023StyleDiffusion: Controllable Disentangled Style Transfer via Diffusion Modelscited by 154
- 2024ControlNet++: Improving Conditional Controls with Efficient Consistency Feedbackcited by 153
- 2023RAPHAEL: Text-to-Image Generation via Large Mixture of Diffusion Pathscited by 141
- 2023Patch Diffusion: Faster and More Data-Efficient Training of Diffusion Modelscited by 131
- 2024One-Step Image Translation with Text-to-Image Modelscited by 111
- 2023In-Context Learning Unlocked for Diffusion Modelscited by 103
12 most cited of 110 All 110 (JSON)
- 2026ReaDiT Guidance: Control for Image and Video Generation using Diffusion Transformer Features4 Sep 2026
- 2026Unlocking the Potential of Image Editing via Concept Scaling and Dense Supervision17 Aug 2026
- 2026Fashion-3DLR: A Controllable 3D Garment Generation Using Pairwise Fashion Elements for Intelligent Design25 Jul 2026
- 2026AtteConDA: Attention-Based Conflict Suppression in Multi-Condition Diffusion Models and Synthetic Data Augmentation10 May 2026
- 2026Active Sampling for Ultra-Low-Bit-Rate Video Compression via Conditional Controlled Diffusion4 May 2026
- 2026RSGen: Enhancing Layout-Driven Remote Sensing Image Generation with Diverse Edge Guidance16 Mar 2026
- 2026Enhancing Image Aesthetics with Dual-Conditioned Diffusion Models Guided by Multimodal Perception12 Mar 2026
- 2026Contour Refinement using Discrete Diffusion in Low Data Regime5 Feb 2026
- 2025MagicQuillV2: Precise and Interactive Image Editing with Layered Visual Cues2 Dec 2025
- 2025Show Me: Unifying Instructional Image and Video Generation with Diffusion Models21 Nov 2025
- 2025Generative AI in Depth: A Survey of Recent Advances, Model Variants, and Real-World Applications23 Oct 2025
- 2025SCEESR: Semantic-Control Edge Enhancement for Diffusion-Based Super-Resolution22 Oct 2025
12 newest of 110 All 110 (JSON)
- 2023CLIP-S4: Language-Guided Self-Supervised Semantic Segmentationcited by 34
- 2024Chat-Edit-3D: Interactive 3D Scene Editing via Text Promptscited by 19
- 2025Vision-Language Modeling Meets Remote Sensing: Models, Datasets and Perspectivescited by 18
- 2026Chat-Edit-3D++: Interactive 3D and 4D Scene Editing via Large Language Modelscited by 1
- 2025Generative AI for Industrial Contour Detection: A Language-Guided Vision Systemcited by 0
- 2026Chat-Edit-3D++: Interactive 3D and 4D Scene Editing via Large Language Models29 Aug 2026
- 2025Generative AI for Industrial Contour Detection: A Language-Guided Vision System29 Aug 2025
- 2025Vision-Language Modeling Meets Remote Sensing: Models, Datasets and Perspectives20 May 2025
- 2024Chat-Edit-3D: Interactive 3D Scene Editing via Text Prompts9 Jul 2024
- 2023CLIP-S4: Language-Guided Self-Supervised Semantic Segmentation1 May 2023
- 2023Visual ChatGPT: Talking, Drawing and Editing with Visual Foundation Modelscited by 659
- 2025Video models are zero-shot learners and reasonerscited by 208
- 2025EDMB: Edge Detector with Mambacited by 2
- 2025EDMB: Edge Detector with Mamba8 Jan 2025
- 2023Segment Anythingcited by 8,158
- 2023Fast Segment Anythingcited by 286
- 2021Unsupervised Semantic Segmentation by Contrasting Object Mask Proposalscited by 190
- 2021Visual Saliency Transformercited by 175
- 2021Pixel Difference Networks for Efficient Edge Detectioncited by 167
- 2022FILM: Frame Interpolation for Large Motioncited by 149
- 2023Make Pixels Dance: High-Dynamic Video Generationcited by 140
- 2021Salient Object Detection via Integrity Learningcited by 133
- 2021A Comprehensive Survey of Scene Graphs: Generation and Applicationcited by 125
- 2022Highly Accurate Dichotomous Image Segmentationcited by 110
- 2024GARField: Group Anything with Radiance Fieldscited by 108
- 2021Mutual Graph Learning for Camouflaged Object Detectioncited by 103
12 most cited of 469 All 469 (JSON)
- 2026DRHeC: Differentiable Rendering for Hand-Eye Calibration with RGB-Based Gradients29 Sep 2026
- 2026OmniVBench: A Benchmark and Large-Scale Dataset for Omni Reference-to-Video Generation18 Sep 2026
- 2026DERA: Detached Edge-Residual Adaptation for Prohibited item Detection11 Sep 2026
- 2026RealOOB: A Definition-Consistent Real-World Oriented Occlusion Boundary Benchmark31 Aug 2026
- 2026Enhancing MRI Brain Tumor Edge Detection: A Hybrid Preprocessing Approach Utilizing CLAHE27 Aug 2026
- 2026Scale-Separated Conditioning for Style-Encoder-Free Diffusion Stylization20 Aug 2026
- 2026Depth-Dominant Skeleton Detection for Natural Scenes17 Aug 2026
- 2026FlowForm: Synergizing Fluid Physics with Topological Consistency for Satellite Flood Synthesis4 Aug 2026
- 2026Investigating the Visual Cues of CNNs for Vascular Segmentation: A Case Study in Microscopy and Fundus Imaging25 Jul 2026
- 2026An Integrated Deep Learning and Statistical Framework for Whole-Network Gene--Environment Association with Leaf Vascular Architecture23 Jul 2026
- 2026FSB-Net: Frequency-Spatial Boundary Network for Brain Stroke Lesion Segmentation in Non-Contrast CT23 Jul 2026
- 2026Multi-Conditioned Diffusion Synthesis of Sand Boils for Low-Resource Earthen-Levee Inspection8 Jul 2026
12 newest of 469 All 469 (JSON)