# Learning Deep Structured Multi-Scale Features using Attention-Gated CRFs for Contour Prediction

arXiv: https://arxiv.org/abs/1801.00524 · HTML: https://mlsanity.com/paper/1801.00524/

## Key facts

- Cited by 30 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 1 Jan 2018.

## Built on by (most cited first, 30 of 30)

- [Pixel Difference Networks for Efficient Edge Detection](https://mlsanity.com/paper/2108.07009/) (2021)
- [Attention, please! A survey of Neural Attention Models in Deep Learning](https://mlsanity.com/paper/2103.16775/) (2021)
- [EDTER: Edge Detection with Transformer](https://mlsanity.com/paper/2203.08566/) (2022)
- [RINDNet: Edge Detection for Discontinuity in Reflectance, Illumination, Normal and Depth](https://mlsanity.com/paper/2108.00616/) (2021)
- [SketchEdit: Mask-Free Local Image Manipulation with Partial Sketches](https://mlsanity.com/paper/2111.15078/) (2021)
- [DiffusionEdge: Diffusion Probabilistic Model for Crisp Edge Detection](https://mlsanity.com/paper/2401.02032/) (2024)
- [The Treasure Beneath Multiple Annotations: An Uncertainty-aware Edge Detector](https://mlsanity.com/paper/2303.11828/) (2023)
- [RankED: Addressing Imbalance and Uncertainty in Edge Detection Using Ranking-based Losses](https://mlsanity.com/paper/2403.01795/) (2024)
- [Lightweight Pixel Difference Networks for Efficient Visual Representation Learning](https://mlsanity.com/paper/2402.00422/) (2024)
- [Continual Attentive Fusion for Incremental Learning in Semantic Segmentation](https://mlsanity.com/paper/2202.00432/) (2022)
- [Practical Edge Detection via Robust Collaborative Learning](https://mlsanity.com/paper/2308.14084/) (2023)
- [Probabilistic Graph Attention Network with Conditional Kernels for Pixel-Wise Prediction](https://mlsanity.com/paper/2101.02843/) (2021)
- [Learning Crisp Boundaries Using Deep Refinement Network and Adaptive Weighting Loss](https://mlsanity.com/paper/2102.01301/) (2021)
- [Learning Deep Morphological Networks with Neural Architecture Search](https://mlsanity.com/paper/2106.07714/) (2021)
- [EdgeNAT: Transformer for Efficient Edge Detection](https://mlsanity.com/paper/2408.10527/) (2024)
- [Generative Edge Detection with Stable Diffusion](https://mlsanity.com/paper/2410.03080/) (2024)
- [Variational Structured Attention Networks for Deep Visual Representation Learning](https://mlsanity.com/paper/2103.03510/) (2021)
- [Zero-Shot Edge Detection with SCESAME: Spectral Clustering-based Ensemble for Segment Anything Model Estimation](https://mlsanity.com/paper/2308.13779/) (2023)
- [EDMB: Edge Detector with Mamba](https://mlsanity.com/paper/2501.04846/) (2025)
- [Dunhuang murals contour generation network based on convolution and self-attention fusion](https://mlsanity.com/paper/2212.00935/) (2022)
- [A new baseline for edge detection: Make Encoder-Decoder great again](https://mlsanity.com/paper/2409.14976/) (2024)
- [Multi-Scale Tensorial Summation and Dimensional Reduction Guided Neural Network for Edge Detection](https://mlsanity.com/paper/2504.15770/) (2025)
- [HR-RCNN: Hierarchical Relational Reasoning for Object Detection](https://mlsanity.com/paper/2110.13892/) (2021)
- [An Adaptive Threshold for the Canny Edge Detection with Actor-Critic Algorithm](https://mlsanity.com/paper/2209.08699/) (2022)
- [Dynamic Graph Message Passing Networks for Visual Recognition](https://mlsanity.com/paper/2209.09760/) (2022)
- [ECT: Fine-grained Edge Detection with Learned Cause Tokens](https://mlsanity.com/paper/2308.03092/) (2023)
- [UHNet: An Ultra-Lightweight and High-Speed Edge Detection Network](https://mlsanity.com/paper/2408.04258/) (2024)
- [Training-free Quantum-Inspired Image Edge Extraction Method](https://mlsanity.com/paper/2501.18929/) (2025)
- [PEdger++: Practical Edge Detection via Assembling Cross Information](https://mlsanity.com/paper/2508.11961/) (2025)
- [Amped: Adaptive Multi-stage Non-edge Pruning for Edge Detection](https://mlsanity.com/paper/2603.27661/) (2026)

## Abstract (arXiv)

Recent works have shown that exploiting multi-scale representations deeply learned via convolutional neural networks (CNN) is of tremendous importance for accurate contour detection. This paper presents a novel approach for predicting contours which advances the state of the art in two fundamental aspects, i.e. multi-scale feature generation and fusion. Different from previous works directly consider- ing multi-scale feature maps obtained from the inner layers of a primary CNN architecture, we introduce a hierarchical deep model which produces more rich and complementary representations. Furthermore, to refine and robustly fuse the representations learned at different scales, the novel Attention-Gated Conditional Random Fields (AG-CRFs) are proposed. The experiments ran on two publicly available datasets (BSDS500 and NYUDv2) demonstrate the effectiveness of the latent AG-CRF model and of the overall hierarchical framework.
