Line Segment Detection Using Transformers without Edges
Not on the map. Why?
Abstract (arXiv)
In this paper, we present a joint end-to-end line segment detection algorithm using Transformers that is post-processing and heuristics-guided intermediate processing (edge/junction/region detection) free. Our method, named LinE segment TRansformers (LETR), takes advantages of having integrated tokenized queries, a self-attention mechanism, and an encoding-decoding strategy within Transformers by skipping standard heuristic designs for the edge element detection and perceptual grouping processes. We equip Transformers with a multi-scale encoder/decoder strategy to perform fine-grained line segment detection under a direct endpoint distance loss. This loss term is particularly suitable for detecting geometric structures such as line segments that are not conveniently represented by the standard bounding box representations. The Transformers learn to gradually refine line segments through layers of self-attention. In our experiments, we show state-of-the-art results on Wireframe and YorkUrban benchmarks.
Key facts. Cited by 73 papers in the map (data through 14 Oct 2026). Builds on 17 of its 38 references that are in the map. First posted on arXiv 6 Jan 2021.
Builds on
17 of 38 references.
References · 17
- 2017Attention Is All You Needcited by 60,361
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,639
- 2020End-to-End Object Detection with Transformerscited by 7,414
- 2014Fully Convolutional Networks for Semantic Segmentationcited by 4,859
- 2017Non-local Neural Networkscited by 2,293
- 2018Dual Attention Network for Scene Segmentationcited by 1,003
- 2018Self-Attention Generative Adversarial Networkscited by 809
- 2015Holistically-Nested Edge Detectioncited by 592
- 2014Deeply-Supervised Netscited by 367
5 more
- 2019End-to-End Wireframe Parsingcited by 72
- 2020Learning to Parse Wireframes in Images of Man-Made Environmentscited by 71
- 2020Holistically-Attracted Wireframe Parsingcited by 64
- 2018Learning Attraction Field Representation for Robust Line Segment Detectioncited by 52
- 2019PPGNet: Learning Point-Pair Graph for Line Segment Detectioncited by 39
Built on by
Citing papers per year: 2021: 12; 2022: 15; 2023: 12; 2024: 17; 2025: 9; 2026: 8.
73 papers.
Sort:
By area:
- 2021Conditional DETR for Fast Training Convergencecited by 424
- 2022VectorMapNet: End-to-end Vectorized HD Map Learningcited by 245
- 2022DETRs with Hybrid Matchingcited by 150
- 2022Text Spotting Transformerscited by 70
- 2023GlueStick: Robust Image Matching by Sticking Points and Lines Togethercited by 66
- 2022DeepLSD: Line Segment Detection and Refinement with Deep Image Gradientscited by 60
- 2024CRS-Diff: Controllable Remote Sensing Image Generation with Diffusion Modelcited by 55
- 2022Connecting the Dots: Floorplan Reconstruction Using Two-Level Queriescited by 49
- 2021TriTransNet: RGB-D Salient Object Detection with a Triplet Transformer Embedding Networkcited by 45
- 20233D Line Mapping Revisitedcited by 39
- 2023PolyDiffuse: Polygonal Shape Reconstruction via Guided Set Diffusion Modelscited by 38
- 2021Towards Light-weight and Real-time Line Segment Detectioncited by 33
38 more
- 2021PlaneTR: Structure-Guided Transformers for 3D Plane Recoverycited by 33
- 2021CTRL-C: Camera calibration TRansformer with Line-Classificationcited by 33
- 2021Visual Relationship Detection Using Part-and-Sum Transformers with Composite Queriescited by 31
- 2021HEAT: Holistic Edge Attention Transformer for Structured Reconstructioncited by 29
- 2022RNGDet: Road Network Graph Detection by Transformer in Aerial Imagescited by 26
- 2022Glass Segmentation with RGB-Thermal Image Pairscited by 26
- 2022Holistically-Attracted Wireframe Parsing: From Supervised to Self-Supervised Learningcited by 26
- 2022Laneformer: Object-aware Row-Column Transformers for Lane Detectioncited by 25
- 2021Fully Convolutional Line Parsingcited by 24
- 2022RNGDet++: Road Network Graph Detection by Transformer with Instance Segmentation and Multi-scale Features Enhancementcited by 24
- 2021ELSED: Enhanced Line SEgment Drawingcited by 23
- 2024HSIGene: A Foundation Model For Hyperspectral Image Generationcited by 22
- 2021ELSD: Efficient Line Segment Detector and Descriptorcited by 18
- 2025Vision-Language Modeling Meets Remote Sensing: Models, Datasets and Perspectivescited by 18
- 2023ScalableMap: Scalable Map Learning for Online Long-Range Vectorized HD Map Constructioncited by 16
- 2021Pose Refinement with Joint Optimization of Visual Points and Linescited by 14
- 2022HoW-3D: Holistic 3D Wireframe Perception from a Single Imagecited by 12
- 2024EdgeGaussians -- 3D Edge Mapping via Gaussian Splattingcited by 10
- 2022Learning to Construct 3D Building Wireframes from 3D Line Cloudscited by 9
- 2024PolyRoom: Room-aware Transformer for Floorplan Reconstructioncited by 9
- 2022Detecting Line Segments in Motion-blurred Images with Eventscited by 6
- 2023A Comprehensive Review of Image Line Segment Detection and Description: Taxonomies, Comparisons, and Challengescited by 6
- 2024FRI-Net: Floorplan Reconstruction via Room-wise Implicit Representationcited by 6
- 2024RoIPoly: Vectorized Building Outline Extraction Using Vertex and Logit Embeddingscited by 6
- 2024DT-LSD: Deformable Transformer-based Line Segment Detectioncited by 6
- 2021Hole-robust Wireframe Detectioncited by 5
- 2024P2PFormer: A Primitive-to-polygon Method for Regular Building Contour Extraction from Remote Sensing Imagescited by 5
- 2025ScaleLSD: Scalable Deep Line Segment Detection Streamlinedcited by 5
- 2024SOFI: Multi-Scale Deformable Transformer for Camera Calibration with Enhanced Line Queriescited by 3
- 2025LINEA: Fast and Accurate Line Detection Using Scalable Transformerscited by 3
- 2023Parsing Line Segments of Floor Plan Images Using Graph Neural Networkscited by 2
- 2024Historical Astronomical Diagrams Decomposition in Geometric Primitivescited by 2
- 2024Synthesizing Realistic Data for Table Recognitioncited by 2
- 2025TextMamba: Scene Text Detector with Mambacited by 2
- 2023EVOLIN Benchmark: Evaluation of Line Detection and Associationcited by 1
- 2023Structure Diagram Recognition in Financial Announcementscited by 1
- 2024MeasureNet: Measurement Based Celiac Disease Identificationcited by 1
- 2025Improving Transformer Based Line Segment Detection with Matched Predicting and Re-rankingcited by 1
50 most cited of 73 All 73 (JSON)
- 2026SweepLSD: A One-Pass, O(width)-Memory Line Segment Detector with an Integer-Only Streaming Core and a Real-Time FPGA Realization22 Aug 2026
- 2026Unified and Efficient Point-Line Local Features20 Aug 2026
- 2026NPLSD: Accelerating Line-Segment Detection on NPU Microcontrollers12 Aug 2026
- 2026PaCoNet: Deep Data Extraction for Parallel Coordinates6 Aug 2026
- 2026MiLSD: A Micro Line-Segment Detector for Resource-Constrained Devices7 Jul 2026
- 2026Generalizable Multiscale Segmentation of Heterogeneous Map Collections5 Mar 2026
- 2026Co-PLNet: A Collaborative Point-Line Network for Prompt-Guided Wireframe Parsing26 Jan 2026
- 2026Detecting 3D Line Segments for 6DoF Pose Estimation with Limited Data17 Jan 2026
- 2025TextMamba: Scene Text Detector with Mamba7 Dec 2025
- 2025Autonomous labeling of surgical resection margins using a foundation model27 Nov 2025
- 2025UniVector: Unified Vector Extraction via Instance-Geometry Interaction15 Oct 2025
- 2025Adaptive Dual-Constrained Line Aggregation for Cross-Paradigm Line Segment Detection27 Aug 2025
38 more
- 2025DeH4R: A Decoupled and Hybrid Method for Road Network Graph Extraction19 Aug 2025
- 2025ScaleLSD: Scalable Deep Line Segment Detection Streamlined11 Jun 2025
- 2025LINEA: Fast and Accurate Line Detection Using Scalable Transformers22 May 2025
- 2025Vision-Language Modeling Meets Remote Sensing: Models, Datasets and Perspectives20 May 2025
- 2025Improving Transformer Based Line Segment Detection with Matched Predicting and Re-ranking25 Feb 2025
- 2024MeasureNet: Measurement Based Celiac Disease Identification2 Dec 2024
- 2024DT-LSD: Deformable Transformer-based Line Segment Detection20 Nov 2024
- 2024The Impact of Semi-Supervised Learning on Line Segment Detection7 Nov 2024
- 2024SOFI: Multi-Scale Deformable Transformer for Camera Calibration with Enhanced Line Queries23 Sep 2024
- 2024EdgeGaussians -- 3D Edge Mapping via Gaussian Splatting19 Sep 2024
- 2024HSIGene: A Foundation Model For Hyperspectral Image Generation19 Sep 2024
- 2024Robust Curve Detection in Volumetric Medical Imaging via Attraction Field2 Aug 2024
- 2024Leaf Angle Estimation using Mask R-CNN and LETR Vision Transformer1 Aug 2024
- 2024RoIPoly: Vectorized Building Outline Extraction Using Vertex and Logit Embeddings20 Jul 2024
- 2024FRI-Net: Floorplan Reconstruction via Room-wise Implicit Representation15 Jul 2024
- 2024PolyRoom: Room-aware Transformer for Floorplan Reconstruction15 Jul 2024
- 2024P2PFormer: A Primitive-to-polygon Method for Regular Building Contour Extraction from Remote Sensing Images5 Jun 2024
- 2024Synthesizing Realistic Data for Table Recognition17 Apr 2024
- 2024Linear Anchored Gaussian Mixture Model for Location and Width Computations of Objects in Thick Line Shape3 Apr 2024
- 2024Staircase Localization for Autonomous Exploration in Urban Environments26 Mar 2024
- 2024CRS-Diff: Controllable Remote Sensing Image Generation with Diffusion Model18 Mar 2024
- 2024Historical Astronomical Diagrams Decomposition in Geometric Primitives13 Mar 2024
- 2023A-Scan2BIM: Assistive Scan to Building Information Modeling30 Nov 2023
- 2023ScalableMap: Scalable Map Learning for Online Long-Range Vectorized HD Map Construction20 Oct 2023
- 2023Holistic Geometric Feature Learning for Structured Reconstruction18 Sep 2023
- 2023PolyDiffuse: Polygonal Shape Reconstruction via Guided Set Diffusion Models2 Jun 2023
- 2023Linear Object Detection in Document Images using Multiple Object Tracking26 May 2023
- 2023A Comprehensive Review of Image Line Segment Detection and Description: Taxonomies, Comparisons, and Challenges29 Apr 2023
- 2023Structure Diagram Recognition in Financial Announcements26 Apr 2023
- 2023CornerFormer: Boosting Corner Representation for Fine-Grained Structured Reconstruction14 Apr 2023
- 2023GlueStick: Robust Image Matching by Sticking Points and Lines Together4 Apr 2023
- 20233D Line Mapping Revisited30 Mar 2023
- 2023EVOLIN Benchmark: Evaluation of Line Detection and Association9 Mar 2023
- 2023Parsing Line Segments of Floor Plan Images Using Graph Neural Networks7 Mar 2023
- 2022DeepLSD: Line Segment Detection and Refinement with Deep Image Gradients15 Dec 2022
- 2022Framework for 2D Ad placements in LinearTV5 Dec 2022
- 2022Robust and Accurate Cylinder Triangulation5 Dec 2022
- 2022Connecting the Dots: Floorplan Reconstruction Using Two-Level Queries28 Nov 2022
50 newest of 73 All 73 (JSON)
- 2025TextMamba: Scene Text Detector with Mambacited by 2
- 2025TextMamba: Scene Text Detector with Mamba7 Dec 2025
- 2021Conditional DETR for Fast Training Convergencecited by 424
- 2022VectorMapNet: End-to-end Vectorized HD Map Learningcited by 245
- 2022DETRs with Hybrid Matchingcited by 150
- 2022Text Spotting Transformerscited by 70
- 2023GlueStick: Robust Image Matching by Sticking Points and Lines Togethercited by 66
- 2022DeepLSD: Line Segment Detection and Refinement with Deep Image Gradientscited by 60
- 2022Connecting the Dots: Floorplan Reconstruction Using Two-Level Queriescited by 49
- 2021TriTransNet: RGB-D Salient Object Detection with a Triplet Transformer Embedding Networkcited by 45
- 20233D Line Mapping Revisitedcited by 39
- 2021Towards Light-weight and Real-time Line Segment Detectioncited by 33
- 2021PlaneTR: Structure-Guided Transformers for 3D Plane Recoverycited by 33
- 2021CTRL-C: Camera calibration TRansformer with Line-Classificationcited by 33
12 most cited of 68 All 68 (JSON)
- 2026SweepLSD: A One-Pass, O(width)-Memory Line Segment Detector with an Integer-Only Streaming Core and a Real-Time FPGA Realization22 Aug 2026
- 2026Unified and Efficient Point-Line Local Features20 Aug 2026
- 2026NPLSD: Accelerating Line-Segment Detection on NPU Microcontrollers12 Aug 2026
- 2026PaCoNet: Deep Data Extraction for Parallel Coordinates6 Aug 2026
- 2026MiLSD: A Micro Line-Segment Detector for Resource-Constrained Devices7 Jul 2026
- 2026Generalizable Multiscale Segmentation of Heterogeneous Map Collections5 Mar 2026
- 2026Co-PLNet: A Collaborative Point-Line Network for Prompt-Guided Wireframe Parsing26 Jan 2026
- 2026Detecting 3D Line Segments for 6DoF Pose Estimation with Limited Data17 Jan 2026
- 2025Autonomous labeling of surgical resection margins using a foundation model27 Nov 2025
- 2025UniVector: Unified Vector Extraction via Instance-Geometry Interaction15 Oct 2025
- 2025Adaptive Dual-Constrained Line Aggregation for Cross-Paradigm Line Segment Detection27 Aug 2025
- 2025DeH4R: A Decoupled and Hybrid Method for Road Network Graph Extraction19 Aug 2025
12 newest of 68 All 68 (JSON)