mlsanityData to 7 Oct 2026

Sketchformer: Transformer-based Representation for Sketched Structure

arXiv 2002.10381 ↗First posted 24 Feb 2020cs.CVcited by 78

Not on the map. Why?

Abstract (arXiv)

Sketchformer is a novel transformer-based representation for encoding free-hand sketches input in a vector form, i.e. as a sequence of strokes. Sketchformer effectively addresses multiple tasks: sketch classification, sketch based image retrieval (SBIR), and the reconstruction and interpolation of sketches. We report several variants exploring continuous and tokenized input representations, and contrast their performance. Our learned embedding, driven by a dictionary learning tokenization scheme, yields state of the art performance in classification and image retrieval tasks, when compared against baseline representations driven by LSTM sequence to sequence architectures: SketchRNN and derivatives. We show that sketch reconstruction and interpolation are improved significantly by the Sketchformer embedding for complex sketches with longer stroke sequences.

Key facts. Cited by 78 papers in the map (data through 7 Oct 2026). First posted on arXiv 24 Feb 2020.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 13; 2022: 15; 2023: 21; 2024: 13; 2025: 10; 2026: 6.

78 papers.

Sort:

By area:

  1. 2021Im2Vec: Synthesizing Vector Graphics without Vector Supervisioncited by 114
  2. 2022Towards Layer-wise Image Vectorizationcited by 77
  3. 2022CLIPasso: Semantically-Aware Object Sketchingcited by 57
  4. 2023Breathing Life Into Sketches Using Text-to-Video Priorscited by 47
  5. 2021Vectorization and Rasterization: Self-Supervised Learning for Sketch and Handwritingcited by 38
  6. 2021More Photos are All You Need: Semi-Supervised Learning for Fine-Grained Sketch Based Image Retrievalcited by 38
  7. 2021Sketch Your Own GANcited by 37
  8. 2024Chat2SVG: Vector Graphics Generation with Large Language Models and Image Diffusion Modelscited by 36
  9. 2023Disentangling Writer and Character Styles for Handwriting Generationcited by 35
  10. 2024Text-to-Vector Generation with Neural Path Representationcited by 32
  11. 2024SketchAgent: Language-Driven Sequential Sketch Generationcited by 30
  12. 2022Sketching without Worrying: Noise-Tolerant Sketch-Based Image Retrievalcited by 27
38 more
  1. 2022Doodle It Yourself: Class Incremental Learning by Drawing a Few Sketchescited by 23
  2. 2023VecFusion: Vector Font Generation with Diffusioncited by 20
  3. 2023What Can Human Sketches Do for Object Detection?cited by 19
  4. 2021DoodleFormer: Creative Sketch Drawing with Transformerscited by 17
  5. 2023Sketch2Saliency: Learning to Detect Salient Objects from Human Drawingscited by 17
  6. 2021Cloud2Curve: Generation and Vectorization of Parametric Sketchescited by 16
  7. 2022Adaptive Fine-Grained Sketch-Based Image Retrievalcited by 15
  8. 2022CoGS: Controllable Generation and Search from Sketch and Stylecited by 14
  9. 2022Abstracting Sketches through Simple Primitivescited by 14
  10. 2023Exploiting Unlabelled Photos for Stronger Fine-Grained SBIRcited by 14
  11. 2023ChiroDiff: Modelling chirographic data with Diffusion Modelscited by 14
  12. 2023SEVA: Leveraging sketches to evaluate alignment between human and machine visual abstractioncited by 14
  13. 2025SwiftSketch: A Diffusion Model for Image-to-Vector Sketch Generationcited by 14
  14. 2024SketchINR: A First Look into Sketches as Implicit Neural Representationscited by 13
  15. 2023SketchXAI: A First Look at Explainability for Human Sketchescited by 10
  16. 2023SketchDreamer: Interactive Text-Augmented Creative Sketch Ideationcited by 10
  17. 2025Multi-Object Sketch Animation with Grouping and Motion Trajectory Priorscited by 9
  18. 2024Text-to-Image Diffusion Models are Great Sketch-Photo Matchmakerscited by 8
  19. 2024Freehand Sketch Generation from Mechanical Componentscited by 8
  20. 2022Content-Based Search for Deep Generative Modelscited by 7
  21. 2024Representing Online Handwriting for Recognition in Large Vision-Language Modelscited by 7
  22. 2021Sketch-QNet: A Quadruplet ConvNet for Color Sketch-based Image Retrievalcited by 5
  23. 2023Learning Geometry-aware Representations by Sketchingcited by 5
  24. 2023Text-Guided Vector Graphics Customizationcited by 5
  25. 2024SketchGPT: Autoregressive Modeling for Sketch Generation and Recognitioncited by 5
  26. 2025Composite Sketch+Text Queries for Retrieving Objects with Elusive Names and Complex Interactionscited by 5
  27. 2022Linking Sketch Patches by Learning Synonymous Proximity for Graphic Sketch Representationcited by 4
  28. 2025SketchFusion: Learning Universal Sketch Features through Fusing Foundation Modelscited by 4
  29. 2021Scene Designer: a Unified Model for Scene Search and Synthesis from Sketchcited by 3
  30. 2021ACNet: Approaching-and-Centralizing Network for Zero-Shot Sketch-Based Image Retrievalcited by 3
  31. 2022Abstract Images Have Different Levels of Retrievability Per Reverse Image Search Enginecited by 3
  32. 2023Query-guided Attention in Vision Transformers for Localizing Objects Using a Single Sketchcited by 3
  33. 2021MARVEL: Raster Manga Vectorization via Primitive-wise Deep Reinforcement Learningcited by 2
  34. 2022Transformers and CNNs both Beat Humans on SBIRcited by 2
  35. 2023Sketch Beautification: Learning Part Beautification and Structure Refinement for Sketches of Man-made Objectscited by 2
  36. 2023Painter: Teaching Auto-regressive Language Models to Draw Sketchescited by 2
  37. 2023DSS: Synthesizing long Digital Ink using Data augmentation, Style encoding and Split generationcited by 2
  38. 2024Equipping Sketch Patches with Context-Aware Positional Encoding for Graphic Sketch Representationcited by 2

50 most cited of 78 All 78 (JSON)