mlsanityData to 14 Oct 2026

LiveSketch: Query Perturbations for Guided Sketch-based Visual Search

arXiv 1904.06611 ↗First posted 14 Apr 2019cs.CV cs.AI cs.IRcited by 34

Not on the map. Why?

Abstract (arXiv)

LiveSketch is a novel algorithm for searching large image collections using hand-sketched queries. LiveSketch tackles the inherent ambiguity of sketch search by creating visual suggestions that augment the query as it is drawn, making query specification an iterative rather than one-shot process that helps disambiguate users' search intent. Our technical contributions are: a triplet convnet architecture that incorporates an RNN based variational autoencoder to search for images using vector (stroke-based) queries; real-time clustering to identify likely search intents (and so, targets within the search embedding); and the use of backpropagation from those targets to perturb the input stroke sequence, so suggesting alterations to the query in order to guide the search. We show improvements in accuracy and time-to-task over contemporary baselines using a 67M image corpus.

Key facts. Cited by 34 papers in the map (data through 14 Oct 2026). First posted on arXiv 14 Apr 2019.

Builds on

No reference list yet.

Built on by

Cited by year

Citing papers per year: 2021: 5; 2022: 10; 2023: 6; 2024: 8; 2025: 5.

34 papers.

Sort:

By area:

  1. 2023CLIP for All Things Zero-Shot Sketch-Based Image Retrieval, Fine-Grained or Notcited by 79
  2. 2021StyleMeUp: Towards Style-Agnostic Sketch-Based Image Retrievalcited by 50
  3. 2021Vectorization and Rasterization: Self-Supervised Learning for Sketch and Handwritingcited by 38
  4. 2021More Photos are All You Need: Semi-Supervised Learning for Fine-Grained Sketch Based Image Retrievalcited by 38
  5. 2022Sketch3T: Test-Time Training for Zero-Shot SBIRcited by 34
  6. 2022SceneTrilogy: On Human Scene-Sketch and its Complementarity with Photo and Textcited by 30
  7. 2022A Sketch Is Worth a Thousand Words: Image Retrieval with Text and Sketchcited by 28
  8. 2022Sketching without Worrying: Noise-Tolerant Sketch-Based Image Retrievalcited by 27
  9. 2021Adversarial Open Domain Adaptation for Sketch-to-Photo Synthesiscited by 24
  10. 2022Doodle It Yourself: Class Incremental Learning by Drawing a Few Sketchescited by 23
  11. 2022Partially Does It: Towards Scene-Level FG-SBIR with Partial Inputcited by 20
  12. 2023What Can Human Sketches Do for Object Detection?cited by 19
22 more
  1. 2023Sketch2Saliency: Learning to Detect Salient Objects from Human Drawingscited by 17
  2. 2022Adaptive Fine-Grained Sketch-Based Image Retrievalcited by 15
  3. 2023Exploiting Unlabelled Photos for Stronger Fine-Grained SBIRcited by 14
  4. 2024SketchINR: A First Look into Sketches as Implicit Neural Representationscited by 13
  5. 2024You'll Never Walk Alone: A Sketch and Text Duet for Fine-Grained Image Retrievalcited by 12
  6. 2024How to Handle Sketch-Abstraction in Sketch-Based Image Retrieval?cited by 10
  7. 2024Text-to-Image Diffusion Models are Great Sketch-Photo Matchmakerscited by 8
  8. 2022Navigable Proximity Graph-Driven Native Hybrid Queries with Structured and Unstructured Constraintscited by 7
  9. 2023AniFaceDrawing: Anime Portrait Exploration during Your Sketchingcited by 7
  10. 2025Composite Sketch+Text Queries for Retrieving Objects with Elusive Names and Complex Interactionscited by 5
  11. 2024What Sketch Explainability Really Means for Downstream Taskscited by 4
  12. 2025SketchFusion: Learning Universal Sketch Features through Fusing Foundation Modelscited by 4
  13. 2021Deep Reinforced Attention Regression for Partial Sketch Based Image Retrievalcited by 3
  14. 2024Modality-Aware Representation Learning for Zero-shot Sketch-based Image Retrievalcited by 2
  15. 2024Do Generalised Classifiers really work on Human Drawn Sketches?cited by 2
  16. 2025Sketch Down the FLOPs: Towards Efficient Networks for Human Sketchcited by 2
  17. 2022Multi-granularity Association Learning Framework for on-the-fly Fine-Grained Sketch-based Image Retrievalcited by 1
  18. 2022Towards Practicality of Sketch-Based Visual Understandingcited by 1
  19. 2023Sketch-based Video Object Segmentation: Benchmark and Analysiscited by 1
  20. 2025SketchYourSeg: Mask-Free Subjective Image Segmentation via Freehand Sketchescited by 1
  21. 2024Dual-Modal Prompting for Sketch-Based Image Retrievalcited by 0
  22. 2025Doodle Your Keypoints: Sketch-Based Few-Shot Keypoint Detectioncited by 0