SignTrace: Describe a Sign, Find the Word
Not on the map. Why?
Abstract (arXiv)
Identifying an unfamiliar sign is difficult when a learner remembers its movement but does not know its meaning or formal feature codes. SignTrace addresses this longstanding reverse-lookup problem through natural-language access to a Chinese sign-language dictionary. The system integrates LLM-based dictionary enrichment, action extraction, dictionary-style rewriting, seven-channel retrieval, and candidate reranking over 6,699 entries. It has been deployed for user trials and has received positive informal feedback. Evaluation on a dictionary-derived benchmark of 500 movement-description queries yields 94.0% Hit@1, 97.4% Hit@9, and a mean reciprocal rank of 0.9540. Reranking increases Hit@1 from 71.8% to 94.0%, while component analyses show the contribution of enriched entry descriptions. Median query-processing time is 13.37 seconds with six concurrent queries. By connecting everyday movement descriptions to documented signs and meanings, SignTrace provides a practical tool for identifying unfamiliar signs. Dictionary-derived wording and prior selection within the benchmark limit generalization to descriptions independently produced by users.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 6 of its 19 references that are in the map. First posted on arXiv 13 Sep 2026.
Builds on
6 of 19 references.
References · 6
- 2023Is ChatGPT Good at Search? Investigating Large Language Models as Re-Ranking Agentscited by 360
- 2023Query2doc: Query Expansion with Large Language Modelscited by 149
- 2022An Analysis of Fusion Functions for Hybrid Retrievalcited by 51
- 2023Found in the Middle: Permutation Self-Consistency Improves Listwise Ranking in Large Language Modelscited by 31
- 2022Sign Language Video Retrieval with Free-Form Textual Queriescited by 23
- 2021Sign and Search: Sign Search Functionality for Sign Language Lexicacited by 1
Built on by
Not cited yet.