Entropy-Aware Structural Alignment for Zero-Shot Handwritten Chinese Character Recognition
Not on the map. Why?
Abstract (arXiv)
Zero-shot Handwritten Chinese Character Recognition (HCCR) aims to recognize unseen characters by leveraging radical-based semantic compositions. However, existing approaches often treat characters as flat radical sequences, neglecting the hierarchical topology and the uneven information density of different components. To address these limitations, we propose an Entropy-Aware Structural Alignment Network that bridges the visual-semantic gap through information-theoretic modeling. First, we introduce an Information Entropy Prior to dynamically modulate positional embeddings via multiplicative interaction, acting as a saliency detector that prioritizes discriminative roots over ubiquitous components. Second, we construct a Dual-View Radical Tree to extract multi-granularity structural features, which are integrated via an adaptive Sigmoid-based gating network to encode both global layout and local spatial roles. Finally, a Top-K Semantic Feature Fusion mechanism is devised to augment the decoding process by utilizing the centroid of semantic neighbors, effectively rectifying visual ambiguities through feature-level consensus. Extensive experiments demonstrate that our method establishes new state-of-the-art performance, achieving an accuracy of 55.04% on the ICDAR 2013 dataset (m=1500), significantly outperforming existing CLIP-based baselines in the challenging zero-shot setting. Furthermore, the framework exhibits exceptional data efficiency, demonstrating rapid adaptability with minimal support samples, achieving 92.41% accuracy with only one support sample per class.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 26 of its 46 references that are in the map. First posted on arXiv 3 Feb 2026.
Builds on
26 of 46 references.
References · 26
- 2017Attention Is All You Needcited by 59,932
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
- 2016Densely Connected Convolutional Networkscited by 6,691
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,581
- 2021Align before Fuse: Vision and Language Representation Learning with Momentum Distillationcited by 1,612
- 2018Self-Attention with Relative Position Representationscited by 1,112
- 2015An End-to-End Trainable Neural Network for Image-based Sequence Recognition and Its Application to Scene Text Recognitioncited by 519
- 2018Stacked Cross Attention for Image-Text Matchingcited by 414
- 2015Improved Semantic Representations From Tree-Structured Long Short-Term Memory Networkscited by 305
14 more
- 2020Learn to Augment: Joint Data Augmentation and Network Optimization for Text Recognitioncited by 36
- 2024On-the-fly Modulation for Balanced Multimodal Learningcited by 32
- 2021Zero-Shot Chinese Character Recognition with Stroke-Level Decompositioncited by 26
- 2018DenseRAN for Offline Handwritten Chinese Character Recognitioncited by 24
- 2023Chinese Text Recognition with A Pre-Trained CLIP-Like Model Through Image-IDS Aligningcited by 24
- 2016Online and Offline Handwritten Chinese Character Recognition: A Comprehensive Study and New Benchmarkcited by 17
- 2017Building Fast and Compact Convolutional Neural Networks for Offline Handwritten Chinese Character Recognitioncited by 14
- 2022RZCR: Zero-shot Character Recognition via Radical-based Reasoningcited by 12
- 2022Chinese Character Recognition with Radical-Structured Stroke Treescited by 12
- 2015High Performance Offline Handwritten Chinese Character Recognition Using GoogLeNet and Directional Feature Mapscited by 10
- 2019Template-Instance Loss for Offline Handwritten Chinese Character Recognitioncited by 9
- 2024HierCode: A Lightweight Hierarchical Codebook for Zero-shot Chinese Text Recognitioncited by 6
- 2022STAR: Zero-Shot Chinese Character Recognition with Stroke- and Radical-Level Decompositionscited by 5
- 2024Improving Chinese Character Representation with Formation Treecited by 2
Built on by
Not cited yet.