Accurate Fine-grained Layout Analysis for the Historical Tibetan Document Based on the Instance Segmentation
Not on the map. Why?
Abstract (arXiv)
Accurate layout analysis without subsequent text-line segmentation remains an ongoing challenge, especially when facing the Kangyur, a kind of historical Tibetan document featuring considerable touching components and mottled background. Aiming at identifying different regions in document images, layout analysis is indispensable for subsequent procedures such as character recognition. However, there was only a little research being carried out to perform line-level layout analysis which failed to deal with the Kangyur. To obtain the optimal results, a fine-grained sub-line level layout analysis approach is presented. Firstly, we introduced an accelerated method to build the dataset which is dynamic and reliable. Secondly, enhancement had been made to the SOLOv2 according to the characteristics of the Kangyur. Then, we fed the enhanced SOLOv2 with the prepared annotation file during the training phase. Once the network is trained, instances of the text line, sentence, and titles can be segmented and identified during the inference stage. The experimental results show that the proposed method delivers a decent 72.7% average precision on our dataset. In general, this preliminary research provides insights into the fine-grained sub-line level layout analysis and testifies the SOLOv2-based approaches. We also believe that the proposed methods can be adopted on other language documents with various layouts.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 22 of its 42 references that are in the map. First posted on arXiv 15 Oct 2021.
Builds on
22 of 42 references.
References · 22
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2017Mask R-CNNcited by 7,277
- 2016Feature Pyramid Networks for Object Detectioncited by 5,036
- 2014Fully Convolutional Networks for Semantic Segmentationcited by 4,859
- 2016DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFscited by 3,241
- 2016Aggregated Residual Transformations for Deep Neural Networkscited by 2,546
- 2016V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentationcited by 2,292
- 2015Spatial Transformer Networkscited by 1,429
- 2019MMDetection: Open MMLab Detection Toolbox and Benchmarkcited by 1,385
- 2017Focal Loss for Dense Object Detectioncited by 752
- 2015An End-to-End Trainable Neural Network for Image-based Sequence Recognition and Its Application to Scene Text Recognitioncited by 520
10 more
- 2019YOLACT: Real-time Instance Segmentationcited by 443
- 2019PubLayNet: largest dataset ever for document layout analysiscited by 351
- 2016Dynamic Filter Networkscited by 319
- 2019SOLO: Segmenting Objects by Locationscited by 289
- 2019Mask Scoring R-CNNcited by 266
- 2019High-Resolution Representations for Labeling Pixels and Regionscited by 211
- 2019Mask TextSpotter: An End-to-End Trainable Neural Network for Spotting Text with Arbitrary Shapescited by 171
- 2017Learning to Extract Semantic Structure from Documents Using Multimodal Fully Convolutional Neural Networkcited by 92
- 2017Convolutional Neural Networks for Page Segmentation of Historical Document Imagescited by 12
- 2019Indiscapes: Instance Segmentation Networks for Layout Parsing of Historical Indic Manuscriptscited by 7
Built on by
Not cited yet.