# Indic Handwritten Script Identification using Offline-Online Multimodal Deep Network

arXiv: https://arxiv.org/abs/1802.08568 · HTML: https://mlsanity.com/paper/1802.08568/

## Key facts

- Cited by 5 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 23 Feb 2018.

## Built on by (most cited first, 5 of 5)

- [TRACE: A Differentiable Approach to Line-level Stroke Recovery for Offline Handwritten Text](https://mlsanity.com/paper/2105.11559/) (2021)
- [Automated Systems For Diagnosis of Dysgraphia in Children: A Survey and Novel Framework](https://mlsanity.com/paper/2206.13043/) (2022)
- [Optical Script Identification for multi-lingual Indic-script](https://mlsanity.com/paper/2308.05780/) (2023)
- [Multimodal Ensemble with Conditional Feature Fusion for Dysgraphia Diagnosis in Children from Handwriting Samples](https://mlsanity.com/paper/2408.13754/) (2024)
- [A Transformer Based Handwriting Recognition System Jointly Using Online and Offline Features](https://mlsanity.com/paper/2506.20255/) (2025)

## Abstract (arXiv)

In this paper, we propose a novel approach of word-level Indic script identification using only character-level data in training stage. The advantages of using character level data for training have been outlined in section I. Our method uses a multimodal deep network which takes both offline and online modality of the data as input in order to explore the information from both the modalities jointly for script identification task. We take handwritten data in either modality as input and the opposite modality is generated through intermodality conversion. Thereafter, we feed this offline-online modality pair to our network. Hence, along with the advantage of utilizing information from both the modalities, it can work as a single framework for both offline and online script identification simultaneously which alleviates the need for designing two separate script identification modules for individual modality. One more major contribution is that we propose a novel conditional multimodal fusion scheme to combine the information from offline and online modality which takes into account the real origin of the data being fed to our network and thus it combines adaptively. An exhaustive experiment has been done on a data set consisting of English and six Indic scripts. Our proposed framework clearly outperforms different frameworks based on traditional classifiers along with handcrafted features and deep learning based methods with a clear margin. Extensive experiments show that using only character level training data can achieve state-of-art performance similar to that obtained with traditional training using word level data in our framework.