Designing Production-Scale OCR for India: Multilingual and Domain-Specific Systems
Not on the map. Why?
Abstract (arXiv)
Designing Optical Character Recognition (OCR) systems for India requires balancing linguistic diversity, document heterogeneity, and deployment constraints. In this paper, we study two training strategies for building multilingual OCR systems with Vision-Language Models through the Chitrapathak series. We first follow a popular multimodal approach, pairing a generic vision encoder with a strong multilingual language model and training the system end-to-end for OCR. Alternatively, we explore fine-tuning an existing OCR model, despite not being trained for the target languages. Through extensive evaluation on multilingual Indic OCR benchmarks and deployment-oriented metrics, we find that the second strategy consistently achieves better accuracy-latency trade-offs. Chitrapathak-2 achieves 3-6x speedup over its predecessor with being state-of-the-art (SOTA) in Telugu (6.69 char ANLS) and second best in the rest. In addition, we present Parichay, an independent OCR model series designed specifically for 9 Indian government documents to extract structured key fields, achieving 89.8% Exact Match score with a faster inference. Together, these systems achieve SOTA performance and provide practical guidance for building production-scale OCR pipelines in the Indian context.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 28 of its 46 references that are in the map. First posted on arXiv 18 Feb 2026.
Builds on
28 of 46 references.
References · 28
- 2017Attention Is All You Needcited by 59,932
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,767
- 2023Improved Baselines with Visual Instruction Tuningcited by 4,362
- 2019Parameter-Efficient Transfer Learning for NLPcited by 4,195
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
- 2019ZeRO: Memory Optimizations Toward Training Trillion Parameter Modelscited by 1,278
- 2015An End-to-End Trainable Neural Network for Image-based Sequence Recognition and Its Application to Scene Text Recognitioncited by 519
- 2021TrOCR: Transformer-based Optical Character Recognition with Pre-trained Modelscited by 278
- 2019Character Region Awareness for Text Detectioncited by 273
- 2023Nougat: Neural Optical Understanding for Academic Documentscited by 240
16 more
- 2024Rotary Position Embedding for Vision Transformercited by 226
- 2024OCRBench v2: An Improved Benchmark for Evaluating Large Multimodal Models on Visual Text Localization and Reasoningcited by 165
- 2025olmOCR: Unlocking Trillions of Tokens in PDFs with Vision Language Modelscited by 120
- 2016TextBoxes: A Fast Text Detector with a Single Deep Neural Networkcited by 119
- 2018TextBoxes++: A Single-Shot Oriented Scene Text Detectorcited by 119
- 2024OmniParser: A Unified Framework for Text Spotting, Key Information Extraction and Table Recognitioncited by 74
- 2022End-to-end Document Recognition and Understanding with Dessurtcited by 73
- 2018PixelLink: Detecting Scene Text via Instance Segmentationcited by 60
- 2016Scene Text Detection via Holistic, Multi-Channel Predictioncited by 11
- 2021Benchmarking Scene Text Recognition in Devanagari, Telugu and Malayalamcited by 11
- 2025Chitrarth: Bridging Vision and Language for a Billion Peoplecited by 10
- 2025Krutrim LLM: Multilingual Foundational Model for over a Billion Peoplecited by 9
- 2025IndicVisionBench: Benchmarking Cultural and Multilingual Understanding in VLMscited by 7
- 2022Transfer Learning for Scene Text Recognition in Indian Languagescited by 6
- 2025Chitranuvad: Adapting Multi-Lingual LLMs for Multimodal Translationcited by 6
- 2025Seeing Straight: Document Orientation Detection for Efficient OCRcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025E-ARMOR: Edge case Assessment and Review of Multilingual Optical Character Recognition
- 2026Chitrakshara: A Large Multilingual Multimodal Dataset for Indian languages
- 2025PsOCR: Benchmarking Large Multimodal Models for Optical Character Recognition in Low-resource Pashto Language
- 2026Multilingual OCR-Aware Fine-Tuning and Prompt-Guided Chain-of-Thought Reasoning for Multimodal Large Language Models
- 2026Can OCR-VLMs Read Devanagari? A Stress-Test Benchmark and Post-Correction Study
- 2025Context-Independent OCR with Multimodal LLMs: Effects of Image Resolution and Visual Complexity
- 2025Finetuning Vision-Language Models as OCR Systems for Low-Resource Languages: A Case Study of Manchu
- 2026GlotOCR Bench: OCR Models Still Struggle Beyond a Handful of Unicode Scripts