A categorical error sensitivity index (ISEC): A preventive ordinal decision-support measure for irrecoverable errors in manual data entry systems
Not on the map. Why?
Abstract (arXiv)
Data entry systems remain structurally vulnerable to categorical misclassifications, particularly in small and medium sized enterprises (SMEs). When nominal categories exhibit semantic or morphological proximity, human machine interaction may produce errors that are irrecoverable ex post. In the absence of automated input controls, manual data entry frequently generates irrecoverable categorical distortions that propagate into Key Performance Indicators (KPIs), thereby misleading managerial decision making. State of the art normalization tools typically evaluate semantic and morphological dimensions in isolation and rely heavily on standard dictionaries, rendering them ineffective for SME master data rich in custom SKUs, abbreviations, and domain-specific technical jargon. This paper introduces the Categorical Error Sensitivity Index (ISEC), an ordinal composite score designed to rank category pairs according to their structural susceptibility to confusion. ISEC integrates semantic distance (via word embeddings), custom weighted morphological transformation costs (through an adapted Damerau Levenshtein algorithm), and empirical frequency into a unified, mathematically robust preventive framework. By leveraging vector database architectures, ISEC reduces computational complexity, achieving approximately a 195x performance improvement over brute-force methods. Validated across three heterogeneous datasets: governmental judicial records, retail inventory, and a synthetic ISO coded metalworking catalog, ISEC provides a scalable and proactive data governance instrument that enables SMEs to detect latent structural risk embedded within their categorical data assets.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 7 of its 25 references that are in the map. First posted on arXiv 12 May 2026.
Builds on
7 of 25 references.
References · 7
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
- 2016Efficient and robust approximate nearest neighbor search using Hierarchical Navigable Small World graphscited by 861
- 2018How Complex is your classification problem? A survey on measuring classification complexitycited by 66
- 2017MoNoise: Modeling Noise Using a Modular Normalization Systemcited by 8
- 2024A compendium and evaluation of taxonomy quality attributescited by 6
- 2020Augmenting Organizational Decision-Making with Deep Learning Algorithms: Principles, Promises, and Challengescited by 4
- 2023A general framework for implementing distances for categorical variablescited by 3
Built on by
Not cited yet.