Beyond ICD Codes: Semantic IDs for Generative Medical Coding
Not on the map. Why?
Abstract (arXiv)
Generative approaches to automatic International Classification of Diseases (ICD) coding use large language models (LLMs) to predict ICD codes from clinical documents. However, original ICD code strings are not ideal generation targets because the ICD hierarchy does not always reflect clinical relationships, and LLMs struggle to interpret and generate these codes. We introduce SemICD, a framework that trains LLMs to generate Semantic IDs (SIDs) instead. SemICD constructs SIDs by hierarchically clustering embeddings of textual code profiles, allowing semantically related codes to share prefixes while each complete SID uniquely identifies one ICD code. To align the SID tokens with clinical semantics, we employ two auxiliary tasks for bidirectional generation between textual code profiles and SIDs. Experiments on MIMIC-III and MIMIC-IV with four LLMs show that SemICD outperforms direct code generation, improving Micro-F1 by 1.34-8.00 points. Our code is available at https://github.com/youwillbethebest/SemICD.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 19 of its 35 references that are in the map. First posted on arXiv 13 Oct 2026.
Builds on
19 of 35 references.
References · 19
- 2025Qwen3 Technical Reportcited by 8,820
- 2025Qwen3 Embedding: Advancing Text Embedding and Reranking Through Foundation Modelscited by 1,261
- 2022Autoregressive Image Generation using Residual Quantizationcited by 722
- 2018Explainable Prediction of Medical Codes from Clinical Textcited by 234
- 2023Adapting Large Language Models by Integrating Collaborative Semantics for Recommendationcited by 179
- 2023Automated Medical Coding on MIMIC-III and MIMIC-IV: A Critical Review and Replicability Studycited by 49
- 2020A Label Attention Model for ICD Coding from Clinical Textcited by 48
- 2024QARM: Quantitative Alignment Multi-Modal Recommendation at Kuaishoucited by 28
- 2020Multi-label Few/Zero-shot Learning with Knowledge Aggregated from Multiple Label Graphscited by 19
- 2024CoRelation: Boosting Automatic ICD Coding Through Contextualized Code Relation Learningcited by 18
- 2022Multi-label Few-shot ICD Coding as Autoregressive Generation with Promptcited by 17
- 2024Can GPT-3.5 Generate and Code Discharge Summaries?cited by 13
7 more
- 2024MedCodER: A Generative AI Assistant for Medical Codingcited by 11
- 2025Code Like Humans: A Multi-Agent Solution for Medical Codingcited by 11
- 2023A Two-Stage Decoder for Efficient ICD Codingcited by 9
- 2025Memorize and Rank: Elevating Large Language Models for Clinical Diagnosis Predictioncited by 8
- 2025Toward Reliable Clinical Coding with Language Models: Verification and Lightweight Adaptationcited by 5
- 2026Can Post-Training Turn LLMs into Good Medical Coders? An Empirical Study of Generative ICD Codingcited by 1
- 2026KREL: Automatic Medical Coding via Knowledge-Guided Reasoning over Clinical Evidence with LLMscited by 1
Built on by
Not cited yet.