Rethinking Genomic Modeling Through Optical Character Recognition
Not on the map. Why?
Abstract (arXiv)
Recent genomic foundation models largely adopt large language model architectures that treat DNA as a one-dimensional token sequence. However, exhaustive sequential reading is structurally misaligned with sparse and discontinuous genomic semantics, leading to wasted computation on low-information background and preventing understanding-driven compression for long contexts. Here, we present OpticalDNA, a vision-based framework that reframes genomic modeling as Optical Character Recognition (OCR)-style document understanding. OpticalDNA renders DNA into structured visual layouts and trains an OCR-capable vision--language model with a visual DNA encoder and a document decoder, where the encoder produces compact, reconstructible visual tokens for high-fidelity compression. Building on this representation, OpticalDNA defines prompt-conditioned objectives over core genomic primitives-reading, region grounding, subsequence retrieval, and masked span completion-thereby learning layout-aware DNA representations that retain fine-grained genomic information under a reduced effective token budget. Across diverse genomic benchmarks, OpticalDNA consistently outperforms recent baselines; on sequences up to 450k bases, it achieves the best overall performance with nearly 20× fewer effective tokens, and surpasses models with up to 985× more activated parameters while tuning only 256k trainable parameters.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 20 of its 52 references that are in the map. First posted on arXiv 2 Feb 2026.
Builds on
20 of 52 references.
References · 20
- 2017Attention Is All You Needcited by 59,932
- 2020Big Bird: Transformers for Longer Sequencescited by 1,673
- 2024DeepSeek-V2: A Strong, Economical, and Efficient Mixture-of-Experts Language Modelcited by 1,093
- 2019LayoutLM: Pre-training of Text and Layout for Document Image Understandingcited by 549
- 2022LayoutLMv3: Pre-training for Document AI with Unified Text and Image Maskingcited by 481
- 2021OCR-free Document Understanding Transformercited by 400
- 2022Pix2Struct: Screenshot Parsing as Pretraining for Visual Language Understandingcited by 360
- 2023Nougat: Neural Optical Understanding for Academic Documentscited by 240
- 2023HyenaDNA: Long-Range Genomic Sequence Modeling at Single Nucleotide Resolutioncited by 187
- 2025DeepSeek-OCR: Contexts Optical Compressioncited by 174
- 2023MEGABYTE: Predicting Million-byte Sequences with Multiscale Transformerscited by 164
- 2023DNABERT-2: Efficient Foundation Model and Benchmark For Multi-Species Genomecited by 139
8 more
- 2024Caduceus: Bi-Directional Equivariant Long-Range DNA Sequence Modelingcited by 108
- 2024LayoutLLM: Layout Instruction Tuning with Large Language Models for Document Understandingcited by 94
- 2025Dolphin: Document Image Parsing via Heterogeneous Anchor Promptingcited by 78
- 2025Glyph: Scaling Context Windows via Visual-Text Compressioncited by 49
- 2023BEND: Benchmarking DNA Language Models on biologically meaningful taskscited by 27
- 2025GENERator: A Long-Context Generative Genomic Foundation Modelcited by 20
- 2025HunyuanOCR Technical Reportcited by 18
- 2025JanusDNA: A Powerful Bi-directional Hybrid DNA Foundation Modelcited by 4
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Near-Lossless Model Compression Enables Longer Context Inference in DNA Large Language Models
- 2025MergeDNA: Context-aware Genome Modeling with Dynamic Tokenization through Token Merging
- 2025DianJin-OCR-R1: Enhancing OCR Capabilities via a Reasoning-and-Tool Interleaved Vision-Language Model
- 2026Wisteria: A Unified Multi-Scale Feature Learning Framework for DNA Language Model
- 2026Identify, Locate, Link: End-to-End Key-Value Extraction from Document Images
- 2026dnaHNet: A Scalable and Hierarchical Foundation Model for Genomic Sequence Learning
- 2025Gene42: Long-Range Genomic Foundation Model With Dense Attention
- 2026From Retrieval to Recognition:How Vision--Language Models Become OCR Specialists