mlsanityData to 7 Oct 2026

Rethinking Genomic Modeling Through Optical Character Recognition

arXiv 2602.02014 ↗First posted 2 Feb 2026cs.CV cs.AI cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Recent genomic foundation models largely adopt large language model architectures that treat DNA as a one-dimensional token sequence. However, exhaustive sequential reading is structurally misaligned with sparse and discontinuous genomic semantics, leading to wasted computation on low-information background and preventing understanding-driven compression for long contexts. Here, we present OpticalDNA, a vision-based framework that reframes genomic modeling as Optical Character Recognition (OCR)-style document understanding. OpticalDNA renders DNA into structured visual layouts and trains an OCR-capable vision--language model with a visual DNA encoder and a document decoder, where the encoder produces compact, reconstructible visual tokens for high-fidelity compression. Building on this representation, OpticalDNA defines prompt-conditioned objectives over core genomic primitives-reading, region grounding, subsequence retrieval, and masked span completion-thereby learning layout-aware DNA representations that retain fine-grained genomic information under a reduced effective token budget. Across diverse genomic benchmarks, OpticalDNA consistently outperforms recent baselines; on sequences up to 450k bases, it achieves the best overall performance with nearly 20× fewer effective tokens, and surpasses models with up to 985× more activated parameters while tuning only 256k trainable parameters.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 20 of its 52 references that are in the map. First posted on arXiv 2 Feb 2026.

Builds on

20 of 52 references.

References · 20

  1. 2017Attention Is All You Needcited by 59,932
  2. 2020Big Bird: Transformers for Longer Sequencescited by 1,673
  3. 2024DeepSeek-V2: A Strong, Economical, and Efficient Mixture-of-Experts Language Modelcited by 1,093
  4. 2019LayoutLM: Pre-training of Text and Layout for Document Image Understandingcited by 549
  5. 2022LayoutLMv3: Pre-training for Document AI with Unified Text and Image Maskingcited by 481
  6. 2021OCR-free Document Understanding Transformercited by 400
  7. 2022Pix2Struct: Screenshot Parsing as Pretraining for Visual Language Understandingcited by 360
  8. 2023Nougat: Neural Optical Understanding for Academic Documentscited by 240
  9. 2023HyenaDNA: Long-Range Genomic Sequence Modeling at Single Nucleotide Resolutioncited by 187
  10. 2025DeepSeek-OCR: Contexts Optical Compressioncited by 174
  11. 2023MEGABYTE: Predicting Million-byte Sequences with Multiscale Transformerscited by 164
  12. 2023DNABERT-2: Efficient Foundation Model and Benchmark For Multi-Species Genomecited by 139
8 more
  1. 2024Caduceus: Bi-Directional Equivariant Long-Range DNA Sequence Modelingcited by 108
  2. 2024LayoutLLM: Layout Instruction Tuning with Large Language Models for Document Understandingcited by 94
  3. 2025Dolphin: Document Image Parsing via Heterogeneous Anchor Promptingcited by 78
  4. 2025Glyph: Scaling Context Windows via Visual-Text Compressioncited by 49
  5. 2023BEND: Benchmarking DNA Language Models on biologically meaningful taskscited by 27
  6. 2025GENERator: A Long-Context Generative Genomic Foundation Modelcited by 20
  7. 2025HunyuanOCR Technical Reportcited by 18
  8. 2025JanusDNA: A Powerful Bi-directional Hybrid DNA Foundation Modelcited by 4

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Near-Lossless Model Compression Enables Longer Context Inference in DNA Large Language Models
  2. 2025MergeDNA: Context-aware Genome Modeling with Dynamic Tokenization through Token Merging
  3. 2025DianJin-OCR-R1: Enhancing OCR Capabilities via a Reasoning-and-Tool Interleaved Vision-Language Model
  4. 2026Wisteria: A Unified Multi-Scale Feature Learning Framework for DNA Language Model
  5. 2026Identify, Locate, Link: End-to-End Key-Value Extraction from Document Images
  6. 2026dnaHNet: A Scalable and Hierarchical Foundation Model for Genomic Sequence Learning
  7. 2025Gene42: Long-Range Genomic Foundation Model With Dense Attention
  8. 2026From Retrieval to Recognition:How Vision--Language Models Become OCR Specialists