mlsanityData to 7 Oct 2026

Central Dogma Transformer II: An AI Microscope for Understanding Cellular Regulatory Mechanisms

arXiv 2602.08751 ↗First posted 9 Feb 2026cs.LG q-bio.QMcited by 0

Not on the map. Why?

Abstract (arXiv)

Motivation: Interpretability is not optional in biology: understanding gene regulation requires models whose learned structure can be directly interrogated, not merely accurate predictors whose internals resist mapping onto regulatory relationships. We ask whether an architecture mirroring the central dogma yields attention and gradient maps that recover known regulatory elements and networks in inspectable form. Results: Central Dogma Transformer II (CDT-II) mirrors the central dogma in its architecture -- DNA self-attention, RNA self-attention, and DNA-to-RNA cross-attention -- requiring only genomic embeddings and raw per-cell expression. On K562 CRISPR interference (CRISPRi) data with five genes held out entirely, CDT-II predicts perturbation effects (per-gene mean r = 0.84), recovers the GFI1B regulatory network (6.6-fold enrichment, P = 3.5 x 10^-17), and concentrates cross-attention on ENCODE regulatory elements including CTCF sites (mean 7.67x across 28 target genes, P < 0.001). Gradient attribution predicts consequences of perturbing therapeutic targets (mean r = 0.82). For TFRC, target of the anti-TfR1 antibody PPMX-T003, it identifies erythrocyte-structure, iron-dependent DNA-synthesis and oxidative-stress genes, matching anemia and ferroptosis reported clinically and preclinically -- without clinical data as input. CDT-II acts as an AI microscope, surfacing clinically relevant regulatory structure from perturbation experiments alone. Availability: Source code is available at https://github.com/nobusama/CDT2. Pre-computed embeddings, training data, and model weights are available at https://huggingface.co/datasets/nobusama17/CDT2-data.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 4 of its 46 references that are in the map. First posted on arXiv 9 Feb 2026.

Builds on

4 of 46 references.

References · 4

  1. 2017Attention Is All You Needcited by 59,932
  2. 2019Attention is not Explanationcited by 916
  3. 2019Attention is not not Explanationcited by 629
  4. 2026Central Dogma Transformer: Towards Mechanism-Oriented AI for Cellular Understandingcited by 1

Built on by

Not cited yet.