mlsanityData to 7 Oct 2026

MapPFN: Learning Causal Perturbation Maps in Context

arXiv 2601.21092 ↗First posted 28 Jan 2026cs.LGcited by 3

Not on the map. Why?

Abstract (arXiv)

Planning effective interventions in biological systems requires treatment-effect models that adapt to unseen biological contexts by identifying their specific underlying mechanisms. Yet single-cell perturbation datasets span only a handful of biological contexts, and existing methods cannot leverage new interventional evidence at inference time to adapt beyond their training data. To meta-learn a perturbation effect estimator, we present MapPFN, a prior-data fitted network (PFN) pre-trained on a synthetic biological prior with causal interventions, decoupling pre-training from limited wet-lab data. Unlike existing methods, MapPFN uses in-context learning to map a sequence of experiments to a post-perturbation distribution, enabling a single pre-trained model to adapt to new datasets and arbitrary gene sets at inference time. Zero-shot, MapPFN identifies differentially expressed genes on par with models trained on real single-cell data, and fine-tuning further improves predictions across biological contexts. Our code, model and data are available at https://marvinsxtr.github.io/MapPFN.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 34 of its 80 references that are in the map. First posted on arXiv 28 Jan 2026.

Builds on

34 of 80 references.

References · 34

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2022Classifier-Free Diffusion Guidancecited by 5,717
  3. 2022Flow Matching for Generative Modelingcited by 5,426
  4. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
  5. 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,286
  6. 2013Sinkhorn Distances: Lightspeed Computation of Optimal Transportation Distancescited by 2,277
  7. 2022TabPFN: A Transformer That Solves Small Tabular Classification Problems in a Secondcited by 643
  8. 2016Input Convex Neural Networkscited by 407
  9. 2021Transformers Can Do Bayesian Inferencecited by 338
  10. 2017Learning Generative Models with Sinkhorn Divergencescited by 310
  11. 2025TabICL: A Tabular Foundation Model for In-Context Learning on Large Datacited by 267
  12. 2022On Neural Differential Equationscited by 264
22 more
  1. 2021Beware of the Simulated DAG! Causal Discovery Benchmarks May Be Easy To Gamecited by 159
  2. 2021Equinox: neural networks in JAX via callable PyTrees and filtered transformationscited by 143
  3. 2022Optimal Transport Tools (OTT): A JAX Toolbox for all things Wassersteincited by 96
  4. 2022Amortized Inference for Causal Structure Learningcited by 89
  5. 2023PFNs4BO: In-Context Learning for Bayesian Optimizationcited by 70
  6. 2022Learning to Induce Causal Structurecited by 68
  7. 2022Supervised Training of Conditional Monge Mapscited by 60
  8. 2024How to Build the Virtual Cell with Artificial Intelligence: Priorities and Opportunitiescited by 50
  9. 2025Do-PFN: In-Context Learning for Causal Effect Estimationcited by 46
  10. 2025CausalPFN: Amortized Causal Effect Estimation via In-Context Learningcited by 43
  11. 2024Meta Flow Matching: Integrating Vector Fields on the Wasserstein Manifoldcited by 41
  12. 2024PerturBench: Benchmarking Machine Learning Models for Cellular Perturbation Analysiscited by 35
  13. 2025Can Transformers Learn Full Bayesian Inference in Context?cited by 30
  14. 2025Foundation Models for Causal Inference via Prior-Data Fitted Networkscited by 30
  15. 2022Meta Optimal Transportcited by 28
  16. 2023GENOT: Entropic (Gromov) Wasserstein Flow Matching with Applications to Single-Cell Genomicscited by 27
  17. 2024A Meta-Learning Approach to Bayesian Causal Discoverycited by 22
  18. 2025TabPFN-Wide: Continued Pre-Training for Extreme Feature Countscited by 13
  19. 2022Tools and Practices for Responsible AI Engineeringcited by 9
  20. 2025Training Dynamics of the Cooldown Stage in Warmup-Stable-Decay Learning Rate Schedulercited by 9
  21. 2024Generative Intervention Models for Causal Perturbation Modelingcited by 4
  22. 2024Identifying biological perturbation targets through causal differential networkscited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 3.

3 papers.