MapPFN: Learning Causal Perturbation Maps in Context
Not on the map. Why?
Abstract (arXiv)
Planning effective interventions in biological systems requires treatment-effect models that adapt to unseen biological contexts by identifying their specific underlying mechanisms. Yet single-cell perturbation datasets span only a handful of biological contexts, and existing methods cannot leverage new interventional evidence at inference time to adapt beyond their training data. To meta-learn a perturbation effect estimator, we present MapPFN, a prior-data fitted network (PFN) pre-trained on a synthetic biological prior with causal interventions, decoupling pre-training from limited wet-lab data. Unlike existing methods, MapPFN uses in-context learning to map a sequence of experiments to a post-perturbation distribution, enabling a single pre-trained model to adapt to new datasets and arbitrary gene sets at inference time. Zero-shot, MapPFN identifies differentially expressed genes on par with models trained on real single-cell data, and fine-tuning further improves predictions across biological contexts. Our code, model and data are available at https://marvinsxtr.github.io/MapPFN.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 34 of its 80 references that are in the map. First posted on arXiv 28 Jan 2026.
Builds on
34 of 80 references.
References · 34
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2022Classifier-Free Diffusion Guidancecited by 5,717
- 2022Flow Matching for Generative Modelingcited by 5,426
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
- 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,286
- 2013Sinkhorn Distances: Lightspeed Computation of Optimal Transportation Distancescited by 2,277
- 2022TabPFN: A Transformer That Solves Small Tabular Classification Problems in a Secondcited by 643
- 2016Input Convex Neural Networkscited by 407
- 2021Transformers Can Do Bayesian Inferencecited by 338
- 2017Learning Generative Models with Sinkhorn Divergencescited by 310
- 2025TabICL: A Tabular Foundation Model for In-Context Learning on Large Datacited by 267
- 2022On Neural Differential Equationscited by 264
22 more
- 2021Beware of the Simulated DAG! Causal Discovery Benchmarks May Be Easy To Gamecited by 159
- 2021Equinox: neural networks in JAX via callable PyTrees and filtered transformationscited by 143
- 2022Optimal Transport Tools (OTT): A JAX Toolbox for all things Wassersteincited by 96
- 2022Amortized Inference for Causal Structure Learningcited by 89
- 2023PFNs4BO: In-Context Learning for Bayesian Optimizationcited by 70
- 2022Learning to Induce Causal Structurecited by 68
- 2022Supervised Training of Conditional Monge Mapscited by 60
- 2024How to Build the Virtual Cell with Artificial Intelligence: Priorities and Opportunitiescited by 50
- 2025Do-PFN: In-Context Learning for Causal Effect Estimationcited by 46
- 2025CausalPFN: Amortized Causal Effect Estimation via In-Context Learningcited by 43
- 2024Meta Flow Matching: Integrating Vector Fields on the Wasserstein Manifoldcited by 41
- 2024PerturBench: Benchmarking Machine Learning Models for Cellular Perturbation Analysiscited by 35
- 2025Can Transformers Learn Full Bayesian Inference in Context?cited by 30
- 2025Foundation Models for Causal Inference via Prior-Data Fitted Networkscited by 30
- 2022Meta Optimal Transportcited by 28
- 2023GENOT: Entropic (Gromov) Wasserstein Flow Matching with Applications to Single-Cell Genomicscited by 27
- 2024A Meta-Learning Approach to Bayesian Causal Discoverycited by 22
- 2025TabPFN-Wide: Continued Pre-Training for Extreme Feature Countscited by 13
- 2022Tools and Practices for Responsible AI Engineeringcited by 9
- 2025Training Dynamics of the Cooldown Stage in Warmup-Stable-Decay Learning Rate Schedulercited by 9
- 2024Generative Intervention Models for Causal Perturbation Modelingcited by 4
- 2024Identifying biological perturbation targets through causal differential networkscited by 1
Built on by
Citing papers per year: 2026: 3.
3 papers.
- 2026PerturbPFN: Probing the Limits of Synthetic Priors in Drug Perturbation Modellingcited by 2
- 2026In-Context Multiple Instance Learningcited by 0
- 2026Causal Foundation Modelscited by 0
- 2026Causal Foundation Models2 Sep 2026
- 2026PerturbPFN: Probing the Limits of Synthetic Priors in Drug Perturbation Modelling26 Jul 2026
- 2026In-Context Multiple Instance Learning4 Jun 2026