Differentiable Programs with Neural Libraries
Not on the map. Why?
Abstract (arXiv)
We develop a framework for combining differentiable programming languages with neural networks. Using this framework we create end-to-end trainable systems that learn to write interpretable algorithms with perceptual components. We explore the benefits of inductive biases for strong generalization and modularity that come from the program-like structure of our models. In particular, modularity allows us to learn a library of (neural) functions which grows and improves as more tasks are solved. Empirically, we show that this leads to lifelong learning systems that transfer knowledge to new tasks more effectively than baselines.
Key facts. Cited by 30 papers in the map (data through 7 Oct 2026). First posted on arXiv 7 Nov 2016.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2019: 1; 2020: 0; 2021: 6; 2022: 9; 2023: 4; 2024: 4; 2025: 3; 2026: 3.
30 papers.
Sort:
By area:
- 2024NExT: Teaching Large Language Models to Reason about Code Executioncited by 60
- 2021Learning to Synthesize Programs as Interpretable and Generalizable Policiescited by 59
- 2022How to Reuse and Compose Knowledge for a Lifetime of Tasks: A Survey on Continual Learning and Functional Compositioncited by 27
- 2024Limits of Deep Learning: Sequence Modeling through the Lens of Complexity Theorycited by 19
- 2022From Perception to Programs: Regularize, Overparameterize, and Amortizecited by 13
- 2022Static Prediction of Runtime Errors by Learning to Execute Programs with External Resource Descriptionscited by 11
- 2019From explanation to synthesis: Compositional program induction for learning from demonstrationcited by 9
- 2022Construction of Hierarchical Neural Architecture Search Spaces based on Context-free Grammarscited by 9
- 2024REFACTOR: Learning to Extract Theorems from Proofscited by 9
- 2023Hierarchical Neural Program Synthesiscited by 7
- 2023Deciphering Raw Data in Neuro-Symbolic Learning with Provable Guaranteescited by 6
- 2023Smoothing Methods for Automatic Differentiation Across Conditional Branchescited by 6
18 more
- 2021Robot Program Parameter Inference via Differentiable Shadow Program Inversioncited by 5
- 2024Differentiable Logic Programming for Distant Supervisioncited by 4
- 2021Deep Algorithmic Question Answering: Towards a Compositionally Hybrid AI for Algorithmic Reasoningcited by 2
- 2022Automated causal inference in application to randomized controlled clinical trialscited by 2
- 2022NESTER: An Adaptive Neurosymbolic Method for Causal Effect Estimationcited by 1
- 2025Compiling to linear neuronscited by 1
- 2026Neural Decision-Propagation for Answer Set Programmingcited by 1
- 2021Understanding in Artificial Intelligencecited by 0
- 2021Procedures as Programs: Hierarchical Control of Situated Agents through Natural Languagecited by 0
- 2021Synthesizing Machine Learning Programs with PAC Guarantees via Statistical Sketchingcited by 0
- 2022Differentiable Quantum Programming with Unbounded Loopscited by 0
- 2022A Short Survey of Systematic Generalizationcited by 0
- 2022Neural Feature-Adaptation for Symbolic Predictions Using Pre-Training and Semantic Losscited by 0
- 2023A differentiable programming framework for spin modelscited by 0
- 2025MetaLint: Easy-to-Hard Generalization for Code Lintingcited by 0
- 2025Compiling to recurrent neuronscited by 0
- 2026Neural-Symbolic Integration with Evolvable Policiescited by 0
- 2026Differentiate the Evaluator, Not the Program: An Efficient Runtime Representation for Neuro-Symbolic Learningcited by 0
- 2026Differentiate the Evaluator, Not the Program: An Efficient Runtime Representation for Neuro-Symbolic Learning3 Jul 2026
- 2026Neural Decision-Propagation for Answer Set Programming3 May 2026
- 2026Neural-Symbolic Integration with Evolvable Policies8 Jan 2026
- 2025Compiling to recurrent neurons18 Nov 2025
- 2025Compiling to linear neurons14 Nov 2025
- 2025MetaLint: Easy-to-Hard Generalization for Code Linting15 Jul 2025
- 2024Differentiable Logic Programming for Distant Supervision22 Aug 2024
- 2024Limits of Deep Learning: Sequence Modeling through the Lens of Complexity Theory26 May 2024
- 2024NExT: Teaching Large Language Models to Reason about Code Execution23 Apr 2024
- 2024REFACTOR: Learning to Extract Theorems from Proofs26 Feb 2024
- 2023Smoothing Methods for Automatic Differentiation Across Conditional Branches5 Oct 2023
- 2023Deciphering Raw Data in Neuro-Symbolic Learning with Provable Guarantees21 Aug 2023
18 more
- 2023A differentiable programming framework for spin models4 Apr 2023
- 2023Hierarchical Neural Program Synthesis9 Mar 2023
- 2022Neural Feature-Adaptation for Symbolic Predictions Using Pre-Training and Semantic Loss29 Nov 2022
- 2022A Short Survey of Systematic Generalization22 Nov 2022
- 2022Differentiable Quantum Programming with Unbounded Loops8 Nov 2022
- 2022NESTER: An Adaptive Neurosymbolic Method for Causal Effect Estimation8 Nov 2022
- 2022Construction of Hierarchical Neural Architecture Search Spaces based on Context-free Grammars3 Nov 2022
- 2022How to Reuse and Compose Knowledge for a Lifetime of Tasks: A Survey on Continual Learning and Functional Composition15 Jul 2022
- 2022From Perception to Programs: Regularize, Overparameterize, and Amortize13 Jun 2022
- 2022Static Prediction of Runtime Errors by Learning to Execute Programs with External Resource Descriptions7 Mar 2022
- 2022Automated causal inference in application to randomized controlled clinical trials15 Jan 2022
- 2021Synthesizing Machine Learning Programs with PAC Guarantees via Statistical Sketching11 Oct 2021
- 2021Procedures as Programs: Hierarchical Control of Situated Agents through Natural Language16 Sep 2021
- 2021Deep Algorithmic Question Answering: Towards a Compositionally Hybrid AI for Algorithmic Reasoning16 Sep 2021
- 2021Learning to Synthesize Programs as Interpretable and Generalizable Policies31 Aug 2021
- 2021Robot Program Parameter Inference via Differentiable Shadow Program Inversion26 Mar 2021
- 2021Understanding in Artificial Intelligence17 Jan 2021
- 2019From explanation to synthesis: Compositional program induction for learning from demonstration27 Feb 2019
- 2021Learning to Synthesize Programs as Interpretable and Generalizable Policiescited by 59
- 2022How to Reuse and Compose Knowledge for a Lifetime of Tasks: A Survey on Continual Learning and Functional Compositioncited by 27
- 2024Limits of Deep Learning: Sequence Modeling through the Lens of Complexity Theorycited by 19
- 2022From Perception to Programs: Regularize, Overparameterize, and Amortizecited by 13
- 2022Static Prediction of Runtime Errors by Learning to Execute Programs with External Resource Descriptionscited by 11
- 2022Construction of Hierarchical Neural Architecture Search Spaces based on Context-free Grammarscited by 9
- 2024REFACTOR: Learning to Extract Theorems from Proofscited by 9
- 2023Hierarchical Neural Program Synthesiscited by 7
- 2023Smoothing Methods for Automatic Differentiation Across Conditional Branchescited by 6
- 2021Robot Program Parameter Inference via Differentiable Shadow Program Inversioncited by 5
- 2024Differentiable Logic Programming for Distant Supervisioncited by 4
- 2021Deep Algorithmic Question Answering: Towards a Compositionally Hybrid AI for Algorithmic Reasoningcited by 2
12 most cited of 27 All 27 (JSON)
- 2026Differentiate the Evaluator, Not the Program: An Efficient Runtime Representation for Neuro-Symbolic Learning3 Jul 2026
- 2026Neural Decision-Propagation for Answer Set Programming3 May 2026
- 2026Neural-Symbolic Integration with Evolvable Policies8 Jan 2026
- 2025Compiling to recurrent neurons18 Nov 2025
- 2025Compiling to linear neurons14 Nov 2025
- 2025MetaLint: Easy-to-Hard Generalization for Code Linting15 Jul 2025
- 2024Differentiable Logic Programming for Distant Supervision22 Aug 2024
- 2024Limits of Deep Learning: Sequence Modeling through the Lens of Complexity Theory26 May 2024
- 2024REFACTOR: Learning to Extract Theorems from Proofs26 Feb 2024
- 2023Smoothing Methods for Automatic Differentiation Across Conditional Branches5 Oct 2023
- 2023A differentiable programming framework for spin models4 Apr 2023
- 2023Hierarchical Neural Program Synthesis9 Mar 2023
12 newest of 27 All 27 (JSON)