# Acetylcholine-modulated plasticity in reward-driven navigation: a computational study

arXiv: https://arxiv.org/abs/1710.01951 · HTML: https://mlsanity.com/paper/1710.01951/

## Key facts

- Cited by 3 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 5 Oct 2017.

## Built on by (most cited first, 3 of 3)

- [Learning to learn online with neuromodulated synaptic plasticity in spiking neural networks](https://mlsanity.com/paper/2206.12520/) (2022)
- [Augmenting learning in neuro-embodied systems through neurobiological first principles](https://mlsanity.com/paper/2407.04525/) (2024)
- [Improving the adaptive and continuous learning capabilities of artificial neural networks: Lessons from multi-neuromodulatory dynamics](https://mlsanity.com/paper/2501.06762/) (2025)

## Abstract (arXiv)

Neuromodulation plays a fundamental role in the acquisition of new behaviours. Our experimental findings show that, whereas acetylcholine biases hippocampal synaptic plasticity towards depression, the subsequent application of dopamine can retroactively convert depression into potentiation. We previously demonstrated that incorporating this sequentially neuromodulated Spike-Timing-Dependent Plasticity (STDP) rule in a network model of navigation yields effective learning of changing reward locations. Here, we further characterize the effects of cholinergic depression on behaviour. We find that acetylcholine, by allowing learning from negative outcomes, influences exploration in a non-trivial manner that highly depends on the specifics of the model, the environment and the task. Interestingly, sequentially neuromodulated STDP also yields flexible learning, surpassing the performance of other reward-modulated plasticity rules.