# gym-DSSAT: a crop model turned into a Reinforcement Learning environment

arXiv: https://arxiv.org/abs/2207.03270 · HTML: https://mlsanity.com/paper/2207.03270/

## Key facts

- Cited by 13 papers in the map (data through 14 Oct 2026).
- Builds on 5 of its 66 references that are in the map.
- First posted on arXiv 7 Jul 2022.

## Builds on (most cited first, 5 of 5)

- [Proximal Policy Optimization Algorithms](https://mlsanity.com/paper/1707.06347/) (2017)
- [Exploration by Random Network Distillation](https://mlsanity.com/paper/1810.12894/) (2018)
- [A Practical Guide to Multi-Objective Reinforcement Learning and Planning](https://mlsanity.com/paper/2103.09568/) (2021)
- [RLlib: Abstractions for Distributed Reinforcement Learning](https://mlsanity.com/paper/1712.09381/) (2017)
- [CropGym: a Reinforcement Learning Environment for Crop Management](https://mlsanity.com/paper/2104.04326/) (2021)

## Built on by (most cited first, 13 of 13)

- [Optimizing Crop Management with Reinforcement Learning and Imitation Learning](https://mlsanity.com/paper/2209.09991/) (2022)
- [The New Agronomists: Language Models are Experts in Crop Management](https://mlsanity.com/paper/2403.19839/) (2024)
- [WOFOSTGym: A Crop Simulator for Learning Annual and Perennial Crop Management Strategies](https://mlsanity.com/paper/2502.19308/) (2025)
- [Learning-based agricultural management in partially observable environments subject to climate variability](https://mlsanity.com/paper/2401.01273/) (2024)
- [Current applications and potential future directions of reinforcement learning-based Digital Twins in agriculture](https://mlsanity.com/paper/2406.08854/) (2024)
- [A Comparative Study of Deep Reinforcement Learning for Crop Production Management](https://mlsanity.com/paper/2411.04106/) (2024)
- [To Measure or Not: A Cost-Sensitive, Selective Measuring Environment for Agricultural Management Decisions with Reinforcement Learning](https://mlsanity.com/paper/2501.12823/) (2025)
- [Intelligent Agricultural Management Considering N2O Emission and Climate Variability with Uncertainties](https://mlsanity.com/paper/2402.08832/) (2024)
- [Towards an efficient and risk aware strategy for guiding farmers in identifying best crop management](https://mlsanity.com/paper/2210.04537/) (2022)
- [CROPS: A Deployable Crop Management System Over All Possible State Availabilities](https://mlsanity.com/paper/2411.06034/) (2024)
- [Opportunities of Reinforcement Learning in South Africa's Just Transition](https://mlsanity.com/paper/2411.15145/) (2024)
- [Leveraging priors on distribution functions for multi-arm bandits](https://mlsanity.com/paper/2503.04518/) (2025)
- [Developing and Integrating Trust Modeling into Multi-Objective Reinforcement Learning for Intelligent Agricultural Management](https://mlsanity.com/paper/2505.10803/) (2025)

## Abstract (arXiv)

Addressing a real world sequential decision problem with Reinforcement Learning (RL) usually starts with the use of a simulated environment that mimics real conditions. We present a novel open source RL environment for realistic crop management tasks. gym-DSSAT is a gym interface to the Decision Support System for Agrotechnology Transfer (DSSAT), a high fidelity crop simulator. DSSAT has been developped over the last 30 years and is widely recognized by agronomists. gym-DSSAT comes with predefined simulations based on real world maize experiments. The environment is as easy to use as any gym environment. We provide performance baselines using basic RL algorithms. We also briefly outline how the monolithic DSSAT simulator written in Fortran has been turned into a Python RL environment. Our methodology is generic and may be applied to similar simulators. We report on very preliminary experimental results which suggest that RL can help researchers to improve sustainability of fertilization and irrigation practices.
