# AutoREC: A reinforcement learning platform for equivalent circuit model generation

arXiv: https://arxiv.org/abs/2604.27266 · HTML: https://mlsanity.com/paper/2604.27266/

## Key facts

- No citing papers in the map yet (data through 14 Oct 2026).
- Placed in Interpretable and logic-guided RL, one of 15 directions in Deep reinforcement learning methods.
- Builds on 10 of its 37 references that are in the map.
- First posted on arXiv 29 Apr 2026.

## Placed in

- Deep reinforcement learning methods / [Interpretable and logic-guided RL](https://mlsanity.com/deeprl/interpretable-and-logic-guided-rl/)

## Builds on (most cited first, 10 of 10)

- [Playing Atari with Deep Reinforcement Learning](https://mlsanity.com/paper/1312.5602/) (2013)
- [UMAP: Uniform Manifold Approximation and Projection for Dimension Reduction](https://mlsanity.com/paper/1802.03426/) (2018)
- [Optuna: A Next-generation Hyperparameter Optimization Framework](https://mlsanity.com/paper/1907.10902/) (2019)
- [Deep Reinforcement Learning with Double Q-learning](https://mlsanity.com/paper/1509.06461/) (2015)
- [Prioritized Experience Replay](https://mlsanity.com/paper/1511.05952/) (2015)
- [A Closer Look at Invalid Action Masking in Policy Gradient Algorithms](https://mlsanity.com/paper/2006.14171/) (2020)
- [Tree-Structured Parzen Estimator: Understanding Its Algorithm Components and Their Roles for Better Empirical Performance](https://mlsanity.com/paper/2304.11127/) (2023)
- [Machine Learning Benchmarks for the Classification of Equivalent Circuit Models from Electrochemical Impedance Spectra](https://mlsanity.com/paper/2302.03362/) (2023)
- [Assessment of different loss functions for fitting equivalent circuit models to electrochemical impedance spectroscopy data](https://mlsanity.com/paper/2510.09662/) (2025)
- [Robust interpretation of electrochemical impedance spectra using numerical complex analysis](https://mlsanity.com/paper/2510.17835/) (2025)

## Abstract (arXiv)

This paper introduces AutoREC, an open-source Python platform for developing, training, and evaluating reinforcement learning (RL) agents that automatically generate equivalent circuit models (ECMs) from electrochemical impedance spectroscopy (EIS) data. Although ECMs are widely used to interpret EIS measurements, their identification typically relies on manual trial-and-error, requiring domain expertise and limiting scalability, particularly in autonomous experimental pipelines such as self-driving laboratories. In AutoREC, ECM generation is formulated as a Markov decision process in which an RL agent sequentially modifies a circuit topology based on the current state, available actions, and feedback from the resulting model. The platform supports an end-to-end workflow encompassing EIS preprocessing with selectable impedance representations, agent setup and training, ECM generation for new measurements, and visualization-based evaluation and analysis of agent decision-making. AutoREC implements a configurable Double Deep Q-Network (DDQN) agent with prioritized experience replay and a dedicated dead-loop mitigation strategy for navigating the complex circuit-generation action space efficiently. To demonstrate the platform, we trained and evaluated a representative agent on synthetic EIS datasets and applied it to previously unseen experimental spectra from battery, corrosion, oxygen evolution reaction, and CO2 reduction systems. These case studies illustrate the end-to-end capabilities of AutoREC while revealing challenges associated with experimental complexity and limited training-data coverage. The demonstrated agent serves as a reference implementation; AutoREC provides an extensible foundation through which users can develop and evaluate agents tailored to their specific electrochemical systems and research objectives.