Echo State Network Optimization: A Systematic Literature Review

In the recent years, numerous studies have demonstrated the importance and efficiency of reservoir computing (RC) approaches. The choice of parameters and architecture in reservoir computing, on the other hand, frequently leads to an optimization task. This paper attempts to present an overview of the related work on echo state network (ESN) and deep echo state network (DeepESN) optimization and to collect research papers through a systematic literature review (SLR). This review covers 129 items published from 2004 to 2022 that are concerned with the issue of our focus. The collected papers are selected, analysed and discussed. The results indicate that there are two techniques of parameters optimization (bio-inspired and non-bio-inspired methods) have been extensively used for various reasons. But Different models employ bio-inspired methods for optimizing in a variety of fields. The potential use of particle swarm optimization (PSO) has also been noted. A significant portion of the research done in this field focuses on the study of reservoirs and how they behave in relation to their unique qualities. In order to test reservoirs with varied parameters, topologies, or training techniques, NARMA, the Mackey glass, and Lorenz time-series prediction dataset are the most commonly employed in the literature. This review debate diverse point of view about ESN's hyper-parameter optimization, metrics, time series benchmarks, real word applications, evaluation measures, and bio-inspired and non-bio-inspired techniques, this paper identifies and explores a number of research gaps.