A reservoir computing system with volatile and non-volatile organic memristors as a promising hardware architecture

In recent years, many scientific groups have been working on hardware implementation of the artificial neural networks to approach the computational efficiency of their biological counterpart. Memristors may play the role of synapses in such networks [1]. Varieties of memristive structures and materials have already been tested in different neural network architectures, but still no memristor is considered ideal for hardware synapse implementation [1]. One of the most significant problems is the presence of inherent stochasticity distinctive for all memristive devices, which complicates the training of the neural networks [1]. Several approaches were proposed to partially mitigate this problem, e.g., a reservoir computing system (RCS) [2] and spiking neural networks (SNN) [3] as well as defect engineering for memristive characteristics improvement. In this work, we propose to combine RCS with SNN and create a bio-inspired neuromorphic system based on two types of organic memristors with specifically designed structures and advanced characteristics. The RCS consists of two main parts: the reservoir and the readout [2]. The reservoir layer extracts some representative features from the input data due to its internal nonlinear dynamics. The readout layer then uses these features to classify the input data. Typically, a conventional fully connected neural network is used as a readout layer in the RCS. The training process occurs only in the readout layer, while a reservoir is not trainable. This decrease in trainable parameters considerably reduces the memristive stochasticity impact on the training process. The use of different types of memristors for the RCS is essential. The reservoir layer should consist of memristors with short-term memory, i.e., volatile memristors. This way, memristors can process each input sample individually. Volatile polyaniline-based memristors were chosen for this layer implementation. They can operate within a biologically plausible time range, which is essential as we aim to mimic biological systems [4]. In contrast, the reservoir layer should consist of memristors with long-term memory, i.e., non-volatile memristors, because the readout layer should preserve the trained synaptic weights. Non-volatile parylene memristors with incorporated MoO3 nanoparticles were chosen for the readout layer. The reservoir computing system adopts some essential principles of brain function, as both short- and long-term memory are significant in biological systems. However, traditional neural networks are commonly used as a readout layer in the RCSs [2]. Their training requires global weight updates, making them vulnerable to memristive stochasticity. In contrast, the SNNs allow local training, e.g., using bio-inspired learning rules, which makes them more effective and robust [3]. Consequently, we presume that a fully organic RCS with an SNN readout layer is a promising hardware memristive architecture. The work consists of two parts: hardware and software. First, the polyaniline- and parylene-based memristive devices were fabricated and tested. Hardware polyaniline reservoir demonstrated an ability to extract characteristic features from the input data. Nanocomposite parylene memristors were suitable for the role of synapses in the readout layer due to the unique combination of high switching speed, high stability, low power consumption and the possibility of crossbar implementation. Next, the traditional and spiking readout layers were compared in simulation. It was shown that the SNN readout layer is more adaptive and sustainable to noise in image classification tasks as well as memristive stochasticity [5].