-
Random pattern and frequency generation using a photonic reservoir computer with output feedback
Authors:
Piotr Antonik,
Michiel Hermans,
Marc Haelterman,
Serge Massar
Abstract:
Reservoir computing is a bio-inspired computing paradigm for processing time dependent signals. The performance of its analogue implementations matches other digital algorithms on a series of benchmark tasks. Their potential can be further increased by feeding the output signal back into the reservoir, which would allow to apply the algorithm to time series generation. This requires, in principle,…
▽ More
Reservoir computing is a bio-inspired computing paradigm for processing time dependent signals. The performance of its analogue implementations matches other digital algorithms on a series of benchmark tasks. Their potential can be further increased by feeding the output signal back into the reservoir, which would allow to apply the algorithm to time series generation. This requires, in principle, implementing a sufficiently fast readout layer for real-time output computation. Here we achieve this with a digital output layer driven by a FPGA chip. We demonstrate the first opto-electronic reservoir computer with output feedback and test it on two examples of time series generation tasks: frequency and random pattern generation. We obtain very good results on the first task, similar to idealised numerical simulations. The performance on the second one, however, suffers from the experimental noise. We illustrate this point with a detailed investigation of the consequences of noise on the performance of a physical reservoir computer with output feedback. Our work thus opens new possible applications for analogue reservoir computing and brings new insights on the impact of noise on the output feedback.
△ Less
Submitted 19 December, 2020;
originally announced December 2020.
-
Online training for high-performance analogue readout layers in photonic reservoir computers
Authors:
Piotr Antonik,
Marc Haelterman,
Serge Massar
Abstract:
Introduction. Reservoir Computing is a bio-inspired computing paradigm for processing time-dependent signals. The performance of its hardware implementation is comparable to state-of-the-art digital algorithms on a series of benchmark tasks. The major bottleneck of these implementation is the readout layer, based on slow offline post-processing. Few analogue solutions have been proposed, but all s…
▽ More
Introduction. Reservoir Computing is a bio-inspired computing paradigm for processing time-dependent signals. The performance of its hardware implementation is comparable to state-of-the-art digital algorithms on a series of benchmark tasks. The major bottleneck of these implementation is the readout layer, based on slow offline post-processing. Few analogue solutions have been proposed, but all suffered from notice able decrease in performance due to added complexity of the setup. Methods. Here we propose the use of online training to solve these issues. We study the applicability of this method using numerical simulations of an experimentally feasible reservoir computer with an analogue readout layer. We also consider a nonlinear output layer, which would be very difficult to train with traditional methods. Results. We show numerically that online learning allows to circumvent the added complexity of the analogue layer and obtain the same level of performance as with a digital layer. Conclusion. This work paves the way to high-performance fully-analogue reservoir computers through the use of online training of the output layers.
△ Less
Submitted 19 December, 2020;
originally announced December 2020.
-
Photonic reservoir computer based on frequency multiplexing
Authors:
Lorenz Butschek,
Akram Akrout,
Evangelia Dimitriadou,
Alessandro Lupo,
Marc Haelterman,
Serge Massar
Abstract:
Reservoir computing is a brain inspired approach for information processing, well suited to analogue implementations. We report a photonic implementation of a reservoir computer that exploits frequency domain multiplexing to encode neuron states. The system processes 25 comb lines simultaneously (i.e. 25 neurons), at a rate of 20 MHz. We illustrate performances on two standard benchmark tasks: cha…
▽ More
Reservoir computing is a brain inspired approach for information processing, well suited to analogue implementations. We report a photonic implementation of a reservoir computer that exploits frequency domain multiplexing to encode neuron states. The system processes 25 comb lines simultaneously (i.e. 25 neurons), at a rate of 20 MHz. We illustrate performances on two standard benchmark tasks: channel equalization and time series forecasting. We also demonstrate that frequency multiplexing allows output weights to be implemented in the optical domain, through optical attenuation. We discuss the perspectives for high speed high performance low footprint implementations.
△ Less
Submitted 21 May, 2022; v1 submitted 25 August, 2020;
originally announced August 2020.
-
Brain-inspired photonic signal processor for periodic pattern generation and chaotic system emulation
Authors:
Piotr Antonik,
Marc Haelterman,
Serge Massar
Abstract:
Reservoir computing is a bio-inspired computing paradigm for processing time-dependent signals. Its hardware implementations have received much attention because of their simplicity and remarkable performance on a series of benchmark tasks. In previous experiments the output was uncoupled from the system and in most cases simply computed offline on a post-processing computer. However, numerical in…
▽ More
Reservoir computing is a bio-inspired computing paradigm for processing time-dependent signals. Its hardware implementations have received much attention because of their simplicity and remarkable performance on a series of benchmark tasks. In previous experiments the output was uncoupled from the system and in most cases simply computed offline on a post-processing computer. However, numerical investigations have shown that feeding the output back into the reservoir would open the possibility of long-horizon time series forecasting. Here we present a photonic reservoir computer with output feedback, and demonstrate its capacity to generate periodic time series and to emulate chaotic systems. We study in detail the effect of experimental noise on system performance. In the case of chaotic systems, this leads us to introduce several metrics, based on standard signal processing techniques, to evaluate the quality of the emulation. Our work significantly enlarges the range of tasks that can be solved by hardware reservoir computers, and therefore the range of applications they could potentially tackle. It also raises novel questions in nonlinear dynamics and chaos theory.
△ Less
Submitted 6 February, 2018;
originally announced February 2018.
-
Parallel photonic reservoir computing using frequency multiplexing of neurons
Authors:
Akram Akrout,
Arno Bouwens,
François Duport,
Quentin Vinckier,
Marc Haelterman,
Serge Massar
Abstract:
Today's unrelenting increase in demand for information processing creates the need for novel computing concepts. Reservoir computing is such a concept that lends itself particularly well to photonic hardware implementations. Over recent years, these hardware implementations have gained maturity and now achieve state-of-the-art performance on several benchmark tasks. However, implementations so far…
▽ More
Today's unrelenting increase in demand for information processing creates the need for novel computing concepts. Reservoir computing is such a concept that lends itself particularly well to photonic hardware implementations. Over recent years, these hardware implementations have gained maturity and now achieve state-of-the-art performance on several benchmark tasks. However, implementations so far are essentially all based on sequential data processing, leaving the inherent parallelism of photonics unexploited. Parallel implementations process all neurons simultaneously, and therefore have the potential of reducing computation time by a factor equal to the number of neurons, compared to sequential architectures. Here, we report a parallel reservoir computer that uses frequency domain multiplexing of neuron states. We illustrate its performance on standard benchmark tasks such as nonlinear channel equalization, the reproduction of a nonlinear 10th-order system, and speech recognition, obtaining error rates similar to previous optical experiments. The present experiment is thus an important step towards high speed, low footprint, all optical photonic information processing.
△ Less
Submitted 24 December, 2016;
originally announced December 2016.
-
Embodiment of Learning in Electro-Optical Signal Processors
Authors:
Michiel Hermans,
Piotr Antonik,
Marc Haelterman,
Serge Massar
Abstract:
Delay-coupled electro-optical systems have received much attention for their dynamical properties and their potential use in signal processing. In particular it has recently been demonstrated, using the artificial intelligence algorithm known as reservoir computing, that photonic implementations of such systems solve complex tasks such as speech recognition. Here we show how the backpropagation al…
▽ More
Delay-coupled electro-optical systems have received much attention for their dynamical properties and their potential use in signal processing. In particular it has recently been demonstrated, using the artificial intelligence algorithm known as reservoir computing, that photonic implementations of such systems solve complex tasks such as speech recognition. Here we show how the backpropagation algorithm can be physically implemented on the same electro-optical delay-coupled architecture used for computation with only minor changes to the original design. We find that, compared when the backpropagation algorithm is not used, the error rate of the resulting computing device, evaluated on three benchmark tasks, decreases considerably. This demonstrates that electro-optical analog computers can embody a large part of their own training process, allowing them to be applied to new, more difficult tasks.
△ Less
Submitted 27 October, 2016; v1 submitted 19 October, 2016;
originally announced October 2016.
-
Online Training of an Opto-Electronic Reservoir Computer Applied to Real-Time Channel Equalisation
Authors:
Piotr Antonik,
François Duport,
Michiel Hermans,
Anteo Smerieri,
Marc Haelterman,
Serge Massar
Abstract:
Reservoir Computing is a bio-inspired computing paradigm for processing time dependent signals. The performance of its analogue implementation are comparable to other state of the art algorithms for tasks such as speech recognition or chaotic time series prediction, but these are often constrained by the offline training methods commonly employed. Here we investigated the online learning approach…
▽ More
Reservoir Computing is a bio-inspired computing paradigm for processing time dependent signals. The performance of its analogue implementation are comparable to other state of the art algorithms for tasks such as speech recognition or chaotic time series prediction, but these are often constrained by the offline training methods commonly employed. Here we investigated the online learning approach by training an opto-electronic reservoir computer using a simple gradient descent algorithm, programmed on an FPGA chip. Our system was applied to wireless communications, a quickly growing domain with an increasing demand for fast analogue devices to equalise the nonlinear distorted channels. We report error rates up to two orders of magnitude lower than previous implementations on this task. We show that our system is particularly well-suited for realistic channel equalisation by testing it on a drifting and a switching channels and obtaining good performances
△ Less
Submitted 19 October, 2016;
originally announced October 2016.
-
High performance photonic reservoir computer based on a coherently driven passive cavity
Authors:
Quentin Vinckier,
François Duport,
Anteo Smerieri,
Kristof Vandoorne,
Peter Bienstman,
Marc Haelterman,
Serge Massar
Abstract:
Reservoir computing is a recent bio-inspired approach for processing time-dependent signals. It has enabled a breakthrough in analog information processing, with several experiments, both electronic and optical, demonstrating state-of-the-art performances for hard tasks such as speech recognition, time series prediction and nonlinear channel equalization. A proof-of-principle experiment using a li…
▽ More
Reservoir computing is a recent bio-inspired approach for processing time-dependent signals. It has enabled a breakthrough in analog information processing, with several experiments, both electronic and optical, demonstrating state-of-the-art performances for hard tasks such as speech recognition, time series prediction and nonlinear channel equalization. A proof-of-principle experiment using a linear optical circuit on a photonic chip to process digital signals was recently reported. Here we present a photonic implementation of a reservoir computer based on a coherently driven passive fiber cavity processing analog signals. Our experiment has error rate as low or lower than previous experiments on a wide variety of tasks, and also has lower power consumption. Furthermore, the analytical model describing our experiment is also of interest, as it constitutes a very simple high performance reservoir computer algorithm. The present experiment, given its good performances, low energy consumption and conceptual simplicity, confirms the great potential of photonic reservoir computing for information processing applications ranging from artificial intelligence to telecommunications
△ Less
Submitted 20 May, 2015; v1 submitted 13 January, 2015;
originally announced January 2015.
-
Analog input layer for optical reservoir computers
Authors:
François Duport,
Akram Akrout,
Anteo Smerieri,
Marc Haelterman,
Serge Massar
Abstract:
Reservoir computing is an information processing technique, derived from the theory of neural networks, which is easy to implement in hardware. Several reservoir computer hardware implementations have been realized recently with performance comparable to digital implementations, which demonstrated the potential of reservoir computing for ultrahigh bandwidth signal processing tasks. In all these im…
▽ More
Reservoir computing is an information processing technique, derived from the theory of neural networks, which is easy to implement in hardware. Several reservoir computer hardware implementations have been realized recently with performance comparable to digital implementations, which demonstrated the potential of reservoir computing for ultrahigh bandwidth signal processing tasks. In all these implementations however the signal pre-processing necessary to efficiently address the reservoir was performed digitally. Here we show how this digital pre-processing can be replaced by an analog input layer. We study both numerically and experimentally to what extent the pre-processing can be replaced by a modulation of the input signal by either a single sine-wave or by a sum of two sine functions, since harmonic oscillations are particularly easy to generate in hardware. We find that the modulation by a single sine gives performance worse than state of the art. On the other hand, on many -but not all- tasks, the modulation by two sines gives performances comparable to the state of the art. The present work thus represents an important step towards fully autonomous, ultrahigh bandwidth analog reservoir computers.
△ Less
Submitted 12 June, 2014;
originally announced June 2014.
-
Analog readout for optical reservoir computers
Authors:
Anteo Smerieri,
François Duport,
Yvan Paquot,
Benjamin Schrauwen,
Marc Haelterman,
Serge Massar
Abstract:
Reservoir computing is a new, powerful and flexible machine learning technique that is easily implemented in hardware. Recently, by using a time-multiplexed architecture, hardware reservoir computers have reached performance comparable to digital implementations. Operating speeds allowing for real time information operation have been reached using optoelectronic systems. At present the main perfor…
▽ More
Reservoir computing is a new, powerful and flexible machine learning technique that is easily implemented in hardware. Recently, by using a time-multiplexed architecture, hardware reservoir computers have reached performance comparable to digital implementations. Operating speeds allowing for real time information operation have been reached using optoelectronic systems. At present the main performance bottleneck is the readout layer which uses slow, digital postprocessing. We have designed an analog readout suitable for time-multiplexed optoelectronic reservoir computers, capable of working in real time. The readout has been built and tested experimentally on a standard benchmark task. Its performance is better than non-reservoir methods, with ample room for further improvement. The present work thereby overcomes one of the major limitations for the future development of hardware reservoir computers.
△ Less
Submitted 14 September, 2012;
originally announced September 2012.
-
All-optical Reservoir Computing
Authors:
François Duport,
Bendix Schneider,
Anteo Smerieri,
Marc Haelterman,
Serge Massar
Abstract:
Reservoir Computing is a novel computing paradigm which uses a nonlinear recurrent dynamical system to carry out information processing. Recent electronic and optoelectronic Reservoir Computers based on an architecture with a single nonlinear node and a delay loop have shown performance on standardized tasks comparable to state-of-the-art digital implementations. Here we report an all-optical impl…
▽ More
Reservoir Computing is a novel computing paradigm which uses a nonlinear recurrent dynamical system to carry out information processing. Recent electronic and optoelectronic Reservoir Computers based on an architecture with a single nonlinear node and a delay loop have shown performance on standardized tasks comparable to state-of-the-art digital implementations. Here we report an all-optical implementation of a Reservoir Computer, made of off-the-shelf components for optical telecommunications. It uses the saturation of a semiconductor optical amplifier as nonlinearity. The present work shows that, within the Reservoir Computing paradigm, all-optical computing with state-of-the-art performance is possible.
△ Less
Submitted 1 October, 2012; v1 submitted 6 July, 2012;
originally announced July 2012.
-
Optoelectronic Reservoir Computing
Authors:
Yvan Paquot,
François Duport,
Anteo Smerieri,
Joni Dambre,
Benjamin Schrauwen,
Marc Haelterman,
Serge Massar
Abstract:
Reservoir computing is a recently introduced, highly efficient bio-inspired approach for processing time dependent data. The basic scheme of reservoir computing consists of a non linear recurrent dynamical system coupled to a single input layer and a single output layer. Within these constraints many implementations are possible. Here we report an opto-electronic implementation of reservoir comput…
▽ More
Reservoir computing is a recently introduced, highly efficient bio-inspired approach for processing time dependent data. The basic scheme of reservoir computing consists of a non linear recurrent dynamical system coupled to a single input layer and a single output layer. Within these constraints many implementations are possible. Here we report an opto-electronic implementation of reservoir computing based on a recently proposed architecture consisting of a single non linear node and a delay line. Our implementation is sufficiently fast for real time information processing. We illustrate its performance on tasks of practical importance such as nonlinear channel equalization and speech recognition, and obtain results comparable to state of the art digital implementations.
△ Less
Submitted 30 November, 2011;
originally announced November 2011.
