Neuromorphic Overparameterisation and Few-Shot Learning in Multilayer Physical Neural Networks
Authors:
Kilian D. Stenning,
Jack C. Gartside,
Luca Manneschi,
Christopher T. S. Cheung,
Tony Chen,
Alex Vanstone,
Jake Love,
Holly H. Holder,
Francesco Caravelli,
Hidekazu Kurebayashi,
Karin Everschor-Sitte,
Eleni Vasilaki,
Will R. Branford
Abstract:
Physical neuromorphic computing, exploiting the complex dynamics of physical systems, has seen rapid advancements in sophistication and performance. Physical reservoir computing, a subset of neuromorphic computing, faces limitations due to its reliance on single systems. This constrains output dimensionality and dynamic range, limiting performance to a narrow range of tasks. Here, we engineer a su…
▽ More
Physical neuromorphic computing, exploiting the complex dynamics of physical systems, has seen rapid advancements in sophistication and performance. Physical reservoir computing, a subset of neuromorphic computing, faces limitations due to its reliance on single systems. This constrains output dimensionality and dynamic range, limiting performance to a narrow range of tasks. Here, we engineer a suite of nanomagnetic array physical reservoirs and interconnect them in parallel and series to create a multilayer neural network architecture. The output of one reservoir is recorded, scaled and virtually fed as input to the next reservoir. This networked approach increases output dimensionality, internal dynamics and computational performance. We demonstrate that a physical neuromorphic system can achieve an overparameterised state, facilitating meta-learning on small training sets and yielding strong performance across a wide range of tasks. Our approach's efficacy is further demonstrated through few-shot learning, where the system rapidly adapts to new tasks.
△ Less
Submitted 20 August, 2024; v1 submitted 11 November, 2022;
originally announced November 2022.
Reconfigurable Reservoir Computing in a Magnetic Metamaterial
Authors:
Ian Vidamour,
Charles Swindells,
Guru Venkat,
Luca Manneschi,
Paul Fry,
Alexander Welbourne,
Richard Rowan-Robinson,
Dirk Backes,
Francisco Maccherozzi,
Sarnjeet Dhesi,
Eleni Vasilaki,
Daniel Allwood,
Thomas Hayward
Abstract:
In-materia reservoir computing (RC) leverages the intrinsic physical responses of functional materials to perform complex computational tasks. Magnetic metamaterials are exciting candidates for RC due to their huge state space, nonlinear emergent dynamics, and non-volatile memory. However, to be suitable for a broad range of tasks, the material system is required to exhibit a broad range of proper…
▽ More
In-materia reservoir computing (RC) leverages the intrinsic physical responses of functional materials to perform complex computational tasks. Magnetic metamaterials are exciting candidates for RC due to their huge state space, nonlinear emergent dynamics, and non-volatile memory. However, to be suitable for a broad range of tasks, the material system is required to exhibit a broad range of properties, and isolating these behaviours experimentally can often prove difficult. By using an electrically accessible device consisting of an array of interconnected magnetic nanorings -- a system shown to exhibit complex emergent dynamics -- here we show how reconfiguring the reservoir architecture allows exploitation of different aspects the system's dynamical behaviours. This is evidenced through state-of-the-art performance in diverse benchmark tasks with very different computational requirements, highlighting the additional computational configurability that can be obtained by altering the input/output architecture around the material system.
△ Less
Submitted 27 August, 2023; v1 submitted 9 June, 2022;
originally announced June 2022.
