-
Ultrafast neuromorphic computing with nanophotonic optical parametric oscillators
Authors:
Midya Parto,
Gordon H. Y. Li,
Ryoto Sekine,
Robert M. Gray,
Luis L. Ledezma,
James Williams,
Arkadev Roy,
Alireza Marandi
Abstract:
Over the past decade, artificial intelligence (AI) has led to disruptive advancements in fundamental sciences and everyday technologies. Among various machine learning algorithms, deep neural networks have become instrumental in revealing complex patterns in large datasets with key applications in computer vision, natural language processing, and predictive analytics. On-chip photonic neural netwo…
▽ More
Over the past decade, artificial intelligence (AI) has led to disruptive advancements in fundamental sciences and everyday technologies. Among various machine learning algorithms, deep neural networks have become instrumental in revealing complex patterns in large datasets with key applications in computer vision, natural language processing, and predictive analytics. On-chip photonic neural networks offer a promising platform that leverage high bandwidths and low propagation losses associated with optical signals to perform analog computations for deep learning. However, nanophotonic circuits are yet to achieve the required linear and nonlinear operations simultaneously in an all-optical and ultrafast fashion. Here, we report an ultrafast nanophotonic neuromorphic processor using an optical parametric oscillator (OPO) fabricated on thin-film lithium niobate (TFLN). The input data is used to modulate the optical pulses synchronously pumping the OPO. The consequent signal pulses generated by the OPO are coupled to one another via the nonlinear delayed dynamics of the OPO, thus forming the internal nodes of a deep recurrent neural network. We use such a nonlinearly coupled OPO network for chaotic time series prediction, nonlinear error correction in a noisy communication channel, as well as noisy waveform classification and achieve accuracies exceeding 93% at an operating clock rate of ~ 10 GHz. Our OPO network is capable of achieving sub-nanosecond latencies, a timescale comparable to a single clock cycle in state-of-the-art digital electronic processors. By circumventing the need for optical-electronic-optical (OEO) conversions, our ultrafast nanophotonic neural network paves the way for the next generation of compact all-optical neuromorphic processors with ultralow latencies and high energy efficiencies.
△ Less
Submitted 27 January, 2025;
originally announced January 2025.
-
Roadmap on Neuromorphic Photonics
Authors:
Daniel Brunner,
Bhavin J. Shastri,
Mohammed A. Al Qadasi,
H. Ballani,
Sylvain Barbay,
Stefano Biasi,
Peter Bienstman,
Simon Bilodeau,
Wim Bogaerts,
Fabian Böhm,
G. Brennan,
Sonia Buckley,
Xinlun Cai,
Marcello Calvanese Strinati,
B. Canakci,
Benoit Charbonnier,
Mario Chemnitz,
Yitong Chen,
Stanley Cheung,
Jeff Chiles,
Suyeon Choi,
Demetrios N. Christodoulides,
Lukas Chrostowski,
J. Chu,
J. H. Clegg
, et al. (125 additional authors not shown)
Abstract:
This roadmap consolidates recent advances while exploring emerging applications, reflecting the remarkable diversity of hardware platforms, neuromorphic concepts, and implementation philosophies reported in the field. It emphasizes the critical role of cross-disciplinary collaboration in this rapidly evolving field.
This roadmap consolidates recent advances while exploring emerging applications, reflecting the remarkable diversity of hardware platforms, neuromorphic concepts, and implementation philosophies reported in the field. It emphasizes the critical role of cross-disciplinary collaboration in this rapidly evolving field.
△ Less
Submitted 16 January, 2025; v1 submitted 14 January, 2025;
originally announced January 2025.
-
All-optical computing with beyond 100-GHz clock rates
Authors:
Gordon H. Y. Li,
Midya Parto,
Jinhao Ge,
Qing-Xin Ji,
Maodong Gao,
Yan Yu,
James Williams,
Robert M. Gray,
Christian R. Leefmans,
Nicolas Englebert,
Kerry J. Vahala,
Alireza Marandi
Abstract:
A computer's clock rate ultimately determines the minimum time between sequential operations or instructions. Despite exponential advances in electronic computer performance owing to Moore's Law and increasingly parallel system architectures, computer clock rates have remained stagnant at $\sim5~\mathrm{GHz}$ for almost two decades. This poses an intractable problem for applications requiring real…
▽ More
A computer's clock rate ultimately determines the minimum time between sequential operations or instructions. Despite exponential advances in electronic computer performance owing to Moore's Law and increasingly parallel system architectures, computer clock rates have remained stagnant at $\sim5~\mathrm{GHz}$ for almost two decades. This poses an intractable problem for applications requiring real-time processing or control of ultrafast information systems. Here we break this barrier by proposing and experimentally demonstrating computing based on an end-to-end and all-optical recurrent neural network harnessing the ultrafast nature of linear and nonlinear optical operations while avoiding electronic operations. The all-optical computer realizes linear operations, nonlinear functions, and memory entirely in the optical domain with $>100~\mathrm{GHz}$ clock rates. We experimentally demonstrate a prototypical task of noisy waveform classification as well as perform ultrafast in-situ analysis of the soliton states from integrated optical microresonators. We further illustrate the application of the architecture for generative artificial intelligence based on quantum fluctuations to generate images even in the absence of input optical signals. Our results highlight the potential of all-optical computing beyond what can be achieved with digital electronics by utilizing ultrafast linear, nonlinear, and memory functions and quantum fluctuations.
△ Less
Submitted 24 January, 2025; v1 submitted 10 January, 2025;
originally announced January 2025.
-
Large-scale time-multiplexed nanophotonic parametric oscillators
Authors:
Robert M. Gray,
Ryoto Sekine,
Luis Ledezma,
Gordon H. Y. Li,
Selina Zhou,
Arkadev Roy,
Midya Parto,
Alireza Marandi
Abstract:
Arrays of nonlinear resonators offer a fertile ground for a wide range of complex phenomena and opportunities for advanced photonic sensing and computing. Recently, significant attention has focused on studying coupled resonators in special-purpose configurations either on chips or in table-top experiments. However, a path to realizing a large-scale programmable network of nonlinear photonic reson…
▽ More
Arrays of nonlinear resonators offer a fertile ground for a wide range of complex phenomena and opportunities for advanced photonic sensing and computing. Recently, significant attention has focused on studying coupled resonators in special-purpose configurations either on chips or in table-top experiments. However, a path to realizing a large-scale programmable network of nonlinear photonic resonators remains elusive because of the challenges associated with simultaneously achieving strong nonlinearity, independent operation of the resonators, and programmability of the couplings. In this work, we break these barriers by realizing large-scale, time-multiplexed optical parametric oscillators (OPOs) on a single lithium niobate nanophotonic chip. We show independent operation of 70 identical OPOs in an ultrafast nanophotonic circuit. The OPOs exhibit an ultra-low threshold of a few picojoules, substantially surpassing the strength of nonlinearity of other platforms. Using our ultrafast nanophotonic circuit, a network of N OPOs with programmable all-to-all couplings requires only a few additional components. The time-multiplexed nanophotonic OPOs can enable myriad applications, including ultrafast classical and quantum information processing.
△ Less
Submitted 27 May, 2024;
originally announced May 2024.
-
Deep Learning with Photonic Neural Cellular Automata
Authors:
Gordon H. Y. Li,
Christian R. Leefmans,
James Williams,
Robert M. Gray,
Midya Parto,
Alireza Marandi
Abstract:
Rapid advancements in deep learning over the past decade have fueled an insatiable demand for efficient and scalable hardware. Photonics offers a promising solution by leveraging the unique properties of light. However, conventional neural network architectures, which typically require dense programmable connections, pose several practical challenges for photonic realizations. To overcome these li…
▽ More
Rapid advancements in deep learning over the past decade have fueled an insatiable demand for efficient and scalable hardware. Photonics offers a promising solution by leveraging the unique properties of light. However, conventional neural network architectures, which typically require dense programmable connections, pose several practical challenges for photonic realizations. To overcome these limitations, we propose and experimentally demonstrate Photonic Neural Cellular Automata (PNCA) for photonic deep learning with sparse connectivity. PNCA harnesses the speed and interconnectivity of photonics, as well as the self-organizing nature of cellular automata through local interactions to achieve robust, reliable, and efficient processing. We utilize linear light interference and parametric nonlinear optics for all-optical computations in a time-multiplexed photonic network to experimentally perform self-organized image classification. We demonstrate binary classification of images in the fashion-MNIST dataset using as few as 3 programmable photonic parameters, achieving an experimental accuracy of 98.0% with the ability to also recognize out-of-distribution data. The proposed PNCA approach can be adapted to a wide range of existing photonic hardware and provides a compelling alternative to conventional photonic neural networks by maximizing the advantages of light-based computing whilst mitigating their practical challenges. Our results showcase the potential of PNCA in advancing photonic deep learning and highlights a path for next-generation photonic computers.
△ Less
Submitted 22 September, 2023;
originally announced September 2023.
-
Photonic Elementary Cellular Automata for Simulation of Complex Phenomena
Authors:
Gordon H. Y. Li,
Christian R. Leefmans,
James Williams,
Alireza Marandi
Abstract:
Cellular automata are a class of computational models based on simple rules and algorithms that can simulate a wide range of complex phenomena. However, when using conventional computers, these 'simple' rules are only encapsulated at the level of software. This can be taken one step further by simplifying the underlying physical hardware. Here, we propose and implement a simple photonic hardware p…
▽ More
Cellular automata are a class of computational models based on simple rules and algorithms that can simulate a wide range of complex phenomena. However, when using conventional computers, these 'simple' rules are only encapsulated at the level of software. This can be taken one step further by simplifying the underlying physical hardware. Here, we propose and implement a simple photonic hardware platform for simulating complex phenomena based on cellular automata. Using this special-purpose computer, we experimentally demonstrate complex phenomena including fractals, chaos, and solitons, which are typically associated with much more complex physical systems. The flexibility and programmability of our photonic computer presents new opportunities to simulate and harness complexity for efficient, robust, and decentralized information processing schemes using light.
△ Less
Submitted 1 November, 2022;
originally announced November 2022.
-
Topological Temporally Mode-Locked Laser
Authors:
Christian Leefmans,
Midya Parto,
James Williams,
Gordon H. Y. Li,
Avik Dutt,
Franco Nori,
Alireza Marandi
Abstract:
Mode-locked lasers play a key role in modern science and technology. Not only do they lay the foundation for ultrafast optics and play a central role in nonlinear optics, but also they have important applications in imaging, telecommunications, sensing, and computing. While substantial efforts have focused on mode-locking the spectral modes of lasers, relatively little attention has been paid to m…
▽ More
Mode-locked lasers play a key role in modern science and technology. Not only do they lay the foundation for ultrafast optics and play a central role in nonlinear optics, but also they have important applications in imaging, telecommunications, sensing, and computing. While substantial efforts have focused on mode-locking the spectral modes of lasers, relatively little attention has been paid to mode-locking their temporal modes. However, temporal mode-locking presents ample opportunities to develop new technologies and to study the intersection of nonlinear, non-Hermitian, and topological phenomena, which, in recent years, has been a priority for the field of topological physics. Here, we theoretically predict and experimentally realize topological temporal mode-locking in a laser cavity with time-delayed intracavity couplings. These couplings introduce non-Hermitian point-gap topology into the temporal modes of our laser and conspire with an effective nonlocal nonlinearity to generate mode-locked temporal structures in our laser cavity, whose form can be tailored by suitably engineering the underlying couplings. We harness this approach to realize a nonlinearity-driven non-Hermitian skin effect, and we show that the topological temporal modes of our laser are robust against disorder-induced localization. The flexibility and programmability of our topological temporal mode-locking scheme reveals new opportunities to study nonlinear and non-Hermitian topological phenomena in mode-locked photonic resonators and could enable new applications of mode-locked lasers to sensing and optical computing.
△ Less
Submitted 1 September, 2022;
originally announced September 2022.
-
All-optical ultrafast ReLU function for energy-efficient nanophotonic deep learning
Authors:
Gordon H. Y. Li,
Ryoto Sekine,
Rajveer Nehra,
Robert M. Gray,
Luis Ledezma,
Qiushi Guo,
Alireza Marandi
Abstract:
In recent years, the computational demands of deep learning applications have necessitated the introduction of energy-efficient hardware accelerators. Optical neural networks are a promising option; however, thus far they have been largely limited by the lack of energy-efficient nonlinear optical functions. Here, we experimentally demonstrate an all-optical Rectified Linear Unit (ReLU), which is t…
▽ More
In recent years, the computational demands of deep learning applications have necessitated the introduction of energy-efficient hardware accelerators. Optical neural networks are a promising option; however, thus far they have been largely limited by the lack of energy-efficient nonlinear optical functions. Here, we experimentally demonstrate an all-optical Rectified Linear Unit (ReLU), which is the most widely used nonlinear activation function for deep learning, using a periodically-poled thin-film lithium niobate nanophotonic waveguide and achieve ultra-low energies in the regime of femtojoules per activation with near-instantaneous operation. Our results provide a clear and practical path towards truly all-optical, energy-efficient nanophotonic deep learning.
△ Less
Submitted 11 January, 2022;
originally announced January 2022.
-
Omnidirectional field enhancements drive giant nonlinearities in epsilon-near-zero waveguides
Authors:
Gordon H. Y. Li,
C. Martijn de Sterke,
Alessandro Tuniz
Abstract:
Bulk materials possessing a relative electric permittivity $\varepsilon$ close to zero exhibit giant Kerr nonlinearities. However, harnessing this response in guided-wave geometries is not straightforward, due to the extreme and counter-intuitive properties of epsilon-near-zero materials. Here we investigate, through rigorous calculations of the Kerr nonlinear coefficient, how the remarkable nonli…
▽ More
Bulk materials possessing a relative electric permittivity $\varepsilon$ close to zero exhibit giant Kerr nonlinearities. However, harnessing this response in guided-wave geometries is not straightforward, due to the extreme and counter-intuitive properties of epsilon-near-zero materials. Here we investigate, through rigorous calculations of the Kerr nonlinear coefficient, how the remarkable nonlinear properties of such materials can be exploited in several different types of structures, including bulk films, plasmonic nanowires, and metal nanoapertures. We find the largest Kerr nonlinear response when both the modal area and the group velocity are simultaneously minimized, corresponding to omnidirectional field enhancement. The physical insights developed will be key for understanding and engineering nonlinear nanophotonic systems with extreme nonlinearities and point to new design paradigms.
△ Less
Submitted 8 September, 2020;
originally announced September 2020.
-
Necessary conditions for out-of-plane lattice plasmons in nanoparticle arrays
Authors:
Gordon Han Ying Li,
Guangyuan Li
Abstract:
Out-of-plane lattice plasmons (OLPs) supported by metallic nanoparticle arrays are promising for diverse applications due to their remarkably narrow linewidths and significant enhancement of local fields. Here we investigate the necessary conditions for metallic nanoparticle arrays to achieve OLPs. Our results show that, besides the prerequisites of large height, oblique incidence, and TM polariza…
▽ More
Out-of-plane lattice plasmons (OLPs) supported by metallic nanoparticle arrays are promising for diverse applications due to their remarkably narrow linewidths and significant enhancement of local fields. Here we investigate the necessary conditions for metallic nanoparticle arrays to achieve OLPs. Our results show that, besides the prerequisites of large height, oblique incidence, and TM polarization, which have been pointed out by the literature; the array period should be properly designed within a limited range, the dielectric environment should be homogeneous, and the height and the angle of incidence need to be optimized. We expect this work will advance the understanding and engineering of OLPs in metallic nanoparticle arrays and promote their applications in nanolasers, ultrasensitive biochemical sensors, and nonlinear optics.
△ Less
Submitted 30 January, 2019; v1 submitted 4 December, 2018;
originally announced December 2018.
-
Longitudinal Schottky spectra of a bunched Ne10+ ion beam at the CSRe
Authors:
W. Q. Wen,
X. Ma,
D. C. Zhang,
X. L. Zhu,
L. J. Meng,
J. Li,
H. P. Liu,
D. M. Zhao,
Z. S. Wang,
R. S. Mao,
T. C. Zhao,
J. X. Wu,
X. M. Ma,
T. L. Yan,
G. H. Li,
X. D. Yang,
Y. Liu,
J. C. Yang,
Y. J. Yuan,
J. W. Xia,
H. S. Xu,
G. Q. Xiao,
H. W. Zhao
Abstract:
The longitudinal Schottky spectra of a radio-frequency (RF) bunched and electron cooled 22Ne10+ ion beam at 70 MeV/u have been studied by a newly installed resonant Schottky pick-up at the experimental cooler storage ring (CSRe), at IMP. For an RF-bunched ion beam, a longitudinal momentum spread of has been reached with less than 107 stored ions. The reduction of momentum spread compared with coas…
▽ More
The longitudinal Schottky spectra of a radio-frequency (RF) bunched and electron cooled 22Ne10+ ion beam at 70 MeV/u have been studied by a newly installed resonant Schottky pick-up at the experimental cooler storage ring (CSRe), at IMP. For an RF-bunched ion beam, a longitudinal momentum spread of has been reached with less than 107 stored ions. The reduction of momentum spread compared with coasting ion beam was observed from Schottky noise signal of the bunched ion beam. In order to prepare the future laser cooling experiment at the CSRe, the RF-bunching power was modulated at 25th, 50th and 75th harmonic of the revolution frequency, effective bunching amplitudes were extracted from the Schottky spectrum analysis. Applications of Schottky noise for measuring beam lifetime with ultra-low intensity of ion beams are presented, and it is relevant to upcoming experiments on laser cooling of relativistic heavy ion beams and nuclear physics at the CSRe.
△ Less
Submitted 22 May, 2013;
originally announced May 2013.