Showing 1–5 of 5 results for author: Werbos, P J

Time-Symmetric Physics: A Radical Approach to the Decoherence Problem

Authors: Paul J. Werbos

Abstract: The most powerful form of quantum learning system possible would somehow learn the parameters W of a quantum system f(X, W), for f representing the largest, most powerful set of possible input-output relations. This paper addresses the issue of how to enlarge the set represented by f, by using a new formulation of time-symmetric physics to model analog quantum computers based on spin and by explor… ▽ More The most powerful form of quantum learning system possible would somehow learn the parameters W of a quantum system f(X, W), for f representing the largest, most powerful set of possible input-output relations. This paper addresses the issue of how to enlarge the set represented by f, by using a new formulation of time-symmetric physics to model analog quantum computers based on spin and by exploring possible sources of backwards-time free energy so as to address problems of decoherence and dissipation. △ Less

Submitted 23 December, 2014; originally announced January 2015.

Comments: 5 pages, 2 figures. Invited keynote talk for Quantum Computing workshop at Pacific Rim AI (PRICAI) conference, December 2014. Simple summary and link to the slides and audio of the talk posted at http://www.werbos.com/quantum.htm

From ADP to the Brain: Foundations, Roadmap, Challenges and Research Priorities

Authors: Paul J Werbos

Abstract: This paper defines and discusses Mouse Level Computational Intelligence (MLCI) as a grand challenge for the coming century. It provides a specific roadmap to reach that target, citing relevant work and review papers and discussing the relation to funding priorities in two NSF funding activities: the ongoing Energy, Power and Adaptive Systems program (EPAS) and the recent initiative in Cognitive Op… ▽ More This paper defines and discusses Mouse Level Computational Intelligence (MLCI) as a grand challenge for the coming century. It provides a specific roadmap to reach that target, citing relevant work and review papers and discussing the relation to funding priorities in two NSF funding activities: the ongoing Energy, Power and Adaptive Systems program (EPAS) and the recent initiative in Cognitive Optimization and Prediction (COPN). It elaborates on the first step, vector intelligence, a challenge in the development of universal learning systems, which itself will require considerable new research to attain. This in turn is a crucial prerequisite to true functional understanding of how mammal brains achieve such general learning capabilities. △ Less

Submitted 2 April, 2014; originally announced April 2014.

Comments: 5p, to appear in Proc. of the Interantional Joint Conference on Neural Networks 2014

Complete stability analysis of a heuristic ADP control design

Authors: Yury Sokolov, Robert Kozma, Ludmilla D. Werbos, Paul J. Werbos

Abstract: This paper provides new stability results for Action-Dependent Heuristic Dynamic Programming (ADHDP), using a control algorithm that iteratively improves an internal model of the external world in the autonomous system based on its continuous interaction with the environment. We extend previous results by ADHDP control to the case of general multi-layer neural networks with deep learning across al… ▽ More This paper provides new stability results for Action-Dependent Heuristic Dynamic Programming (ADHDP), using a control algorithm that iteratively improves an internal model of the external world in the autonomous system based on its continuous interaction with the environment. We extend previous results by ADHDP control to the case of general multi-layer neural networks with deep learning across all layers. In particular, we show that the introduced control approach is uniformly ultimately bounded (UUB) under specific conditions on the learning rates, without explicit constraints on the temporal discount factor. We demonstrate the benefit of our results to the control of linear and nonlinear systems, including the cart-pole balancing problem. Our results show significantly improved learning and control performance as compared to the state-of-art. △ Less

Submitted 27 July, 2015; v1 submitted 14 August, 2013; originally announced August 2013.

Comments: 20 pages

Journal ref: Automatica 59 (2015) 9-18

Brain-Like Stochastic Search: A Research Challenge and Funding Opportunity

Authors: Paul J. Werbos

Abstract: Brain-Like Stochastic Search (BLiSS) refers to this task: given a family of utility functions U(u,A), where u is a vector of parameters or task descriptors, maximize or minimize U with respect to u, using networks (Option Nets) which input A and learn to generate good options u stochastically. This paper discusses why this is crucial to brain-like intelligence (an area funded by NSF) and to many a… ▽ More Brain-Like Stochastic Search (BLiSS) refers to this task: given a family of utility functions U(u,A), where u is a vector of parameters or task descriptors, maximize or minimize U with respect to u, using networks (Option Nets) which input A and learn to generate good options u stochastically. This paper discusses why this is crucial to brain-like intelligence (an area funded by NSF) and to many applications, and discusses various possibilities for network design and training. The appendix discusses recent research, relations to work on stochastic optimization in operations research, and relations to engineering-based approaches to understanding neocortex. △ Less

Submitted 1 June, 2010; originally announced June 2010.

Comments: Plenary talk at IEEE Conference on Evolutionary Computing 1999, extended in 2010 with new appendix

Beyond Feedforward Models Trained by Backpropagation: a Practical Training Tool for a More Efficient Universal Approximator

Authors: Roman Ilin, Robert Kozma, Paul J. Werbos

Abstract: Cellular Simultaneous Recurrent Neural Network (SRN) has been shown to be a function approximator more powerful than the MLP. This means that the complexity of MLP would be prohibitively large for some problems while SRN could realize the desired mapping with acceptable computational constraints. The speed of training of complex recurrent networks is crucial to their successful application. Pres… ▽ More Cellular Simultaneous Recurrent Neural Network (SRN) has been shown to be a function approximator more powerful than the MLP. This means that the complexity of MLP would be prohibitively large for some problems while SRN could realize the desired mapping with acceptable computational constraints. The speed of training of complex recurrent networks is crucial to their successful application. Present work improves the previous results by training the network with extended Kalman filter (EKF). We implemented a generic Cellular SRN and applied it for solving two challenging problems: 2D maze navigation and a subset of the connectedness problem. The speed of convergence has been improved by several orders of magnitude in comparison with the earlier results in the case of maze navigation, and superior generalization has been demonstrated in the case of connectedness. The implications of this improvements are discussed. △ Less

Submitted 22 October, 2007; originally announced October 2007.