Showing 1–10 of 10 results for author: Buckley, S M

Scaling of hardware-compatible perturbative training algorithms

Authors: Bakhrom G. Oripov, Andrew Dienstfrey, Adam N. McCaughan, Sonia M. Buckley

Abstract: In this work, we explore the capabilities of multiplexed gradient descent (MGD), a scalable and efficient perturbative zeroth-order training method for estimating the gradient of a loss function in hardware and training it via stochastic gradient descent. We extend the framework to include both weight and node perturbation, and discuss the advantages and disadvantages of each approach. We investig… ▽ More In this work, we explore the capabilities of multiplexed gradient descent (MGD), a scalable and efficient perturbative zeroth-order training method for estimating the gradient of a loss function in hardware and training it via stochastic gradient descent. We extend the framework to include both weight and node perturbation, and discuss the advantages and disadvantages of each approach. We investigate the time to train networks using MGD as a function of network size and task complexity. Previous research has suggested that perturbative training methods do not scale well to large problems, since in these methods the time to estimate the gradient scales linearly with the number of network parameters. However, in this work we show that the time to reach a target accuracy--that is, actually solve the problem of interest--does not follow this undesirable linear scaling, and in fact often decreases with network size. Furthermore, we demonstrate that MGD can be used to calculate a drop-in replacement for the gradient in stochastic gradient descent, and therefore optimization accelerators such as momentum can be used alongside MGD, ensuring compatibility with existing machine learning practices. Our results indicate that MGD can efficiently train large networks on hardware, achieving accuracy comparable to backpropagation, thus presenting a practical solution for future neuromorphic computing systems. △ Less

Submitted 26 January, 2025; originally announced January 2025.

Wiring switches to more light bulbs

Authors: Stephen M. Buckley, Anthony G. O'Farrell

Abstract: Given $n$ buttons and $n$ bulbs so that the $i$th button toggles the $i$th bulb and perhaps some other bulbs, we compute the sharp lower bound on the number of bulbs that can be lit regardless of the action of the buttons. In the previous article we dealt with the case where each button affects at most 2 or 3 bulbs. In the present article we give sharp lower bounds for up to 4 or 5 wires per switc… ▽ More Given $n$ buttons and $n$ bulbs so that the $i$th button toggles the $i$th bulb and perhaps some other bulbs, we compute the sharp lower bound on the number of bulbs that can be lit regardless of the action of the buttons. In the previous article we dealt with the case where each button affects at most 2 or 3 bulbs. In the present article we give sharp lower bounds for up to 4 or 5 wires per switch, and we show that the sharp asymptotic bound for an arbitrary number of wires is $\frac12$. (Even if you've found their buttons, you can please no more than half the people all the time!) △ Less

Submitted 23 February, 2025; v1 submitted 3 October, 2024; originally announced October 2024.

Comments: 22 pages, 6 figures

MSC Class: Primary 05D99. Secondary 11B39; 68R05; 94C10

Quasihyperbolic geodesics are hyperbolic quasi-geodesics

Authors: David A Herron, Stephen M Buckley

Abstract: This is a tale describing the large scale geometry of Euclidean plane domains with their hyperbolic or quasihyperbolic distances. We prove that in any hyperbolic plane domain, hyperbolic and quasihyperbolic quasi-geodesics are the same curves. We also demonstrate the simultaneous Gromov hyperbolicity of such domains with their hyperbolic or quasihyperbolic distances. This is a tale describing the large scale geometry of Euclidean plane domains with their hyperbolic or quasihyperbolic distances. We prove that in any hyperbolic plane domain, hyperbolic and quasihyperbolic quasi-geodesics are the same curves. We also demonstrate the simultaneous Gromov hyperbolicity of such domains with their hyperbolic or quasihyperbolic distances. △ Less

Submitted 24 April, 2017; originally announced April 2017.

MSC Class: Primary: 30F45; 30L99; Secondary: 51F99; 53C22; 30C62

Distinguishing properties of weak slice conditions II

Authors: Stephen M. Buckley, Andre Diatta, Alexander Stanoyevitch

Abstract: The slice condition and the more general weak slice conditions are geometric conditions on Euclidean space domains which have evolved over the last several years as a tool in various areas of analysis. This paper examines some of their finer distinctive properties. The slice condition and the more general weak slice conditions are geometric conditions on Euclidean space domains which have evolved over the last several years as a tool in various areas of analysis. This paper examines some of their finer distinctive properties. △ Less

Submitted 21 December, 2012; originally announced December 2012.

Comments: 16 pages, 3 enclosed latex figures. Key Words and Phrases: slice conditions, quasihyperbolic metric. The final version appeared at International Journal of Pure and Applied Mathematics, Volume 71, No. 1, pp 83-98 (2011)

MSC Class: 51M15; 46E35

Journal ref: Int. J. Pure Appl. Math. 71 (2011), no. 1, 83-98

The n-point Condition and Rough CAT(0)

Authors: S. M. Buckley, B. Hanson

Abstract: We show that for n > 4 a length space (X,d) satisfies a rough n-point condition if and only it it is rough CAT(0). We show that for n > 4 a length space (X,d) satisfies a rough n-point condition if and only it it is rough CAT(0). △ Less

Submitted 26 October, 2012; originally announced October 2012.

Natural maps between CAT(0) boundaries

Authors: Stephen M. Buckley, Kurt Falk

Abstract: It is shown that certain natural maps between the ideal, Gromov, and end boundaries of a complete CAT(0) space can fail to be either injective or surjective. Additionally the natural map from the Gromov boundary to the end boundary of a complete CAT(-1) space can fail to be either injective or surjective. It is shown that certain natural maps between the ideal, Gromov, and end boundaries of a complete CAT(0) space can fail to be either injective or surjective. Additionally the natural map from the Gromov boundary to the end boundary of a complete CAT(-1) space can fail to be either injective or surjective. △ Less

Submitted 30 January, 2013; v1 submitted 17 October, 2012; originally announced October 2012.

Comments: 8 pages

MSC Class: 51M05; 51M10 (Primary) 51F99 (Secondary)

The Boundary at Infinity of a rough CAT(0) space

Authors: Stephen M. Buckley, Kurt Falk

Abstract: We develop the boundary theory of rough CAT(0) spaces, a class of spaces that contains both Gromov hyperbolic and CAT(0) spaces. The resulting theory generalizes the common features of the Gromov boundary of a Gromov hyperbolic space and the ideal boundary of a complete CAT(0) space. It is not assumed that the spaces are geodesic or proper. We develop the boundary theory of rough CAT(0) spaces, a class of spaces that contains both Gromov hyperbolic and CAT(0) spaces. The resulting theory generalizes the common features of the Gromov boundary of a Gromov hyperbolic space and the ideal boundary of a complete CAT(0) space. It is not assumed that the spaces are geodesic or proper. △ Less

Submitted 6 November, 2013; v1 submitted 28 September, 2012; originally announced September 2012.

Comments: 35 pages, 1 figure

MSC Class: 51M05; 51M10 (Primary) 51F99 (Secondary)

Rough CAT(0) spaces

Authors: Stephen M. Buckley, Kurt Falk

Abstract: We investigate various notions of rough CAT(0). These conditions define classes of spaces that strictly include the union of all Gromov hyperbolic length spaces and all CAT(0) spaces. We investigate various notions of rough CAT(0). These conditions define classes of spaces that strictly include the union of all Gromov hyperbolic length spaces and all CAT(0) spaces. △ Less

Submitted 21 December, 2011; v1 submitted 11 April, 2011; originally announced April 2011.

Comments: Corrected typos and updated Corollaries 3.22 and 3.23

MSC Class: 51M05; 51M10 (Primary) 54B10; 51F99 (Secondary)

Wiring Switches to Light Bulbs

Authors: Stephen M. Buckley, Anthony G. O'Farrell

Abstract: Given n buttons and n bulbs so that the ith button toggles the ith bulb and at most two other bulbs, we compute the sharp lower bound on the number of bulbs that can be lit regardless of the action of the buttons. Given n buttons and n bulbs so that the ith button toggles the ith bulb and at most two other bulbs, we compute the sharp lower bound on the number of bulbs that can be lit regardless of the action of the buttons. △ Less

Submitted 16 December, 2024; v1 submitted 25 January, 2011; originally announced January 2011.

Comments: 22 pages, 14 figures

MSC Class: Primary 05D99; Secondary 68R05; 94C10

Journal ref: Irish Math Soc Bulletin 94 Winter 2024, 69-88

On Ptolemaic metric simplicial complexes

Authors: S. M. Buckley, J. McDougall, D. J. Wraith

Abstract: We show that under certain mild conditions, a metric simplicial complex which satisfies the Ptolemy inequality is a CAT(0) space. Ptolemy's inequality is closely related to inversions of metric spaces. For a large class of metric simplicial complexes, we characterize those which are isometric to Euclidean space in terms of metric inversions. We show that under certain mild conditions, a metric simplicial complex which satisfies the Ptolemy inequality is a CAT(0) space. Ptolemy's inequality is closely related to inversions of metric spaces. For a large class of metric simplicial complexes, we characterize those which are isometric to Euclidean space in terms of metric inversions. △ Less

Submitted 10 June, 2009; originally announced June 2009.

Comments: 13 pages

MSC Class: 51F99