Showing 1–5 of 5 results for author: Gearhart, A

Tunable Complexity Benchmarks for Evaluating Physics-Informed Neural Networks on Coupled Ordinary Differential Equations

Authors: Alexander New, Benjamin Eng, Andrea C. Timm, Andrew S. Gearhart

Abstract: In this work, we assess the ability of physics-informed neural networks (PINNs) to solve increasingly-complex coupled ordinary differential equations (ODEs). We focus on a pair of benchmarks: discretized partial differential equations and harmonic oscillators, each of which has a tunable parameter that controls its complexity. Even by varying network architecture and applying a state-of-the-art tr… ▽ More In this work, we assess the ability of physics-informed neural networks (PINNs) to solve increasingly-complex coupled ordinary differential equations (ODEs). We focus on a pair of benchmarks: discretized partial differential equations and harmonic oscillators, each of which has a tunable parameter that controls its complexity. Even by varying network architecture and applying a state-of-the-art training method that accounts for "difficult" training regions, we show that PINNs eventually fail to produce correct solutions to these benchmarks as their complexity -- the number of equations and the size of time domain -- increases. We identify several reasons why this may be the case, including insufficient network capacity, poor conditioning of the ODEs, and high local curvature, as measured by the Laplacian of the PINN loss. △ Less

Submitted 14 October, 2022; originally announced October 2022.

Comments: Accepted at KGML-AAAI-22: https://sites.google.com/vt.edu/kgml-aaai-22

Scatterbrained: A flexible and expandable pattern for decentralized machine learning

Authors: Miller Wilt, Jordan K. Matelsky, Andrew S. Gearhart

Abstract: Federated machine learning is a technique for training a model across multiple devices without exchanging data between them. Because data remains local to each compute node, federated learning is well-suited for use-cases in fields where data is carefully controlled, such as medicine, or in domains with bandwidth constraints. One weakness of this approach is that most federated learning tools rely… ▽ More Federated machine learning is a technique for training a model across multiple devices without exchanging data between them. Because data remains local to each compute node, federated learning is well-suited for use-cases in fields where data is carefully controlled, such as medicine, or in domains with bandwidth constraints. One weakness of this approach is that most federated learning tools rely upon a central server to perform workload delegation and to produce a single shared model. Here, we suggest a flexible framework for decentralizing the federated learning pattern, and provide an open-source, reference implementation compatible with PyTorch. △ Less

Submitted 14 December, 2021; originally announced December 2021.

Comments: Code and documentation is available at https://github.com/JHUAPL/scatterbrained

Geometry and Generalization: Eigenvalues as predictors of where a network will fail to generalize

Authors: Susama Agarwala, Benjamin Dees, Andrew Gearhart, Corey Lowman

Abstract: We study the deformation of the input space by a trained autoencoder via the Jacobians of the trained weight matrices. In doing so, we prove bounds for the mean squared errors for points in the input space, under assumptions regarding the orthogonality of the eigenvectors. We also show that the trace and the product of the eigenvalues of the Jacobian matrices is a good predictor of the MSE on test… ▽ More We study the deformation of the input space by a trained autoencoder via the Jacobians of the trained weight matrices. In doing so, we prove bounds for the mean squared errors for points in the input space, under assumptions regarding the orthogonality of the eigenvectors. We also show that the trace and the product of the eigenvalues of the Jacobian matrices is a good predictor of the MSE on test points. This is a dataset independent means of testing an autoencoder's ability to generalize on new input. Namely, no knowledge of the dataset on which the network was trained is needed, only the parameters of the trained model. △ Less

Submitted 13 July, 2021; originally announced July 2021.

Development of a proton Computed Tomography (pCT) scanner at NIU

Authors: S. A. Uzunyan, G. Blazey, S. Boi, G. Coutrakon, A. Dyshkant, B. Erdelyi, A. Gearhart, D. Hedin, E. Johnson, J. Krider, V. Zutshi, R. Ford, T. Fitzpatrick, G. Sellberg, J. E. Rauch, M. Roman, P. Rubinov, P. Wilson, K. Lalwani, M. Naimuddin

Abstract: We describe the development of a proton Computed Tomography (pCT) scanner at Northern Illinois University (NIU) in collaboration with Fermilab and Delhi University. This paper provides an overview of major components of the scanner and a detailed description of the data acquisition system (DAQ). We describe the development of a proton Computed Tomography (pCT) scanner at Northern Illinois University (NIU) in collaboration with Fermilab and Delhi University. This paper provides an overview of major components of the scanner and a detailed description of the data acquisition system (DAQ). △ Less

Submitted 13 December, 2013; originally announced December 2013.

Comments: 7 pages, 4 figures. Proceedings of the International Conference "New Trends in High-Energy Physics", Alushta, Crimea, Ukraine, September 23-29, 2013, edited by L.L. Jenkovszky, D. Savchenko, G. Stelmakn, (Kiev, 2013), pp. 152-157

Report number: C13-09-28

Inclusive Electron Scattering from Nuclei at $x \simeq 1$

Authors: J. Arrington, P. Anthony, R. G. Arnold, E. J. Beise, J. E. Belz, P. E. Bosted, H. -J. Bulten, M. S. Chapman, K. P. Coulter, F. Dietrich, R. Ent, M. Epstein, B. W. Filippone, H. Gao, R. A. Gearhart, D. F. Geesaman, J. -O. Hansen, R. J. Holt, H. E. Jackson, C. E. Jones, C. E. Keppel, E. R. Kinney, S. Kuhn, K. Lee, W. Lorenzon , et al. (21 additional authors not shown)

Abstract: The inclusive A(e,e') cross section for $x \simeq 1$ was measured on $^2$H, C, Fe, and Au for momentum transfers $Q^2$ from 1-7 (GeV/c)$^2$. The scaling behavior of the data was examined in the region of transition from y-scaling to x-scaling. Throughout this transitional region, the data exhibit $ξ$-scaling, reminiscent of the Bloom-Gilman duality seen in free nucleon scattering. The inclusive A(e,e') cross section for $x \simeq 1$ was measured on $^2$H, C, Fe, and Au for momentum transfers $Q^2$ from 1-7 (GeV/c)$^2$. The scaling behavior of the data was examined in the region of transition from y-scaling to x-scaling. Throughout this transitional region, the data exhibit $ξ$-scaling, reminiscent of the Bloom-Gilman duality seen in free nucleon scattering. △ Less

Submitted 25 April, 1995; originally announced April 1995.

Comments: 4 pages, RevTeX; 4 figures (postscript in .tar.Z file)

Journal ref: Phys.Rev.C53:2248-2251,1996