Skip to main content

Showing 1–5 of 5 results for author: Gamst, A

Searching in archive stat. Search in all archives.
.
  1. arXiv:1811.11152  [pdf, other

    stat.ML cs.LG

    Knots in random neural networks

    Authors: Kevin K. Chen, Anthony C. Gamst, Alden K. Walker

    Abstract: The weights of a neural network are typically initialized at random, and one can think of the functions produced by such a network as having been generated by a prior over some function space. Studying random networks, then, is useful for a Bayesian understanding of the network evolution in early stages of training. In particular, one can investigate why neural networks with huge numbers of parame… ▽ More

    Submitted 27 November, 2018; originally announced November 2018.

    Comments: Presented at the Workshop on Bayesian Deep Learning, NIPS 2016, Barcelona, Spain

  2. arXiv:1710.08952  [pdf, other

    stat.ML

    Estimating the Operating Characteristics of Ensemble Methods

    Authors: Anthony Gamst, Jay-Calvin Reyes, Alden Walker

    Abstract: In this paper we present a technique for using the bootstrap to estimate the operating characteristics and their variability for certain types of ensemble methods. Bootstrapping a model can require a huge amount of work if the training data set is large. Fortunately in many cases the technique lets us determine the effect of infinite resampling without actually refitting a single model. We apply t… ▽ More

    Submitted 24 October, 2017; originally announced October 2017.

    Comments: 17 pages, 8 figures

  3. arXiv:1706.07101  [pdf, other

    stat.ML cs.LG

    The energy landscape of a simple neural network

    Authors: Anthony Collins Gamst, Alden Walker

    Abstract: We explore the energy landscape of a simple neural network. In particular, we expand upon previous work demonstrating that the empirical complexity of fitted neural networks is vastly less than a naive parameter count would suggest and that this implicit regularization is actually beneficial for generalization from fitted models.

    Submitted 21 June, 2017; originally announced June 2017.

    Comments: 17 pages, 15 figures

  4. arXiv:1611.09444  [pdf, other

    stat.ML cs.LG

    The empirical size of trained neural networks

    Authors: Kevin K. Chen, Anthony Gamst, Alden Walker

    Abstract: ReLU neural networks define piecewise linear functions of their inputs. However, initializing and training a neural network is very different from fitting a linear spline. In this paper, we expand empirically upon previous theoretical work to demonstrate features of trained neural networks. Standard network initialization and training produce networks vastly simpler than a naive parameter count wo… ▽ More

    Submitted 28 November, 2016; originally announced November 2016.

    Comments: 6 pages, 5 figures

  5. arXiv:1602.07559  [pdf, other

    stat.AP stat.ME

    Regression of ranked responses when raw responses are censored

    Authors: Michael C. Donohue, Anthony C. Gamst, Robert A. Rissman, Ian Abramson

    Abstract: We discuss semiparametric regression when only the ranks of responses are observed. The model is $Y_i = F (\mathbf{x}_i'{\boldsymbolβ}_0 + \varepsilon_i)$, where $Y_i$ is the unobserved response, $F$ is a monotone increasing function, $\mathbf{x}_i$ is a known $p-$vector of covariates, ${\boldsymbolβ}_0$ is an unknown $p$-vector of interest, and $\varepsilon_i$ is an error term independent of… ▽ More

    Submitted 24 February, 2016; originally announced February 2016.

    Comments: 33 pages, 6 figures