Skip to main content

Showing 1–9 of 9 results for author: Horn, D

Searching in archive stat. Search in all archives.
.
  1. arXiv:2503.21495  [pdf, other

    cs.LG cs.AI stat.ML

    Adaptive Resampling with Bootstrap for Noisy Multi-Objective Optimization Problems

    Authors: Timo Budszuhn, Mark Joachim Krallmann, Daniel Horn

    Abstract: The challenge of noisy multi-objective optimization lies in the constant trade-off between exploring new decision points and improving the precision of known points through resampling. This decision should take into account both the variability of the objective functions and the current estimate of a point in relation to the Pareto front. Since the amount and distribution of noise are generally un… ▽ More

    Submitted 24 April, 2025; v1 submitted 27 March, 2025; originally announced March 2025.

    Comments: 14 pages. 5 figures

    MSC Class: 90C29 ACM Class: G.1.6

  2. arXiv:2401.13045  [pdf

    stat.ML cs.LG stat.AP stat.ME

    Assessment of Sports Concussion in Female Athletes: A Role for Neuroinformatics?

    Authors: Rachel Edelstein, Sterling Gutterman, Benjamin Newman, John Darrell Van Horn

    Abstract: Over the past decade, the intricacies of sports-related concussions among female athletes have become readily apparent. Traditional clinical methods for diagnosing concussions suffer limitations when applied to female athletes, often failing to capture subtle changes in brain structure and function. Advanced neuroinformatics techniques and machine learning models have become invaluable assets in t… ▽ More

    Submitted 9 March, 2024; v1 submitted 23 January, 2024; originally announced January 2024.

  3. Using Sequential Statistical Tests for Efficient Hyperparameter Tuning

    Authors: Philip Buczak, Andreas Groll, Markus Pauly, Jakob Rehof, Daniel Horn

    Abstract: Hyperparameter tuning is one of the the most time-consuming parts in machine learning. Despite the existence of modern optimization algorithms that minimize the number of evaluations needed, evaluations of a single setting may still be expensive. Usually a resampling technique is used, where the machine learning method has to be fitted a fixed number of k times on different training datasets. The… ▽ More

    Submitted 28 November, 2022; v1 submitted 23 December, 2021; originally announced December 2021.

  4. arXiv:2009.06078  [pdf, other

    stat.ML cs.LG stat.CO stat.ME

    Random boosting and random^2 forests -- A random tree depth injection approach

    Authors: Tobias Markus Krabel, Thi Ngoc Tien Tran, Andreas Groll, Daniel Horn, Carsten Jentsch

    Abstract: The induction of additional randomness in parallel and sequential ensemble methods has proven to be worthwhile in many aspects. In this manuscript, we propose and examine a novel random tree depth injection approach suitable for sequential and parallel tree-based approaches including Boosting and Random Forests. The resulting methods are called \emph{Random Boost} and \emph{Random$^2$ Forest}. Bot… ▽ More

    Submitted 13 September, 2020; originally announced September 2020.

  5. arXiv:1808.08776  [pdf

    physics.data-an stat.AP

    Field Formulation of Parzen Data Analysis

    Authors: D. Horn

    Abstract: The Parzen window density is a well-known technique, associating Gaussian kernels with data points. It is a very useful tool in data exploration, with particular importance for clustering schemes and image analysis. This method is presented here within a formalism containing scalar fields, such as the density function and its potential, and their corresponding gradients. The potential is derived f… ▽ More

    Submitted 27 August, 2018; originally announced August 2018.

  6. arXiv:1807.01011  [pdf, other

    cs.NE stat.ML

    A First Analysis of Kernels for Kriging-based Optimization in Hierarchical Search Spaces

    Authors: Martin Zaefferer, Daniel Horn

    Abstract: Many real-world optimization problems require significant resources for objective function evaluations. This is a challenge to evolutionary algorithms, as it limits the number of available evaluations. One solution are surrogate models, which replace the expensive objective. A particular issue in this context are hierarchical variables. Hierarchical variables only influence the objective function… ▽ More

    Submitted 3 July, 2018; originally announced July 2018.

    Comments: The final authenticated version of this publication will appear in the proceedings of the 15th International Conference on Parallel Problem Solving from Nature 2018 (PPSN XV), published in the LNCS by Springer

  7. arXiv:1703.03373  [pdf, other

    stat.ML

    mlrMBO: A Modular Framework for Model-Based Optimization of Expensive Black-Box Functions

    Authors: Bernd Bischl, Jakob Richter, Jakob Bossek, Daniel Horn, Janek Thomas, Michel Lang

    Abstract: We present mlrMBO, a flexible and comprehensive R toolbox for model-based optimization (MBO), also known as Bayesian optimization, which addresses the problem of expensive black-box optimization by approximating the given objective function through a surrogate regression model. It is designed for both single- and multi-objective optimization with mixed continuous, categorical and conditional param… ▽ More

    Submitted 3 December, 2018; v1 submitted 9 March, 2017; originally announced March 2017.

    Comments: 23 pages, 5 figures

  8. arXiv:1602.03368  [pdf, other

    stat.ML cs.LG

    Fast model selection by limiting SVM training times

    Authors: Aydin Demircioglu, Daniel Horn, Tobias Glasmachers, Bernd Bischl, Claus Weihs

    Abstract: Kernelized Support Vector Machines (SVMs) are among the best performing supervised learning methods. But for optimal predictive performance, time-consuming parameter tuning is crucial, which impedes application. To tackle this problem, the classic model selection procedure based on grid-search and cross-validation was refined, e.g. by data subsampling and direct search heuristics. Here we focus on… ▽ More

    Submitted 10 February, 2016; originally announced February 2016.

  9. arXiv:0908.2644  [pdf, ps, other

    physics.data-an cs.DS hep-ex physics.comp-ph stat.ML

    Dynamic quantum clustering: a method for visual exploration of structures in data

    Authors: Marvin Weinstein, David Horn

    Abstract: A given set of data-points in some feature space may be associated with a Schrodinger equation whose potential is determined by the data. This is known to lead to good clustering solutions. Here we extend this approach into a full-fledged dynamical scheme using a time-dependent Schrodinger equation. Moreover, we approximate this Hamiltonian formalism by a truncated calculation within a set of Ga… ▽ More

    Submitted 18 August, 2009; originally announced August 2009.

    Comments: 15 pages, 9 figures

    Report number: SLAC-PUB-13759

    Journal ref: Phys.Rev.E80:066117,2009