-
BoFire: Bayesian Optimization Framework Intended for Real Experiments
Authors:
Johannes P. Dürholt,
Thomas S. Asche,
Johanna Kleinekorte,
Gabriel Mancino-Ball,
Benjamin Schiller,
Simon Sung,
Julian Keupp,
Aaron Osburg,
Toby Boyne,
Ruth Misener,
Rosona Eldred,
Wagner Steuer Costa,
Chrysoula Kappatou,
Robert M. Lee,
Dominik Linzner,
David Walz,
Niklas Wulkow,
Behrang Shafei
Abstract:
Our open-source Python package BoFire combines Bayesian Optimization (BO) with other design of experiments (DoE) strategies focusing on developing and optimizing new chemistry. Previous BO implementations, for example as they exist in the literature or software, require substantial adaptation for effective real-world deployment in chemical industry. BoFire provides a rich feature-set with extensiv…
▽ More
Our open-source Python package BoFire combines Bayesian Optimization (BO) with other design of experiments (DoE) strategies focusing on developing and optimizing new chemistry. Previous BO implementations, for example as they exist in the literature or software, require substantial adaptation for effective real-world deployment in chemical industry. BoFire provides a rich feature-set with extensive configurability and realizes our vision of fast-tracking research contributions into industrial use via maintainable open-source software. Owing to quality-of-life features like JSON-serializability of problem formulations, BoFire enables seamless integration of BO into RESTful APIs, a common architecture component for both self-driving laboratories and human-in-the-loop setups. This paper discusses the differences between BoFire and other BO implementations and outlines ways that BO research needs to be adapted for real-world use in a chemistry setting.
△ Less
Submitted 9 August, 2024;
originally announced August 2024.
-
Practical Path-based Bayesian Optimization
Authors:
Jose Pablo Folch,
James Odgers,
Shiqiang Zhang,
Robert M Lee,
Behrang Shafei,
David Walz,
Calvin Tsay,
Mark van der Wilk,
Ruth Misener
Abstract:
There has been a surge in interest in data-driven experimental design with applications to chemical engineering and drug manufacturing. Bayesian optimization (BO) has proven to be adaptable to such cases, since we can model the reactions of interest as expensive black-box functions. Sometimes, the cost of this black-box functions can be separated into two parts: (a) the cost of the experiment itse…
▽ More
There has been a surge in interest in data-driven experimental design with applications to chemical engineering and drug manufacturing. Bayesian optimization (BO) has proven to be adaptable to such cases, since we can model the reactions of interest as expensive black-box functions. Sometimes, the cost of this black-box functions can be separated into two parts: (a) the cost of the experiment itself, and (b) the cost of changing the input parameters. In this short paper, we extend the SnAKe algorithm to deal with both types of costs simultaneously. We further propose extensions to the case of a maximum allowable input change, as well as to the multi-objective setting.
△ Less
Submitted 1 December, 2023;
originally announced December 2023.
-
Using the Built-in iPhone Body Tracking System for Neurological Tests: The Example of Assessing Arm Weakness in Stroke Patients. A Preliminary Evaluation of Accuracy and Performance
Authors:
Vittorio Lippi,
Isabelle Daniela Walz,
Tobias Heimbach,
Simone Meier,
Jochen Brich,
Christian Haverkamp,
Christoph Maurer
Abstract:
Timely treatment of stroke is critical to minimize brain damage. Therefore, efforts are being made to educate the public on detecting stroke symptoms, e.g., face, arms, and speech test (FAST). In this position paper, we propose to perform the arm weakness test using the integrated video tracking from an iPhone - some general tests to assess the tracking quality and discuss potential critical point…
▽ More
Timely treatment of stroke is critical to minimize brain damage. Therefore, efforts are being made to educate the public on detecting stroke symptoms, e.g., face, arms, and speech test (FAST). In this position paper, we propose to perform the arm weakness test using the integrated video tracking from an iPhone - some general tests to assess the tracking quality and discuss potential critical points. The test has been performed on 4 stroke patients. The result is compared with the report of the clinician. Although presenting some limitations, the system proved to be able to detect arm weakness as a symptom of stroke. We envisage that introducing a portable body tracking system in such clinical tests will provide advantages in terms of objectivity, repeatability, and the possibility to record and compare groups of patients.
△ Less
Submitted 16 November, 2023;
originally announced November 2023.
-
Combining Multi-Fidelity Modelling and Asynchronous Batch Bayesian Optimization
Authors:
Jose Pablo Folch,
Robert M Lee,
Behrang Shafei,
David Walz,
Calvin Tsay,
Mark van der Wilk,
Ruth Misener
Abstract:
Bayesian Optimization is a useful tool for experiment design. Unfortunately, the classical, sequential setting of Bayesian Optimization does not translate well into laboratory experiments, for instance battery design, where measurements may come from different sources and their evaluations may require significant waiting times. Multi-fidelity Bayesian Optimization addresses the setting with measur…
▽ More
Bayesian Optimization is a useful tool for experiment design. Unfortunately, the classical, sequential setting of Bayesian Optimization does not translate well into laboratory experiments, for instance battery design, where measurements may come from different sources and their evaluations may require significant waiting times. Multi-fidelity Bayesian Optimization addresses the setting with measurements from different sources. Asynchronous batch Bayesian Optimization provides a framework to select new experiments before the results of the prior experiments are revealed. This paper proposes an algorithm combining multi-fidelity and asynchronous batch methods. We empirically study the algorithm behavior, and show it can outperform single-fidelity batch methods and multi-fidelity sequential methods. As an application, we consider designing electrode materials for optimal performance in pouch cells using experiments with coin cells to approximate battery performance.
△ Less
Submitted 23 February, 2023; v1 submitted 11 November, 2022;
originally announced November 2022.
-
Tree ensemble kernels for Bayesian optimization with known constraints over mixed-feature spaces
Authors:
Alexander Thebelt,
Calvin Tsay,
Robert M. Lee,
Nathan Sudermann-Merx,
David Walz,
Behrang Shafei,
Ruth Misener
Abstract:
Tree ensembles can be well-suited for black-box optimization tasks such as algorithm tuning and neural architecture search, as they achieve good predictive performance with little or no manual tuning, naturally handle discrete feature spaces, and are relatively insensitive to outliers in the training data. Two well-known challenges in using tree ensembles for black-box optimization are (i) effecti…
▽ More
Tree ensembles can be well-suited for black-box optimization tasks such as algorithm tuning and neural architecture search, as they achieve good predictive performance with little or no manual tuning, naturally handle discrete feature spaces, and are relatively insensitive to outliers in the training data. Two well-known challenges in using tree ensembles for black-box optimization are (i) effectively quantifying model uncertainty for exploration and (ii) optimizing over the piece-wise constant acquisition function. To address both points simultaneously, we propose using the kernel interpretation of tree ensembles as a Gaussian Process prior to obtain model variance estimates, and we develop a compatible optimization formulation for the acquisition function. The latter further allows us to seamlessly integrate known constraints to improve sampling efficiency by considering domain-knowledge in engineering settings and modeling search space symmetries, e.g., hierarchical relationships in neural architecture search. Our framework performs as well as state-of-the-art methods for unconstrained black-box optimization over continuous/discrete features and outperforms competing methods for problems combining mixed-variable feature spaces and known input constraints.
△ Less
Submitted 30 December, 2022; v1 submitted 2 July, 2022;
originally announced July 2022.
-
SnAKe: Bayesian Optimization with Pathwise Exploration
Authors:
Jose Pablo Folch,
Shiqiang Zhang,
Robert M Lee,
Behrang Shafei,
David Walz,
Calvin Tsay,
Mark van der Wilk,
Ruth Misener
Abstract:
Bayesian Optimization is a very effective tool for optimizing expensive black-box functions. Inspired by applications developing and characterizing reaction chemistry using droplet microfluidic reactors, we consider a novel setting where the expense of evaluating the function can increase significantly when making large input changes between iterations. We further assume we are working asynchronou…
▽ More
Bayesian Optimization is a very effective tool for optimizing expensive black-box functions. Inspired by applications developing and characterizing reaction chemistry using droplet microfluidic reactors, we consider a novel setting where the expense of evaluating the function can increase significantly when making large input changes between iterations. We further assume we are working asynchronously, meaning we have to select new queries before evaluating previous experiments. This paper investigates the problem and introduces 'Sequential Bayesian Optimization via Adaptive Connecting Samples' (SnAKe), which provides a solution by considering large batches of queries and preemptively building optimization paths that minimize input costs. We investigate some convergence properties and empirically show that the algorithm is able to achieve regret similar to classical Bayesian Optimization algorithms in both synchronous and asynchronous settings, while reducing input costs significantly. We show the method is robust to the choice of its single hyper-parameter and provide a parameter-free alternative.
△ Less
Submitted 11 January, 2023; v1 submitted 31 January, 2022;
originally announced February 2022.
-
Multi-Objective Constrained Optimization for Energy Applications via Tree Ensembles
Authors:
Alexander Thebelt,
Calvin Tsay,
Robert M. Lee,
Nathan Sudermann-Merx,
David Walz,
Tom Tranter,
Ruth Misener
Abstract:
Energy systems optimization problems are complex due to strongly non-linear system behavior and multiple competing objectives, e.g. economic gain vs. environmental impact. Moreover, a large number of input variables and different variable types, e.g. continuous and categorical, are challenges commonly present in real-world applications. In some cases, proposed optimal solutions need to obey explic…
▽ More
Energy systems optimization problems are complex due to strongly non-linear system behavior and multiple competing objectives, e.g. economic gain vs. environmental impact. Moreover, a large number of input variables and different variable types, e.g. continuous and categorical, are challenges commonly present in real-world applications. In some cases, proposed optimal solutions need to obey explicit input constraints related to physical properties or safety-critical operating conditions. This paper proposes a novel data-driven strategy using tree ensembles for constrained multi-objective optimization of black-box problems with heterogeneous variable spaces for which underlying system dynamics are either too complex to model or unknown. In an extensive case study comprised of synthetic benchmarks and relevant energy applications we demonstrate the competitive performance and sampling efficiency of the proposed algorithm compared to other state-of-the-art tools, making it a useful all-in-one solution for real-world applications with limited evaluation budgets.
△ Less
Submitted 4 November, 2021;
originally announced November 2021.
