-
Bayesian A/B Testing for Business Decisions
Authors:
Shafi Kamalbasha,
Manuel J. A. Eugster
Abstract:
Controlled experiments (A/B tests or randomized field experiments) are the de facto standard to make data-driven decisions when implementing changes and observing customer responses. The methodology to analyze such experiments should be easily understandable to stakeholders like product and marketing managers. Bayesian inference recently gained a lot of popularity and, in terms of A/B testing, one…
▽ More
Controlled experiments (A/B tests or randomized field experiments) are the de facto standard to make data-driven decisions when implementing changes and observing customer responses. The methodology to analyze such experiments should be easily understandable to stakeholders like product and marketing managers. Bayesian inference recently gained a lot of popularity and, in terms of A/B testing, one key argument is the easy interpretability. For stakeholders, "probability to be best" (with corresponding credible intervals) provides a natural metric to make business decisions. In this paper, we motivate the quintessential questions a business owner typically has and how to answer them with a Bayesian approach. We present three experiment scenarios that are common in our company, how they are modeled in a Bayesian fashion, and how to use the models to draw business decisions. For each of the scenarios, we present a real-world experiment, the results and the final business decisions drawn.
△ Less
Submitted 5 March, 2020;
originally announced March 2020.
-
Natural brain-information interfaces: Recommending information by relevance inferred from human brain signals
Authors:
Manuel J. A. Eugster,
Tuukka Ruotsalo,
Michiel M. Spapé,
Oswald Barral,
Niklas Ravaja,
Giulio Jacucci,
Samuel Kaski
Abstract:
Finding relevant information from large document collections such as the World Wide Web is a common task in our daily lives. Estimation of a user's interest or search intention is necessary to recommend and retrieve relevant information from these collections. We introduce a brain-information interface used for recommending information by relevance inferred directly from brain signals. In experime…
▽ More
Finding relevant information from large document collections such as the World Wide Web is a common task in our daily lives. Estimation of a user's interest or search intention is necessary to recommend and retrieve relevant information from these collections. We introduce a brain-information interface used for recommending information by relevance inferred directly from brain signals. In experiments, participants were asked to read Wikipedia documents about a selection of topics while their EEG was recorded. Based on the prediction of word relevance, the individual's search intent was modeled and successfully used for retrieving new, relevant documents from the whole English Wikipedia corpus. The results show that the users' interests towards digital content can be modeled from the brain signals evoked by reading. The introduced brain-relevance paradigm enables the recommendation of information without any explicit user interaction, and may be applied across diverse information-intensive applications.
△ Less
Submitted 12 July, 2016;
originally announced July 2016.
-
Probabilistic Archetypal Analysis
Authors:
Sohan Seth,
Manuel J. A. Eugster
Abstract:
Archetypal analysis represents a set of observations as convex combinations of pure patterns, or archetypes. The original geometric formulation of finding archetypes by approximating the convex hull of the observations assumes them to be real valued. This, unfortunately, is not compatible with many practical situations. In this paper we revisit archetypal analysis from the basic principles, and pr…
▽ More
Archetypal analysis represents a set of observations as convex combinations of pure patterns, or archetypes. The original geometric formulation of finding archetypes by approximating the convex hull of the observations assumes them to be real valued. This, unfortunately, is not compatible with many practical situations. In this paper we revisit archetypal analysis from the basic principles, and propose a probabilistic framework that accommodates other observation types such as integers, binary, and probability vectors. We corroborate the proposed methodology with convincing real-world applications on finding archetypal winter tourists based on binary survey data, archetypal disaster-affected countries based on disaster count data, and document archetypes based on term-frequency data. We also present an appropriate visualization tool to summarize archetypal analysis solution better.
△ Less
Submitted 7 April, 2014; v1 submitted 29 December, 2013;
originally announced December 2013.
-
A Plea for Neutral Comparison Studies in Computational Sciences
Authors:
Anne-Laure Boulesteix,
Manuel J. A. Eugster
Abstract:
In a context where most published articles are devoted to the development of "new methods", comparison studies are generally appreciated by readers but surprisingly given poor consideration by many scientific journals. In connection with recent articles on over-optimism and epistemology published in Bioinformatics, this letter stresses the importance of neutral comparison studies for the objective…
▽ More
In a context where most published articles are devoted to the development of "new methods", comparison studies are generally appreciated by readers but surprisingly given poor consideration by many scientific journals. In connection with recent articles on over-optimism and epistemology published in Bioinformatics, this letter stresses the importance of neutral comparison studies for the objective evaluation of existing methods and the establishment of standards by drawing parallels with clinical research.
△ Less
Submitted 13 August, 2012;
originally announced August 2012.
-
Archetypal Athletes
Authors:
Manuel J. A. Eugster
Abstract:
Discussions on outstanding---positively and/or negatively---athletes are common practice. The rapidly grown amount of collected sports data now allow to support such discussions with state of the art statistical methodology. Given a (multivariate) data set with collected data of athletes within a specific sport, outstanding athletes are values on the data set boundary. In the present paper we prop…
▽ More
Discussions on outstanding---positively and/or negatively---athletes are common practice. The rapidly grown amount of collected sports data now allow to support such discussions with state of the art statistical methodology. Given a (multivariate) data set with collected data of athletes within a specific sport, outstanding athletes are values on the data set boundary. In the present paper we propose archetypal analysis to compute these extreme values. The so-called archetypes, i.e., archetypal athletes, approximate the observations as convex combinations. We interpret the archetypal athletes and their characteristics, and, furthermore, the composition of all athletes based on the archetypal athletes. The application of archetypal analysis is demonstrated on basketball statistics and soccer skill ratings.
△ Less
Submitted 10 October, 2011;
originally announced October 2011.
