Skip to main content

Showing 1–19 of 19 results for author: Roustant, O

Searching in archive stat. Search in all archives.
.
  1. arXiv:2503.15922  [pdf, ps, other

    math.ST stat.ML

    General reproducing properties in RKHS with application to derivative and integral operators

    Authors: Fatima-Zahrae El-Boukkouri, Josselin Garnier, Olivier Roustant

    Abstract: In this paper, we consider the reproducing property in Reproducing Kernel Hilbert Spaces (RKHS). We establish a reproducing property for the closure of the class of combinations of composition operators under minimal conditions. This allows to revisit the sufficient conditions for the reproducing property to hold for the derivative operator, as well as for the existence of the mean embedding funct… ▽ More

    Submitted 31 March, 2025; v1 submitted 20 March, 2025; originally announced March 2025.

  2. arXiv:2407.13402  [pdf, other

    stat.ME

    Block-Additive Gaussian Processes under Monotonicity Constraints

    Authors: M. Deronzier, A. F. López-Lopera, F. Bachoc, O. Roustant, J. Rohmer

    Abstract: We generalize the additive constrained Gaussian process framework to handle interactions between input variables while enforcing monotonicity constraints everywhere on the input space. The block-additive structure of the model is particularly suitable in the presence of interactions, while maintaining tractable computations. In addition, we develop a sequential algorithm, MaxMod, for model selecti… ▽ More

    Submitted 21 January, 2025; v1 submitted 18 July, 2024; originally announced July 2024.

    Comments: 33 pages, 9 figures

  3. arXiv:2205.08528  [pdf, other

    stat.ML cs.LG

    High-dimensional additive Gaussian processes under monotonicity constraints

    Authors: Andrés F. López-Lopera, François Bachoc, Olivier Roustant

    Abstract: We introduce an additive Gaussian process framework accounting for monotonicity constraints and scalable to high dimensions. Our contributions are threefold. First, we show that our framework enables to satisfy the constraints everywhere in the input space. We also show that more general componentwise linear inequality constraints can be handled similarly, such as componentwise convexity. Second,… ▽ More

    Submitted 17 May, 2022; originally announced May 2022.

  4. arXiv:2111.01533  [pdf, other

    math.OC cs.LG stat.AP stat.CO stat.ML

    A comparison of mixed-variables Bayesian optimization approaches

    Authors: Jhouben Cuesta-Ramirez, Rodolphe Le Riche, Olivier Roustant, Guillaume Perrin, Cedric Durantin, Alain Gliere

    Abstract: Most real optimization problems are defined over a mixed search space where the variables are both discrete and continuous. In engineering applications, the objective function is typically calculated with a numerically costly black-box simulation.General mixed and costly optimization problems are therefore of a great practical interest, yet their resolution remains in a large part an open scientif… ▽ More

    Submitted 3 May, 2022; v1 submitted 30 October, 2021; originally announced November 2021.

    Comments: Accepted for publication in Advanced Modeling and Simulation in Engineering Sciences, march 2022

  5. arXiv:2107.00394  [pdf, other

    stat.CO math.CA math.NA math.ST

    Global sensitivity analysis using derivative-based sparse Poincaré chaos expansions

    Authors: Nora Lüthen, Olivier Roustant, Fabrice Gamboa, Bertrand Iooss, Stefano Marelli, Bruno Sudret

    Abstract: Variance-based global sensitivity analysis, in particular Sobol' analysis, is widely used for determining the importance of input variables to a computational model. Sobol' indices can be computed cheaply based on spectral methods like polynomial chaos expansions (PCE). Another choice are the recently developed Poincaré chaos expansions (PoinCE), whose orthonormal tensor-product basis is generated… ▽ More

    Submitted 9 June, 2023; v1 submitted 1 July, 2021; originally announced July 2021.

    Report number: RSUQ-2021-004C

    Journal ref: International Journal for Uncertainty Quantification, vol. 13 (6), 57-82, 2023

  6. arXiv:2005.10285  [pdf, other

    stat.ME

    Functional principal component analysis for global sensitivity analysis of model with spatial output

    Authors: T. V. E. Perrin, O. Roustant, J. Rohmer, O. Alata, J. P. Naulin, D. Idier, R. Pedreros, D. Moncoulon, P. Tinard

    Abstract: Motivated by risk assessment of coastal flooding, we consider time-consuming simulators with a spatial output. The aim is to perform sensitivity analysis (SA), quantifying the influence of input parameters on the output. There are three main issues. First, due to computational time, standard SA techniques cannot be directly applied on the simulator. Second, the output is infinite dimensional, or a… ▽ More

    Submitted 4 January, 2021; v1 submitted 20 May, 2020; originally announced May 2020.

    Comments: 26 pages, 12 figures, 1 algoritm

  7. Approximating Gaussian Process Emulators with Linear Inequality Constraints and Noisy Observations via MC and MCMC

    Authors: Andrés F. López-Lopera, François Bachoc, Nicolas Durrande, Jérémy Rohmer, Déborah Idier, Olivier Roustant

    Abstract: Adding inequality constraints (e.g. boundedness, monotonicity, convexity) into Gaussian processes (GPs) can lead to more realistic stochastic emulators. Due to the truncated Gaussianity of the posterior, its distribution has to be approximated. In this work, we consider Monte Carlo (MC) and Markov Chain Monte Carlo (MCMC) methods. However, strictly interpolating the observations may entail expensi… ▽ More

    Submitted 21 June, 2019; v1 submitted 15 January, 2019; originally announced January 2019.

  8. arXiv:1802.02368  [pdf, other

    math.ST stat.ME

    Group kernels for Gaussian process metamodels with categorical inputs

    Authors: Olivier Roustant, Esperan Padonou, Yves Deville, Aloïs Clément, Guillaume Perrin, Jean Giorla, Henry Wynn

    Abstract: Gaussian processes (GP) are widely used as a metamodel for emulating time-consuming computer codes. We focus on problems involving categorical inputs, with a potentially large number L of levels (typically several tens), partitioned in G << L groups of various sizes. Parsimonious covariance functions, or kernels, can then be defined by block covariance matrices T with constant covariances between… ▽ More

    Submitted 24 July, 2018; v1 submitted 7 February, 2018; originally announced February 2018.

  9. arXiv:1710.07453  [pdf, other

    stat.ML cs.LG

    Finite-dimensional Gaussian approximation with linear inequality constraints

    Authors: Andrés F. López-Lopera, François Bachoc, Nicolas Durrande, Olivier Roustant

    Abstract: Introducing inequality constraints in Gaussian process (GP) models can lead to more realistic uncertainties in learning a great variety of real-world problems. We consider the finite-dimensional Gaussian approach from Maatouk and Bay (2017) which can satisfy inequality conditions everywhere (either boundedness, monotonicity or convexity). Our contributions are threefold. First, we extend their app… ▽ More

    Submitted 20 October, 2017; originally announced October 2017.

  10. arXiv:1704.05318  [pdf, other

    math.OC stat.ME stat.ML

    On the choice of the low-dimensional domain for global optimization via random embeddings

    Authors: Mickaël Binois, David Ginsbourger, Olivier Roustant

    Abstract: The challenge of taking many variables into account in optimization problems may be overcome under the hypothesis of low effective dimensionality. Then, the search of solutions can be reduced to the random embedding of a low dimensional space into the original one, resulting in a more manageable optimization problem. Specifically, in the case of time consuming black-box functions and when the budg… ▽ More

    Submitted 22 October, 2018; v1 submitted 18 April, 2017; originally announced April 2017.

  11. arXiv:1612.03689  [pdf, other

    math.ST math.PR stat.ML

    Poincaré inequalities on intervals -- application to sensitivity analysis

    Authors: Olivier Roustant, Franck Barthe, Bertrand Iooss

    Abstract: The development of global sensitivity analysis of numerical model outputs has recently raised new issues on 1-dimensional Poincaré inequalities. Typically two kind of sensitivity indices are linked by a Poincaré type inequality, which provide upper bounds of the most interpretable index by using the other one, cheaper to compute. This allows performing a low-cost screening of unessential variables… ▽ More

    Submitted 12 December, 2016; originally announced December 2016.

  12. arXiv:1512.07560  [pdf, other

    stat.AP math.ST

    Universal Prediction Distribution for Surrogate Models

    Authors: Malek Ben Salem, Olivier Roustant, Fabrice Gamboa, Lionel Tomaso

    Abstract: The use of surrogate models instead of computationally expensive simulation codes is very convenient in engineering. Roughly speaking, there are two kinds of surrogate models: the deterministic and the probabilistic ones. These last are generally based on Gaussian assumptions. The main advantage of probabilistic approach is that it provides a measure of uncertainty associated with the surrogate… ▽ More

    Submitted 23 December, 2015; originally announced December 2015.

  13. arXiv:1411.3685  [pdf, other

    math.OC stat.ML

    A warped kernel improving robustness in Bayesian optimization via random embeddings

    Authors: Mickaël Binois, David Ginsbourger, Olivier Roustant

    Abstract: This works extends the Random Embedding Bayesian Optimization approach by integrating a warping of the high dimensional subspace within the covariance kernel. The proposed warping, that relies on elementary geometric considerations, allows mitigating the drawbacks of the high extrinsic dimensionality while avoiding the algorithm to evaluate points giving redundant information. It also alleviates c… ▽ More

    Submitted 18 March, 2015; v1 submitted 13 November, 2014; originally announced November 2014.

  14. arXiv:1410.0403  [pdf, other

    stat.ME stat.OT

    Computer experiments with functional inputs and scalar outputs by a norm-based approach

    Authors: Thomas Muehlenstaedt, Jana Fruth, Olivier Roustant

    Abstract: A framework for designing and analyzing computer experiments is presented, which is constructed for dealing with functional and real number inputs and real number outputs. For designing experiments with both functional and real number inputs a two stage approach is suggested. The first stage consists of constructing a candidate set for each functional input and during the second stage an optimal c… ▽ More

    Submitted 1 October, 2014; originally announced October 2014.

  15. arXiv:1308.1359  [pdf, other

    math.ST math.PR stat.ME stat.ML

    Invariances of random fields paths, with applications in Gaussian Process Regression

    Authors: David Ginsbourger, Olivier Roustant, Nicolas Durrande

    Abstract: We study pathwise invariances of centred random fields that can be controlled through the covariance. A result involving composition operators is obtained in second-order settings, and we show that various path properties including additivity boil down to invariances of the covariance kernel. These results are extended to a broader class of operators in the Gaussian case, via the Loève isometry. S… ▽ More

    Submitted 6 August, 2013; originally announced August 2013.

  16. arXiv:1111.6233  [pdf, ps, other

    stat.ML

    Additive Covariance Kernels for High-Dimensional Gaussian Process Modeling

    Authors: Nicolas Durrande, David Ginsbourger, Olivier Roustant, Laurent Carraro

    Abstract: Gaussian process models -also called Kriging models- are often used as mathematical approximations of expensive experiments. However, the number of observation required for building an emulator becomes unrealistic when using classical covariance kernels when the dimension of input increases. In oder to get round the curse of dimensionality, a popular approach is to consider simplified models such… ▽ More

    Submitted 27 November, 2011; originally announced November 2011.

    Comments: arXiv admin note: substantial text overlap with arXiv:1103.4023

    Journal ref: Annales de la Faculté de Sciences de Toulouse Tome 21, numéro 3 (2012) p. 481-499

  17. arXiv:1106.3571  [pdf, ps, other

    stat.ML

    ANOVA kernels and RKHS of zero mean functions for model-based sensitivity analysis

    Authors: Nicolas Durrande, David Ginsbourger, Olivier Roustant, Laurent Carraro

    Abstract: Given a reproducing kernel Hilbert space H of real-valued functions and a suitable measure mu over the source space D (subset of R), we decompose H as the sum of a subspace of centered functions for mu and its orthogonal in H. This decomposition leads to a special case of ANOVA kernels, for which the functional ANOVA representation of the best predictor can be elegantly derived, either in an inter… ▽ More

    Submitted 7 December, 2012; v1 submitted 17 June, 2011; originally announced June 2011.

    Journal ref: Journal of Multivariate Analysis 115 (2013) 57-67

  18. arXiv:1103.4023  [pdf, ps, other

    stat.ML

    Additive Kernels for Gaussian Process Modeling

    Authors: Nicolas Durrande, David Ginsbourger, Olivier Roustant

    Abstract: Gaussian Process (GP) models are often used as mathematical approximations of computationally expensive experiments. Provided that its kernel is suitably chosen and that enough data is available to obtain a reasonable fit of the simulator, a GP model can beneficially be used for tasks such as prediction, optimization, or Monte-Carlo-based quantification of uncertainty. However, the former conditio… ▽ More

    Submitted 21 March, 2011; originally announced March 2011.

  19. arXiv:0802.1008  [pdf, ps, other

    stat.ME math.ST

    Calculations of Sobol indices for the Gaussian process metamodel

    Authors: Amandine Marrel, Bertrand Iooss, Beatrice Laurent, Olivier Roustant

    Abstract: Global sensitivity analysis of complex numerical models can be performed by calculating variance-based importance measures of the input variables, such as the Sobol indices. However, these techniques, requiring a large number of model evaluations, are often unacceptable for time expensive computer codes. A well known and widely used decision consists in replacing the computer code by a metamodel… ▽ More

    Submitted 7 February, 2008; originally announced February 2008.