-
Maximizing information from chemical engineering data sets: Applications to machine learning
Authors:
Alexander Thebelt,
Johannes Wiebe,
Jan Kronqvist,
Calvin Tsay,
Ruth Misener
Abstract:
It is well-documented how artificial intelligence can have (and already is having) a big impact on chemical engineering. But classical machine learning approaches may be weak for many chemical engineering applications. This review discusses how challenging data characteristics arise in chemical engineering applications. We identify four characteristics of data arising in chemical engineering appli…
▽ More
It is well-documented how artificial intelligence can have (and already is having) a big impact on chemical engineering. But classical machine learning approaches may be weak for many chemical engineering applications. This review discusses how challenging data characteristics arise in chemical engineering applications. We identify four characteristics of data arising in chemical engineering applications that make applying classical artificial intelligence approaches difficult: (1) high variance, low volume data, (2) low variance, high volume data, (3) noisy/corrupt/missing data, and (4) restricted data with physics-based limitations. For each of these four data characteristics, we discuss applications where these data characteristics arise and show how current chemical engineering research is extending the fields of data science and machine learning to incorporate these challenges. Finally, we identify several challenges for future research.
△ Less
Submitted 24 January, 2022;
originally announced January 2022.
-
ROmodel: Modeling robust optimization problems in Pyomo
Authors:
Johannes Wiebe,
Ruth Misener
Abstract:
This paper introduces ROmodel, an open source Python package extending the modeling capabilities of the algebraic modeling language Pyomo to robust optimization problems. ROmodel helps practitioners transition from deterministic to robust optimization through modeling objects which allow formulating robust models in close analogy to their mathematical formulation. ROmodel contains a library of com…
▽ More
This paper introduces ROmodel, an open source Python package extending the modeling capabilities of the algebraic modeling language Pyomo to robust optimization problems. ROmodel helps practitioners transition from deterministic to robust optimization through modeling objects which allow formulating robust models in close analogy to their mathematical formulation. ROmodel contains a library of commonly used uncertainty sets which can be generated using their matrix representations, but it also allows users to define custom uncertainty sets using Pyomo constraints. ROmodel supports adjustable variables via linear decision rules. The resulting models can be solved using ROmodels solvers which implement both the robust reformulation and cutting plane approach. ROmodel is a platform to implement and compare custom uncertainty sets and reformulations. We demonstrate ROmodel's capabilities by applying it to six case studies. We implement custom uncertainty sets based on (warped) Gaussian processes to show how ROmodel can integrate data-driven models with optimization.
△ Less
Submitted 18 May, 2021;
originally announced May 2021.
-
A robust approach to warped Gaussian process-constrained optimization
Authors:
Johannes Wiebe,
Inês Cecílio,
Jonathan Dunlop,
Ruth Misener
Abstract:
Optimization problems with uncertain black-box constraints, modeled by warped Gaussian processes, have recently been considered in the Bayesian optimization setting. This work introduces a new class of constraints in which the same black-box function occurs multiple times evaluated at different domain points. Such constraints are important in applications where, e.g., safety-critical measures are…
▽ More
Optimization problems with uncertain black-box constraints, modeled by warped Gaussian processes, have recently been considered in the Bayesian optimization setting. This work introduces a new class of constraints in which the same black-box function occurs multiple times evaluated at different domain points. Such constraints are important in applications where, e.g., safety-critical measures are aggregated over multiple time periods. Our approach, which uses robust optimization, reformulates these uncertain constraints into deterministic constraints guaranteed to be satisfied with a specified probability, i.e., deterministic approximations to a chance constraint. This approach extends robust optimization methods from parametric uncertainty to uncertain functions modeled by warped Gaussian processes. We analyze convexity conditions and propose a custom global optimization strategy for non-convex cases. A case study derived from production planning and an industrially relevant example from oil well drilling show that the approach effectively mitigates uncertainty in the learned curves. For the drill scheduling example, we develop a custom strategy for globally optimizing integer decisions.
△ Less
Submitted 15 June, 2020;
originally announced June 2020.
-
Zeroes of quaternionic modular forms and central $L$-values
Authors:
Kimball Martin,
Jordan Wiebe
Abstract:
Values of quaternionic modular forms are related to twisted central $L$-values via periods and a theorem of Waldspurger. In particular, certain twisted $L$-values must be non-vanishing for forms with no zeroes. Here we study, theoretically and computationally, zeroes of definite quaternionic modular forms of trivial weight. Local sign conditions force certain forms to have trivial zeroes, but we c…
▽ More
Values of quaternionic modular forms are related to twisted central $L$-values via periods and a theorem of Waldspurger. In particular, certain twisted $L$-values must be non-vanishing for forms with no zeroes. Here we study, theoretically and computationally, zeroes of definite quaternionic modular forms of trivial weight. Local sign conditions force certain forms to have trivial zeroes, but we conjecture that almost all forms have no nontrivial zeroes. In particular, almost all forms with appropriate local signs should have no zeroes. We show these conjectures follow from a conjecture on the average number of Galois orbits, and give applications to (non)vanishing of $L$-values.
△ Less
Submitted 18 June, 2020; v1 submitted 9 January, 2020;
originally announced January 2020.
-
Approximation Algorithms for Process Systems Engineering
Authors:
Dimitrios Letsios,
Radu Baltean-Lugojan,
Francesco Ceccon,
Miten Mistry,
Johannes Wiebe,
Ruth Misener
Abstract:
Designing and analyzing algorithms with provable performance guarantees enables efficient optimization problem solving in different application domains, e.g.\ communication networks, transportation, economics, and manufacturing. Despite the significant contributions of approximation algorithms in engineering, only limited and isolated works contribute from this perspective in process systems engin…
▽ More
Designing and analyzing algorithms with provable performance guarantees enables efficient optimization problem solving in different application domains, e.g.\ communication networks, transportation, economics, and manufacturing. Despite the significant contributions of approximation algorithms in engineering, only limited and isolated works contribute from this perspective in process systems engineering. The current paper discusses three representative, NP-hard problems in process systems engineering: (i) pooling, (ii) process scheduling, and (iii) heat exchanger network synthesis. We survey relevant results and raise major open questions. Further, we present approximation algorithms applications which are relevant to process systems engineering: (i) better mathematical modeling, (ii) problem classification, (iii) designing solution methods, and (iv) dealing with uncertainty. This paper aims to motivate further research at the intersection of approximation algorithms and process systems engineering.
△ Less
Submitted 26 September, 2019;
originally announced September 2019.
-
Robust optimization for the pooling problem
Authors:
Johannes Wiebe,
Inês Cecílio,
Ruth Misener
Abstract:
The pooling problem has applications, e.g., in petrochemical refining, water networks, and supply chains and is widely studied in global optimization. To date, it has largely been treated deterministically, neglecting the influence of parametric uncertainty. This paper applies two robust optimization approaches, reformulation and cutting planes, to the non-linear, non-convex pooling problem. Most…
▽ More
The pooling problem has applications, e.g., in petrochemical refining, water networks, and supply chains and is widely studied in global optimization. To date, it has largely been treated deterministically, neglecting the influence of parametric uncertainty. This paper applies two robust optimization approaches, reformulation and cutting planes, to the non-linear, non-convex pooling problem. Most applications of robust optimization have been either convex or mixed-integer linear problems. We explore the suitability of robust optimization in the context of global optimization problems which are concave in the uncertain parameters by considering the pooling problem with uncertain inlet concentrations. We compare the computational efficiency of reformulation and cutting plane approaches for three commonly-used uncertainty set geometries on 14 pooling problem instances and demonstrate how accounting for uncertainty changes the optimal solution.
△ Less
Submitted 18 June, 2019;
originally announced June 2019.
-
Data-driven optimization of processes with degrading equipment
Authors:
Johannes Wiebe,
Inês Cecílio,
Ruth Misener
Abstract:
In chemical and manufacturing processes, unit failures due to equipment degradation can lead to process downtime and significant costs. In this context, finding an optimal maintenance strategy to ensure good unit health while avoiding excessive expensive maintenance activities is highly relevant. We propose a practical approach for the integrated optimization of production and maintenance capable…
▽ More
In chemical and manufacturing processes, unit failures due to equipment degradation can lead to process downtime and significant costs. In this context, finding an optimal maintenance strategy to ensure good unit health while avoiding excessive expensive maintenance activities is highly relevant. We propose a practical approach for the integrated optimization of production and maintenance capable of incorporating uncertain sensor data regarding equipment degradation. To this end, we integrate data-driven stochastic degradation models from Condition-based Maintenance into a process level mixed-integer optimization problem using Robust Optimization. We reduce computational expense by utilizing both analytical and data-based approximations and optimize the Robust optimization parameters using Bayesian Optimization. We apply our framework to five instances of the State-Task-Network and demonstrate that it can efficiently compromise between equipment availability and cost of maintenance.
△ Less
Submitted 24 January, 2019; v1 submitted 22 October, 2018;
originally announced October 2018.
-
Constructing non-maximal orders in quaternion algebras
Authors:
Jordan Wiebe
Abstract:
We present an explicit basis for orders of arbitrary level N>1 in definite rational quaternion algebras. These orders have applications to computations of spaces of elliptic and quaternionic modular forms.
We present an explicit basis for orders of arbitrary level N>1 in definite rational quaternion algebras. These orders have applications to computations of spaces of elliptic and quaternionic modular forms.
△ Less
Submitted 11 October, 2018;
originally announced October 2018.
