Surrogate-Based Optimization Techniques for Process Systems Engineering
Authors:
Mathias Neufang,
Emma Pajak,
Damien van de Berg,
Ye Seol Lee,
Ehecatl Antonio del Rio Chanona
Abstract:
Optimization plays an important role in chemical engineering, impacting cost-effectiveness, resource utilization, product quality, and process sustainability metrics. This chapter broadly focuses on data-driven optimization, particularly, on model-based derivative-free techniques, also known as surrogate-based optimization. The chapter introduces readers to the theory and practical considerations…
▽ More
Optimization plays an important role in chemical engineering, impacting cost-effectiveness, resource utilization, product quality, and process sustainability metrics. This chapter broadly focuses on data-driven optimization, particularly, on model-based derivative-free techniques, also known as surrogate-based optimization. The chapter introduces readers to the theory and practical considerations of various algorithms, complemented by a performance assessment across multiple dimensions, test functions, and two chemical engineering case studies: a stochastic high-dimensional reactor control study and a low-dimensional constrained stochastic reactor optimization study. This assessment sheds light on each algorithm's performance and suitability for diverse applications. Additionally, each algorithm is accompanied by background information, mathematical foundations, and algorithm descriptions. Among the discussed algorithms are Bayesian Optimization (BO), including state-of-the-art TuRBO, Constrained Optimization by Linear Approximation (COBYLA), the Ensemble Tree Model Optimization Tool (ENTMOOT) which uses decision trees as surrogates, Stable Noisy Optimization by Branch and Fit (SNOBFIT), methods that use radial basis functions such as DYCORS and SRBFStrategy, Constrained Optimization by Quadratic Approximations (COBYQA), as well as a few others recognized for their effectiveness in surrogate-based optimization. By combining theory with practice, this chapter equips readers with the knowledge to integrate surrogate-based optimization techniques into chemical engineering. The overarching aim is to highlight the advantages of surrogate-based optimization, introduce state-of-the-art algorithms, and provide guidance for successful implementation within process systems engineering.
△ Less
Submitted 18 December, 2024;
originally announced December 2024.
Hierarchical planning-scheduling-control -- Optimality surrogates and derivative-free optimization
Authors:
Damien van de Berg,
Nilay Shah,
Ehecatl Antonio del Rio-Chanona
Abstract:
Planning, scheduling, and control typically constitute separate decision-making units within chemical companies. Traditionally, their integration is modelled sequentially, but recent efforts prioritize lower-level feasibility and optimality, leading to large-scale, potentially multi-level, hierarchical formulations. Data-driven techniques, like optimality surrogates or derivative-free optimization…
▽ More
Planning, scheduling, and control typically constitute separate decision-making units within chemical companies. Traditionally, their integration is modelled sequentially, but recent efforts prioritize lower-level feasibility and optimality, leading to large-scale, potentially multi-level, hierarchical formulations. Data-driven techniques, like optimality surrogates or derivative-free optimization, become essential in addressing ensuing tractability challenges. We demonstrate a step-by-step workflow to find a tractable solution to a tri-level formulation of a multi-site, multi-product planning-scheduling-control case study. We discuss solution tractability-accuracy trade-offs and scaling properties for both methods. Despite individual improvements over conventional heuristics, both approaches present drawbacks. Consequently, we synthesize our findings into a methodology combining their strengths. Our approach remains agnostic to the level-specific formulations when the linking variables are identified and retains the heuristic sequential solution as fallback option. We advance the field by leveraging parallelization, hyperparameter tuning, and a combination of off- and on-line computation, to find tractable solutions to more accurate multi-level formulations.
△ Less
Submitted 11 October, 2023;
originally announced October 2023.