Showing 1–19 of 19 results for author: Hwang, J T

Spline Dimensional Decomposition with Interpolation-based Optimal Knot Selection for Stochastic Dynamic Analysis

Authors: Yeonsu Kim, Junhan Lee, Bingran Wang, John T. Hwang, Dongjin Lee

Abstract: Forward uncertainty quantification in dynamical systems is challenging due to non-smooth or locally oscillating nonlinear behaviors. Spline dimensional decomposition (SDD) addresses such nonlinearity by partitioning input coordinates via knot placement, but its accuracy is highly sensitive to internal knot locations. Optimizing knots using sequential quadratic programming is effective, yet computa… ▽ More Forward uncertainty quantification in dynamical systems is challenging due to non-smooth or locally oscillating nonlinear behaviors. Spline dimensional decomposition (SDD) addresses such nonlinearity by partitioning input coordinates via knot placement, but its accuracy is highly sensitive to internal knot locations. Optimizing knots using sequential quadratic programming is effective, yet computationally expensive. We propose a computationally efficient, interpolation-based method for optimal knot selection in SDD. The method includes: (1) interpolating input-output profiles, (2) defining subinterval-based reference regions, and (3) selecting knots at maximum gradient points within each region. The resulting knot vector is then applied to SDD for accurate approximation of non-smooth and oscillatory responses. A modal analysis of a lower control arm shows that SDD with the proposed knots yields higher accuracy than SDD with uniformly or randomly spaced knots and a Gaussian process model. In this example, the proposed SDD achieves the lowest relative variance error (2.89%) for the first natural frequency distribution, compared to uniformly spaced knots (12.310%), randomly spaced knots (15.274%), and Gaussian process (5.319%). All surrogates are constructed using the same 401 simulation datasets, and errors are evaluated against a 2000-sample Monte Carlo simulation. Scalability and applicability are demonstrated through stochastic and reliability analyses of one- and three-dimensional benchmark functions, and a ten-dimensional lower control arm model. Results confirm that second-moment statistics and reliability estimates can be accurately obtained with only a few hundred function evaluations or finite element simulations. △ Less

Submitted 16 June, 2025; v1 submitted 19 May, 2025; originally announced May 2025.

Comments: 28 pages, 15 figures

A comparative study of uncertainty quantification methods in gust response analysis of a Lift-Plus-Cruise eVTOL aircraft wing

Authors: Bingran Wang, Michael Warner, Aoran Tian, Luca Scotzniovsky, John T. Hwang

Abstract: Wind gusts, being inherently stochastic, can significantly influence the safety and performance of aircraft. This study investigates a three-dimensional uncertainty quantification (UQ) problem to explore how uncertainties in gust and flight conditions affect the structural response of a Lift-Plus-Cruise eVTOL aircraft wing. The analysis employs an unsteady aeroelastic model with a one-way coupling… ▽ More Wind gusts, being inherently stochastic, can significantly influence the safety and performance of aircraft. This study investigates a three-dimensional uncertainty quantification (UQ) problem to explore how uncertainties in gust and flight conditions affect the structural response of a Lift-Plus-Cruise eVTOL aircraft wing. The analysis employs an unsteady aeroelastic model with a one-way coupling between a panel method aerodynamic solver and a shell analysis structural solver to predict the wing's response under varying conditions. Additionally, this paper presents a comparative evaluation of commonly used non-intrusive UQ methods, including non-intrusive polynomial chaos, kriging, Monte Carlo, univariate dimension reduction, and gradient-enhanced univariate dimension reduction. These methods are assessed based on their effectiveness in estimating various risk measures-mean, standard deviation, and 95th percentile-of critical structural response outputs such as maximum tip displacement and average strain energy. The numerical results reveal significant variability in the structural response outputs, even under relatively small ranges of uncertain inputs. This highlights the sensitivity of the system to uncertainties in gust and flight conditions. Furthermore, the performance of the implemented UQ methods varies significantly depending on the specific risk measures and the quantity of interest being analyzed. △ Less

Submitted 7 January, 2025; originally announced January 2025.

Design optimization of semiconductor manufacturing equipment using a novel multi-fidelity surrogate modeling approach

Authors: Bingran Wang, Min Sung Kim, Taewoong Yoon, Dasom Lee, Byeong-Sang Kim, Dougyong Sung, John T. Hwang

Abstract: Careful design of semiconductor manufacturing equipment is crucial for ensuring the performance, yield, and reliability of semiconductor devices. Despite this, numerical optimization methods are seldom applied to optimize the design of such equipment due to the difficulty of obtaining accurate simulation models. In this paper, we address a practical and industrially relevant electrostatic chuck (E… ▽ More Careful design of semiconductor manufacturing equipment is crucial for ensuring the performance, yield, and reliability of semiconductor devices. Despite this, numerical optimization methods are seldom applied to optimize the design of such equipment due to the difficulty of obtaining accurate simulation models. In this paper, we address a practical and industrially relevant electrostatic chuck (ESC) design optimization problem by proposing a novel multi-fidelity surrogate modeling approach. The optimization aims to improve the temperature uniformity of the wafer during the etching process by adjusting seven parameters associated with the coolant path and embossing. Our approach combines low-fidelity (LF) and high-fidelity (HF) simulation data to efficiently predict spatial-field quantities, even with a limited number of data points. We use proper orthogonal decomposition (POD) to project the spatially interpolated HF and LF field data onto a shared latent space, followed by the construction of a multi-fidelity kriging model to predict the latent variables of the HF output field. In the ESC design problem, with hundreds or fewer data, our approach achieves a more than 10% reduction in prediction error compared to using kriging models with only HF or LF data. Additionally, in the ESC optimization problem, our proposed method yields better solutions with improvements in all of the quantities of interest, while requiring 20% less data generation cost compared to the HF surrogate modeling approach. △ Less

Submitted 12 November, 2024; originally announced November 2024.

modOpt: A modular development environment and library for optimization algorithms

Authors: Anugrah Jo Joshy, John T. Hwang

Abstract: Recent advances in computing hardware and modeling software have given rise to new applications for numerical optimization. These new applications occasionally uncover bottlenecks in existing optimization algorithms and necessitate further specialization of the algorithms. However, such specialization requires expert knowledge of the underlying mathematical theory and the software implementation o… ▽ More Recent advances in computing hardware and modeling software have given rise to new applications for numerical optimization. These new applications occasionally uncover bottlenecks in existing optimization algorithms and necessitate further specialization of the algorithms. However, such specialization requires expert knowledge of the underlying mathematical theory and the software implementation of existing algorithms. To address this challenge, we present modOpt, an open-source software framework that facilitates the construction of optimization algorithms from modules. The modular environment provided by modOpt enables developers to tailor an existing algorithm for a new application by only altering the relevant modules. modOpt is designed as a platform to support students and beginner developers in quickly learning and developing their own algorithms. With that aim, the entirety of the framework is written in Python, and it is well-documented, well-tested, and hosted open-source on GitHub. Several additional features are embedded into the framework to assist both beginner and advanced developers. In addition to providing stock modules, the framework also includes fully transparent implementations of pedagogical optimization algorithms in Python. To facilitate testing and benchmarking of new algorithms, the framework features built-in visualization and recording capabilities, interfaces to modeling frameworks such as OpenMDAO and CSDL, interfaces to general-purpose optimization algorithms such as SNOPT and SLSQP, an interface to the CUTEst test problem set, etc. In this paper, we present the underlying software architecture of modOpt, review its various features, discuss several educational and performance-oriented algorithms within modOpt, and present numerical studies illustrating its unique benefits. △ Less

Submitted 16 October, 2024; originally announced October 2024.

Comments: 37 pages with 13 figures. For associated code, see https://github.com/LSDOlab/modopt

ACM Class: D.2.2; D.2.13; G.1.6; G.4; J.2

Open-source shape optimization for isogeometric shells using FEniCS and OpenMDAO

Authors: Han Zhao, John T. Hwang, Jiun-Shyan Chen

Abstract: We present an open-source Python framework for the shape optimization of complex shell structures using isogeometric analysis (IGA). IGA seamlessly integrates computer-aided design (CAD) and analysis models by employing non-uniform rational B-splines (NURBS) as basis functions, enabling the natural implementation of the Kirchhoff--Love shell model due to their higher order of continuity. We levera… ▽ More We present an open-source Python framework for the shape optimization of complex shell structures using isogeometric analysis (IGA). IGA seamlessly integrates computer-aided design (CAD) and analysis models by employing non-uniform rational B-splines (NURBS) as basis functions, enabling the natural implementation of the Kirchhoff--Love shell model due to their higher order of continuity. We leverage the recently developed FEniCS-based analysis framework, PENGoLINS, for the direct structural analysis of shell structures consisting of a collection of NURBS patches through a penalty-based formulation. This contribution introduces the open-source implementation of gradient-based shape optimization for isogeometric Kirchhoff--Love shells with a modular architecture. Complex shell structures with non-matching intersections are handled using a free-form deformation (FFD) approach and a moving intersections formulation. The symbolic differentiation and code generation capabilities in FEniCS are utilized to compute the analytical derivatives. By integrating FEniCS with OpenMDAO, we build modular components that facilitate gradient-based shape optimization of shell structures. The modular architecture in this work supports future extensions and integration with other disciplines and solvers, making it highly customizable and suitable for a wide range of applications. We validate the design-analysis-optimization workflow through several benchmark problems and demonstrate its application to aircraft wing design optimization. The framework is implemented in a Python library named GOLDFISH (Gradient-based Optimization and Large-scale Design Framework for Isogeometric SHells) and the source code will be maintained at https://github.com/hanzhao2020/GOLDFISH. △ Less

Submitted 4 February, 2025; v1 submitted 3 October, 2024; originally announced October 2024.

Comments: 39 pages, 14 figures

PySLSQP: A transparent Python package for the SLSQP optimization algorithm modernized with utilities for visualization and post-processing

Authors: Anugrah Jo Joshy, John T. Hwang

Abstract: PySLSQP is a seamless interface for using the SLSQP algorithm from Python. It wraps the original SLSQP Fortran code sourced from the SciPy repository and provides a host of new features to improve the research utility of the original algorithm. Some of the additional features offered by PySLSQP include auto-generation of unavailable derivatives using finite differences, independent scaling of the… ▽ More PySLSQP is a seamless interface for using the SLSQP algorithm from Python. It wraps the original SLSQP Fortran code sourced from the SciPy repository and provides a host of new features to improve the research utility of the original algorithm. Some of the additional features offered by PySLSQP include auto-generation of unavailable derivatives using finite differences, independent scaling of the problem variables and functions, access to internal optimization data, live-visualization, saving optimization data from each iteration, warm/hot restarting of optimization, and various other utilities for post-processing. △ Less

Submitted 23 August, 2024; originally announced August 2024.

Comments: 9 pages with 2 figures. For associated code, see https://github.com/anugrahjo/PySLSQP

ACM Class: G.1.6; J.2

Shape optimization of non-matching isogeometric shells with moving intersections

Authors: Han Zhao, John T. Hwang, J. S. Chen

Abstract: While shape optimization using isogeometric shells exhibits appealing features by integrating design geometries and analysis models, challenges arise when addressing computer-aided design (CAD) geometries comprised of multiple non-uniform rational B-splines (NURBS) patches, which are common in practice. The intractability stems from surface intersections within these CAD models. In this paper, we… ▽ More While shape optimization using isogeometric shells exhibits appealing features by integrating design geometries and analysis models, challenges arise when addressing computer-aided design (CAD) geometries comprised of multiple non-uniform rational B-splines (NURBS) patches, which are common in practice. The intractability stems from surface intersections within these CAD models. In this paper, we develop an approach for shape optimization of non-matching isogeometric shells incorporating intersection movement. Separately parametrized NURBS surfaces are modeled using Kirchhoff--Love shell theory and coupled using a penalty-based formulation. The optimization scheme allows shell patches to move without preserving relative location with other members during the shape optimization. This flexibility is achieved through an implicit state function, and analytical sensitivities are derived for the relative movement of shell patches. The introduction of differentiable intersections expands the design space and overcomes challenges associated with large mesh distortion, particularly when optimal shapes involve significant movement of patch intersections in physical space. Throughout optimization iterations, all members within the shell structures maintain the NURBS geometry representation, enabling efficient integration of analysis and design models. The optimization approach leverages the multilevel design concept by selecting a refined model for accurate analysis from a coarse design model while maintaining the same geometry. We adopt several example problems to verify the effectiveness of the proposed scheme and demonstrate its applicability to the optimization of the internal stiffeners of an aircraft wing. △ Less

Submitted 28 June, 2024; originally announced July 2024.

Comments: 41 pages, 18 figures

Extension of graph-accelerated non-intrusive polynomial chaos to high-dimensional uncertainty quantification through the active subspace method

Authors: Bingran Wang, Nicholas C. Orndorff, Mark Sperry, John T. Hwang

Abstract: The recently introduced graph-accelerated non-intrusive polynomial chaos (NIPC) method has shown effectiveness in solving a broad range of uncertainty quantification (UQ) problems with multidisciplinary systems. It uses integration-based NIPC to solve the UQ problem and generates the quadrature rule in a desired tensor structure, so that the model evaluations can be efficiently accelerated through… ▽ More The recently introduced graph-accelerated non-intrusive polynomial chaos (NIPC) method has shown effectiveness in solving a broad range of uncertainty quantification (UQ) problems with multidisciplinary systems. It uses integration-based NIPC to solve the UQ problem and generates the quadrature rule in a desired tensor structure, so that the model evaluations can be efficiently accelerated through the computational graph transformation method, Accelerated Model evaluations on Tensor grids using Computational graph transformations (AMTC). This method is efficient when the model's computational graph possesses a certain type of sparsity which is commonly the case in multidisciplinary problems. However, it faces limitations in high-dimensional cases due to the curse of dimensionality. To broaden its applicability in high-dimensional UQ problems, we propose AS-AMTC, which integrates the AMTC approach with the active subspace (AS) method, a widely-used dimension reduction technique. In developing this new method, we have also developed AS-NIPC, linking integration-based NIPC with the AS method for solving high-dimensional UQ problems. AS-AMTC incorporates rigorous approaches to generate orthogonal polynomial basis functions for lower-dimensional active variables and efficient quadrature rules to estimate their coefficients. The AS-AMTC method extends AS-NIPC by generating a quadrature rule with a desired tensor structure. This allows the AMTC method to exploit the computational graph sparsity, leading to efficient model evaluations. In an 81-dimensional UQ problem derived from an air-taxi trajectory optimization scenario, AS-NIPC demonstrates a 30% decrease in relative error compared to the existing methods, while AS-AMTC achieves an 80% reduction. △ Less

Submitted 9 May, 2024; originally announced May 2024.

Air-taxi trajectory optimization with aerodynamic and motor models

Authors: Nicholas C. Orndorff, John T. Hwang

Abstract: To fulfill the vision for large-scale urban air mobility, air-taxi concepts must be carefully designed and optimized for their intended mission. Proposed air-taxi missions contain dynamic segments that are dominated by nonlinear dynamics. One such segment is the transition to and from hover and cruise that occurs at the start and end of the mission. Because this transition involves low-altitude an… ▽ More To fulfill the vision for large-scale urban air mobility, air-taxi concepts must be carefully designed and optimized for their intended mission. Proposed air-taxi missions contain dynamic segments that are dominated by nonlinear dynamics. One such segment is the transition to and from hover and cruise that occurs at the start and end of the mission. Because this transition involves low-altitude and high-power flight, analyzing transition trajectories is critical for safe and economical urban air mobility. Optimization of the transition maneuver requires an optimal control approach that characterizes the trajectories of the system states through time. In this paper we solve this optimal control problem for air-taxi transition within a large-scale design-optimization framework. This framework allows us to include five physics-based models that describe flight dynamics, rotor aerodynamics, wing aerodynamics, motor performance, and acoustics with which we create a low-fidelity model of NASA's Lift-plus-Cruise air-taxi concept. We use this optimization problem formulation to compute transition trajectories that minimize time or minimize energy. Our results show that the Lift-plus-Cruise aircraft completes a minimum-energy transition in 80s with an energy expenditure of 13.3MJ and a minimum-time transition in 28s with an energy expenditure of 16.4MJ. We find that these trajectories contain large pitch angles and high sound pressure levels which are both undesirable for practical urban air mobility. Consequently, we explore trajectories that include pitch angle and acoustic constraints, and find that minimum time trajectories are significantly more affected by these constraints than minimum energy trajectories. △ Less

Submitted 5 April, 2025; v1 submitted 23 April, 2024; originally announced April 2024.

A gradient-enhanced univariate dimension reduction method for uncertainty propagation

Authors: Bingran Wang, Nicholas C. Orndorff, Mark Sperry, John T. Hwang

Abstract: The univariate dimension reduction (UDR) method stands as a way to estimate the statistical moments of the output that is effective in a large class of uncertainty quantification (UQ) problems. UDR's fundamental strategy is to approximate the original function using univariate functions so that the UQ cost only scales linearly with the dimension of the problem. Nonetheless, UDR's effectiveness can… ▽ More The univariate dimension reduction (UDR) method stands as a way to estimate the statistical moments of the output that is effective in a large class of uncertainty quantification (UQ) problems. UDR's fundamental strategy is to approximate the original function using univariate functions so that the UQ cost only scales linearly with the dimension of the problem. Nonetheless, UDR's effectiveness can diminish when uncertain inputs have high variance, particularly when assessing the output's second and higher-order statistical moments. This paper proposes a new method, gradient-enhanced univariate dimension reduction (GUDR), that enhances the accuracy of UDR by incorporating univariate gradient function terms into the UDR approximation function. Theoretical results indicate that the GUDR approximation is expected to be one order more accurate than UDR in approximating the original function, and it is expected to generate more accurate results in computing the output's second and higher-order statistical moments. Our proposed method uses a computational graph transformation strategy to efficiently evaluate the GUDR approximation function on tensor-grid quadrature inputs, and use the tensor-grid input-output data to compute the statistical moments of the output. With an efficient automatic differentiation method to compute the gradients, our method preserves UDR's linear scaling of computation time with problem dimension. Numerical results show that the GUDR is more accurate than UDR in estimating the standard deviation of the output and has a performance comparable to the method of moments using a third-order Taylor series expansion. △ Less

Submitted 15 October, 2024; v1 submitted 22 March, 2024; originally announced March 2024.

Journal ref: Aerospace Science and Technology vol. 155, 2024, 109602

Graph-accelerated non-intrusive polynomial chaos expansion using partially tensor-structured quadrature rules for uncertainty quantification

Authors: Bingran Wang, Nicholas C. Orndorff, John T. Hwang

Abstract: Recently, the graph-accelerated non-intrusive polynomial chaos (NIPC) method has been proposed for solving uncertainty quantification (UQ) problems. This method leverages the full-grid integration-based NIPC method to address UQ problems while employing the computational graph transformation approach, AMTC, to accelerate the tensor-grid evaluations. This method exhibits remarkable efficacy on a br… ▽ More Recently, the graph-accelerated non-intrusive polynomial chaos (NIPC) method has been proposed for solving uncertainty quantification (UQ) problems. This method leverages the full-grid integration-based NIPC method to address UQ problems while employing the computational graph transformation approach, AMTC, to accelerate the tensor-grid evaluations. This method exhibits remarkable efficacy on a broad range of low-dimensional (three dimensions or less) UQ problems featuring multidisciplinary models. However, it often does not scale well with problem dimensions due to the exponential increase in the number of quadrature points when using the full-grid quadrature rule. To expand the applicability of this method to a broader range of UQ problems, this paper introduces a new framework for generating a tailored, partially tensor-structured quadrature rule to use with the graph-accelerated NIPC method. This quadrature rule, generated through the designed quadrature approach, possesses a tensor structure that is tailored for the computational model. The selection of the tensor structure is guided by an analysis of the computational graph, ensuring that the quadrature rule effectively capitalizes on the sparsity within the computational graph when paired with the AMTC method. This method has been tested on one 4D and one 6D UQ problem, both originating from aircraft design scenarios and featuring multidisciplinary models. Numerical results show that, when using with graph-accelerated NIPC method, our approach generates a partially tensor-structured quadrature rule that outperforms the full-grid Gauss quadrature and the designed quadrature methods (more than 40% reduction in computational costs) in both of the test problems. △ Less

Submitted 15 October, 2024; v1 submitted 22 March, 2024; originally announced March 2024.

Accelerating model evaluations in uncertainty propagation on tensor grids using computational graph transformations

Authors: Bingran Wang, Mark Sperry, Victor E. Gandarillas, John T. Hwang

Abstract: Methods such as non-intrusive polynomial chaos (NIPC), and stochastic collocation are frequently used for uncertainty propagation problems. Particularly for low-dimensional problems, these methods often use a tensor-product grid for sampling the space of uncertain inputs. A limitation of this approach is that it encounters a significant challenge: the number of sample points grows exponentially wi… ▽ More Methods such as non-intrusive polynomial chaos (NIPC), and stochastic collocation are frequently used for uncertainty propagation problems. Particularly for low-dimensional problems, these methods often use a tensor-product grid for sampling the space of uncertain inputs. A limitation of this approach is that it encounters a significant challenge: the number of sample points grows exponentially with the increase of uncertain inputs. Current strategies to mitigate computational costs abandon the tensor structure of sampling points, with the aim of reducing their overall count. Contrastingly, our investigation reveals that preserving the tensor structure of sample points can offer distinct advantages in specific scenarios. Notably, by manipulating the computational graph of the targeted model, it is feasible to avoid redundant evaluations at the operation level to significantly reduce the model evaluation cost on tensor-grid inputs. This paper presents a pioneering method: Accelerated Model Evaluations on Tensor grids using Computational graph transformations (AMTC). The core premise of AMTC lies in the strategic modification of the computational graph of the target model to algorithmically remove the repeated evaluations on the operation level. We implemented the AMTC method within the compiler of a new modeling language called the Computational System Design Language (CSDL). We demonstrate the effectiveness of AMTC by using it with the full-grid NIPC method to solve four low-dimensional UQ problems involving an analytical piston model, a multidisciplinary unmanned aerial vehicle design model, a multi-point air taxi mission analysis model, and a single-disciplinary rotor model, respectively. For three of the four test problems, AMTC reduces the model evaluation cost by between 50% and 90%, making the full-grid NIPC the most efficacious method to use among the UQ methods implemented. △ Less

Submitted 22 March, 2024; v1 submitted 12 September, 2023; originally announced September 2023.

Automated shape and thickness optimization for non-matching isogeometric shells using free-form deformation

Authors: Han Zhao, David Kamensky, John T. Hwang, Jiun-Shyan Chen

Abstract: Isogeometric analysis (IGA) has emerged as a promising approach in the field of structural optimization, benefiting from the seamless integration between the computer-aided design (CAD) geometry and the analysis model by employing non-uniform rational B-splines (NURBS) as basis functions. However, structural optimization for real-world CAD geometries consisting of multiple non-matching NURBS patch… ▽ More Isogeometric analysis (IGA) has emerged as a promising approach in the field of structural optimization, benefiting from the seamless integration between the computer-aided design (CAD) geometry and the analysis model by employing non-uniform rational B-splines (NURBS) as basis functions. However, structural optimization for real-world CAD geometries consisting of multiple non-matching NURBS patches remains a challenging task. In this work, we propose a unified formulation for shape and thickness optimization of separately-parametrized shell structures by adopting the free-form deformation (FFD) technique, so that continuity with respect to design variables is preserved at patch intersections during optimization. Shell patches are modeled with isogeometric Kirchhoff--Love theory and coupled using a penalty-based method in the analysis. We use Lagrange extraction to link the control points associated with the B-spline FFD block and shell patches, and we perform IGA using the same extraction matrices by taking advantage of existing finite element assembly procedures in the FEniCS partial differential equation (PDE) solution library. Moreover, we enable automated analytical derivative computation by leveraging advanced code generation in FEniCS, thereby facilitating efficient gradient-based optimization algorithms. The framework is validated using a collection of benchmark problems, demonstrating its applications to shape and thickness optimization of aircraft wings with complex shell layouts. △ Less

Submitted 2 August, 2023; originally announced August 2023.

SMT 2.0: A Surrogate Modeling Toolbox with a focus on Hierarchical and Mixed Variables Gaussian Processes

Authors: Paul Saves, Remi Lafage, Nathalie Bartoli, Youssef Diouane, Jasper Bussemaker, Thierry Lefebvre, John T. Hwang, Joseph Morlier, Joaquim R. R. A. Martins

Abstract: The Surrogate Modeling Toolbox (SMT) is an open-source Python package that offers a collection of surrogate modeling methods, sampling techniques, and a set of sample problems. This paper presents SMT 2.0, a major new release of SMT that introduces significant upgrades and new features to the toolbox. This release adds the capability to handle mixed-variable surrogate models and hierarchical varia… ▽ More The Surrogate Modeling Toolbox (SMT) is an open-source Python package that offers a collection of surrogate modeling methods, sampling techniques, and a set of sample problems. This paper presents SMT 2.0, a major new release of SMT that introduces significant upgrades and new features to the toolbox. This release adds the capability to handle mixed-variable surrogate models and hierarchical variables. These types of variables are becoming increasingly important in several surrogate modeling applications. SMT 2.0 also improves SMT by extending sampling methods, adding new surrogate models, and computing variance and kernel derivatives for Kriging. This release also includes new functions to handle noisy and use multifidelity data. To the best of our knowledge, SMT 2.0 is the first open-source surrogate library to propose surrogate models for hierarchical and mixed inputs. This open-source software is distributed under the New BSD license. △ Less

Submitted 23 January, 2024; v1 submitted 23 May, 2023; originally announced May 2023.

Comments: 10.1016/j.advengsoft.2023.103571

Journal ref: Advances in Engineering Software Volume 188, February 2024, 103571

Large-scale multidisciplinary design optimization of the NASA lift-plus-cruise concept using a novel aircraft design framework

Authors: Marius L. Ruh, Darshan Sarojini, Andrew Fletcher, Isaac Asher, John T. Hwang

Abstract: The conceptual design of eVTOL aircraft is a high-dimensional optimization problem that involves large numbers of continuous design parameters. Therefore, eVTOL design method would benefit from numerical optimization algorithms capable of systematically searching these high-dimensional parameters spaces, using comprehensive and multidisciplinary models of the aircraft. By leveraging recent progres… ▽ More The conceptual design of eVTOL aircraft is a high-dimensional optimization problem that involves large numbers of continuous design parameters. Therefore, eVTOL design method would benefit from numerical optimization algorithms capable of systematically searching these high-dimensional parameters spaces, using comprehensive and multidisciplinary models of the aircraft. By leveraging recent progress in sensitivity analysis methods, a computational framework called the Comprehensive Aircraft high-Dimensional DEsign Environment (CADDEE) has been developed for large-scale multidisciplinary design optimization (MDO) of electric air taxis. CADDEE uses a geometry-centric approach that propagates geometry changes in a differentiable manner to meshes for physics-based models of arbitrary fidelity level. The paper demonstrates the capabilities of this new aircraft design tool, by presenting large-scale MDO results for NASA's Lift+Cruise eVTOL concept. MDO with over 100 design variables, 17 constraints, and low-fidelity predictive models for key disciplines is demonstrated with an optimization time of less than one hour with a desktop computer. The results show a reduction in gross weight of 11.4% and suggest that CADDEE can be valuable in the conceptual design and optimization of eVTOL aircraft. △ Less

Submitted 25 April, 2023; originally announced April 2023.

Comments: 21 pages, 15 figures

ACM Class: J.2

TALOS: A toolbox for spacecraft conceptual design

Authors: Victor Gandarillas, John T. Hwang

Abstract: We present the Toolbox for Analysis and Large-scale Optimization of Spacecraft (TALOS), a framework designed for applying large-scale multidisciplinary design optimization (MDO) to spacecraft design problems. The framework is built using the Computational System Design Language (CSDL), with abstractions for users to describe systems at a high level. CSDL is a compiled, embedded domain-specific lan… ▽ More We present the Toolbox for Analysis and Large-scale Optimization of Spacecraft (TALOS), a framework designed for applying large-scale multidisciplinary design optimization (MDO) to spacecraft design problems. The framework is built using the Computational System Design Language (CSDL), with abstractions for users to describe systems at a high level. CSDL is a compiled, embedded domain-specific language that fully automates derivative computation using the adjoint method. CSDL provides a unified interface for defining MDO problems, separating model definition from low-level program implementation details. TALOS provides discipline models for spacecraft mission designers to perform analyses, optimizations, and trade studies early in the design process. TALOS also provides interfaces for users to provide high-level system descriptions without the need to use CSDL directly, which simplifies the exploration of different spacecraft configurations. We describe the interfaces in TALOS available to users and run analyses on selected spacecraft subsystem disciplines to demonstrate the current capabilities of TALOS. △ Less

Submitted 27 March, 2023; originally announced March 2023.

A new approach for analyzing panel AR(1) series with application to the unit root test

Authors: Yu-Pin Hu, J. T. Gene Hwang

Abstract: This paper derives several novel tests to improve on the t-test for testing AR(1) coefficients of panel time series, i.e., of multiple time series, when each has a small number of observations. These tests can determine the acceptance or the rejection of each hypothesis individually while controlling the average type one error. Strikingly, the testing statistics derived by the empirical Bayes appr… ▽ More This paper derives several novel tests to improve on the t-test for testing AR(1) coefficients of panel time series, i.e., of multiple time series, when each has a small number of observations. These tests can determine the acceptance or the rejection of each hypothesis individually while controlling the average type one error. Strikingly, the testing statistics derived by the empirical Bayes approach can be approximated by a simple form similar to the t-statistic; the only difference is that the means and the variances are estimated by shrinkage estimators. Simulations demonstrate that the proposed tests have higher average power than the t-test in all settings we examine including those when the priors are miss-specified and the cross section series are dependent. △ Less

Submitted 21 September, 2015; originally announced September 2015.

Shrinkage Confidence Procedures

Authors: George Casella, J. T. Gene Hwang

Abstract: The possibility of improving on the usual multivariate normal confidence was first discussed in Stein (1962). Using the ideas of shrinkage, through Bayesian and empirical Bayesian arguments, domination results, both analytic and numerical, have been obtained. Here we trace some of the developments in confidence set estimation. The possibility of improving on the usual multivariate normal confidence was first discussed in Stein (1962). Using the ideas of shrinkage, through Bayesian and empirical Bayesian arguments, domination results, both analytic and numerical, have been obtained. Here we trace some of the developments in confidence set estimation. △ Less

Submitted 22 March, 2012; originally announced March 2012.

Comments: Published in at http://dx.doi.org/10.1214/10-STS319 the Statistical Science (http://www.imstat.org/sts/) by the Institute of Mathematical Statistics (http://www.imstat.org)

Report number: IMS-STS-STS319

Journal ref: Statistical Science 2012, Vol. 27, No. 1, 51-60

Minimax estimation with thresholding and its application to wavelet analysis

Authors: Harrison H. Zhou, J. T. Gene Hwang

Abstract: Many statistical practices involve choosing between a full model and reduced models where some coefficients are reduced to zero. Data were used to select a model with estimated coefficients. Is it possible to do so and still come up with an estimator always better than the traditional estimator based on the full model? The James-Stein estimator is such an estimator, having a property called mini… ▽ More Many statistical practices involve choosing between a full model and reduced models where some coefficients are reduced to zero. Data were used to select a model with estimated coefficients. Is it possible to do so and still come up with an estimator always better than the traditional estimator based on the full model? The James-Stein estimator is such an estimator, having a property called minimaxity. However, the estimator considers only one reduced model, namely the origin. Hence it reduces no coefficient estimator to zero or every coefficient estimator to zero. In many applications including wavelet analysis, what should be more desirable is to reduce to zero only the estimators smaller than a threshold, called thresholding in this paper. Is it possible to construct this kind of estimators which are minimax? In this paper, we construct such minimax estimators which perform thresholding. We apply our recommended estimator to the wavelet analysis and show that it performs the best among the well-known estimators aiming simultaneously at estimation and model selection. Some of our estimators are also shown to be asymptotically optimal. △ Less

Submitted 25 April, 2005; originally announced April 2005.

Comments: Published at http://dx.doi.org/10.1214/009053604000000977 in the Annals of Statistics (http://www.imstat.org/aos/) by the Institute of Mathematical Statistics (http://www.imstat.org)

Report number: IMS-AOS-AOS291 MSC Class: 62G05; 62J07 (Primary) 62C10; 62H25. (Secondary)

Journal ref: Annals of Statistics 2005, Vol. 33, No. 1, 101-125