-
Branch-and-bound algorithm for efficient reliability analysis of general coherent systems
Authors:
Ji-Eun Byun,
Hyeuk Ryu,
Daniel Straub
Abstract:
Branch and bound algorithms have been developed for reliability analysis of coherent systems. They exhibit a set of advantages; in particular, they can find a computationally efficient representation of a system failure or survival event, which can be re-used when the input probability distributions change over time or when new data is available. However, existing branch-and-bound algorithms can h…
▽ More
Branch and bound algorithms have been developed for reliability analysis of coherent systems. They exhibit a set of advantages; in particular, they can find a computationally efficient representation of a system failure or survival event, which can be re-used when the input probability distributions change over time or when new data is available. However, existing branch-and-bound algorithms can handle only a limited set of system performance functions, mostly network connectivity and maximum flow. Furthermore, they run redundant analyses on component vector states whose system state can be inferred from previous analysis results. This study addresses these limitations by proposing branch and bound for reliability analysis of general coherent systems} (BRC) algorithm: an algorithm that automatically finds minimal representations of failure/survival events of general coherent systems. Computational efficiency is attained by dynamically inferring importance of component events from hitherto obtained results. We demonstrate advantages of the BRC method as a real-time risk management tool by application to the Eastern Massachusetts highway benchmark network.
△ Less
Submitted 27 October, 2024;
originally announced October 2024.
-
Probabilistic inverse optimal control for non-linear partially observable systems disentangles perceptual uncertainty and behavioral costs
Authors:
Dominik Straub,
Matthias Schultheis,
Heinz Koeppl,
Constantin A. Rothkopf
Abstract:
Inverse optimal control can be used to characterize behavior in sequential decision-making tasks. Most existing work, however, is limited to fully observable or linear systems, or requires the action signals to be known. Here, we introduce a probabilistic approach to inverse optimal control for partially observable stochastic non-linear systems with unobserved action signals, which unifies previou…
▽ More
Inverse optimal control can be used to characterize behavior in sequential decision-making tasks. Most existing work, however, is limited to fully observable or linear systems, or requires the action signals to be known. Here, we introduce a probabilistic approach to inverse optimal control for partially observable stochastic non-linear systems with unobserved action signals, which unifies previous approaches to inverse optimal control with maximum causal entropy formulations. Using an explicit model of the noise characteristics of the sensory and motor systems of the agent in conjunction with local linearization techniques, we derive an approximate likelihood function for the model parameters, which can be computed within a single forward pass. We present quantitative evaluations on stochastic and partially observable versions of two classic control tasks and two human behavioral tasks. Importantly, we show that our method can disentangle perceptual factors and behavioral costs despite the fact that epistemic and pragmatic actions are intertwined in sequential decision-making under uncertainty, such as in active sensing and active learning. The proposed method has broad applicability, ranging from imitation learning to sensorimotor neuroscience.
△ Less
Submitted 30 October, 2023; v1 submitted 29 March, 2023;
originally announced March 2023.
-
Bridging POMDPs and Bayesian decision making for robust maintenance planning under model uncertainty: An application to railway systems
Authors:
Giacomo Arcieri,
Cyprien Hoelzl,
Oliver Schwery,
Daniel Straub,
Konstantinos G. Papakonstantinou,
Eleni Chatzi
Abstract:
Structural Health Monitoring (SHM) describes a process for inferring quantifiable metrics of structural condition, which can serve as input to support decisions on the operation and maintenance of infrastructure assets. Given the long lifespan of critical structures, this problem can be cast as a sequential decision making problem over prescribed horizons. Partially Observable Markov Decision Proc…
▽ More
Structural Health Monitoring (SHM) describes a process for inferring quantifiable metrics of structural condition, which can serve as input to support decisions on the operation and maintenance of infrastructure assets. Given the long lifespan of critical structures, this problem can be cast as a sequential decision making problem over prescribed horizons. Partially Observable Markov Decision Processes (POMDPs) offer a formal framework to solve the underlying optimal planning task. However, two issues can undermine the POMDP solutions. Firstly, the need for a model that can adequately describe the evolution of the structural condition under deterioration or corrective actions and, secondly, the non-trivial task of recovery of the observation process parameters from available monitoring data. Despite these potential challenges, the adopted POMDP models do not typically account for uncertainty on model parameters, leading to solutions which can be unrealistically confident. In this work, we address both key issues. We present a framework to estimate POMDP transition and observation model parameters directly from available data, via Markov Chain Monte Carlo (MCMC) sampling of a Hidden Markov Model (HMM) conditioned on actions. The MCMC inference estimates distributions of the involved model parameters. We then form and solve the POMDP problem by exploiting the inferred distributions, to derive solutions that are robust to model uncertainty. We successfully apply our approach on maintenance planning for railway track assets on the basis of a "fractal value" indicator, which is computed from actual railway monitoring data.
△ Less
Submitted 15 December, 2022;
originally announced December 2022.
-
Inverse Optimal Control Adapted to the Noise Characteristics of the Human Sensorimotor System
Authors:
Matthias Schultheis,
Dominik Straub,
Constantin A. Rothkopf
Abstract:
Computational level explanations based on optimal feedback control with signal-dependent noise have been able to account for a vast array of phenomena in human sensorimotor behavior. However, commonly a cost function needs to be assumed for a task and the optimality of human behavior is evaluated by comparing observed and predicted trajectories. Here, we introduce inverse optimal control with sign…
▽ More
Computational level explanations based on optimal feedback control with signal-dependent noise have been able to account for a vast array of phenomena in human sensorimotor behavior. However, commonly a cost function needs to be assumed for a task and the optimality of human behavior is evaluated by comparing observed and predicted trajectories. Here, we introduce inverse optimal control with signal-dependent noise, which allows inferring the cost function from observed behavior. To do so, we formalize the problem as a partially observable Markov decision process and distinguish between the agent's and the experimenter's inference problems. Specifically, we derive a probabilistic formulation of the evolution of states and belief states and an approximation to the propagation equation in the linear-quadratic Gaussian problem with signal-dependent noise. We extend the model to the case of partial observability of state variables from the point of view of the experimenter. We show the feasibility of the approach through validation on synthetic data and application to experimental data. Our approach enables recovering the costs and benefits implicit in human sequential sensorimotor behavior, thereby reconciling normative and descriptive approaches in a computational framework.
△ Less
Submitted 21 October, 2021;
originally announced October 2021.
-
Value of information from vibration-based structural health monitoring extracted via Bayesian model updating
Authors:
Antonios Kamariotis,
Eleni Chatzi,
Daniel Straub
Abstract:
Quantifying the value of the information extracted from a structural health monitoring (SHM) system is an important step towards convincing decision makers to implement these systems. We quantify this value by adaptation of the Bayesian decision analysis framework. In contrast to previous works, we model in detail the entire process of data generation to processing, model updating and reliability…
▽ More
Quantifying the value of the information extracted from a structural health monitoring (SHM) system is an important step towards convincing decision makers to implement these systems. We quantify this value by adaptation of the Bayesian decision analysis framework. In contrast to previous works, we model in detail the entire process of data generation to processing, model updating and reliability calculation, and investigate it on a deteriorating bridge system. The framework assumes that dynamic response data are obtained in a sequential fashion from deployed accelerometers, subsequently processed by an output-only operational modal analysis scheme for identifying the system's modal characteristics. We employ a classical Bayesian model updating methodology to sequentially learn the deterioration and estimate the structural damage evolution over time. This leads to sequential updating of the structural reliability, which constitutes the basis for a preposterior Bayesian decision analysis. Alternative actions are defined and a heuristic-based approach is employed for the life-cycle optimization. By solving the preposterior Bayesian decision analysis, one is able to quantify the benefit of the availability of long-term SHM vibrational data. Numerical investigations show that this framework can provide quantitative measures on the optimality of an SHM system in a specific decision context.
△ Less
Submitted 12 March, 2021;
originally announced March 2021.
-
Optimal adaptive inspection and maintenance planning for deteriorating structural systems
Authors:
Elizabeth Bismut,
Daniel Straub
Abstract:
Optimizing inspection and maintenance (I&M) plans for a large deteriorating structure is a computationally challenging task, in particular if one considers interdependences among its components. This is due to the sheer number of possible decision alternatives over the lifetime of the structure and the uncertainty surrounding the deterioration processes, the structural performance and the outcomes…
▽ More
Optimizing inspection and maintenance (I&M) plans for a large deteriorating structure is a computationally challenging task, in particular if one considers interdependences among its components. This is due to the sheer number of possible decision alternatives over the lifetime of the structure and the uncertainty surrounding the deterioration processes, the structural performance and the outcomes of inspection and maintenance actions. To address this challenge, Luque and Straub (2019) proposed a heuristic approach in which I&M plans for structural systems are defined through a set of simple decision rules. Here, we formalize the optimization of these decision rules and extend the approach to enable adaptive planning. The initially optimal I&M plan is successively adapted throughout the service life, based on past inspection and monitoring results. The proposed methodology uses stochastic deterioration models and accounts for the interdependence among structural components. The heuristic-based adaptive planning is illustrated for a structural frame subjected to fatigue.
△ Less
Submitted 10 February, 2021;
originally announced February 2021.
