-
Parameter identification from single trajectory data: from linear to nonlinear
Authors:
Xiaoyu Duan,
Jonathan E Rubin,
David Swigon
Abstract:
Our recent work lays out a general framework for inferring information about the parameters and associated dynamics of a differential equation model from a discrete set of data points collected from the system being modeled. Rigorous mathematical results have justified this approach and have identified some common features that arise for certain classes of integrable models. In this work we presen…
▽ More
Our recent work lays out a general framework for inferring information about the parameters and associated dynamics of a differential equation model from a discrete set of data points collected from the system being modeled. Rigorous mathematical results have justified this approach and have identified some common features that arise for certain classes of integrable models. In this work we present a thorough numerical investigation that shows that several of these core features extend to a paradigmatic linear-in-parameters model, the Lotka-Volterra (LV) system, which we consider in the conservative case as well as under the addition of terms that perturb the system away from this regime. A central construct for this analysis is a concise representation of parameter features in the data space that we call the $P_n$-diagram, which is particularly useful for visualization of results for low-dimensional (small $n$) systems. Our work also exposes some new properties related to non-uniqueness that arise for these LV systems, with non-uniqueness manifesting as a multi-layered structure in the associated $P_2$-diagrams.
△ Less
Submitted 28 September, 2022;
originally announced September 2022.
-
Deep Normed Embeddings for Patient Representation
Authors:
Thesath Nanayakkara,
Gilles Clermont,
Christopher James Langmead,
David Swigon
Abstract:
We introduce a novel contrastive representation learning objective and a training scheme for clinical time series. Specifically, we project high dimensional EHR. data to a closed unit ball of low dimension, encoding geometric priors so that the origin represents an idealized perfect health state and the Euclidean norm is associated with the patient's mortality risk. Moreover, using septic patients…
▽ More
We introduce a novel contrastive representation learning objective and a training scheme for clinical time series. Specifically, we project high dimensional EHR. data to a closed unit ball of low dimension, encoding geometric priors so that the origin represents an idealized perfect health state and the Euclidean norm is associated with the patient's mortality risk. Moreover, using septic patients as an example, we show how we could learn to associate the angle between two vectors with the different organ system failures, thereby, learning a compact representation which is indicative of both mortality risk and specific organ failure. We show how the learned embedding can be used for online patient monitoring, can supplement clinicians and improve performance of downstream machine learning tasks. This work was partially motivated from the desire and the need to introduce a systematic way of defining intermediate rewards for Reinforcement Learning in critical care medicine. Hence, we also show how such a design in terms of the learned embedding can result in qualitatively different policies and value distributions, as compared with using only terminal rewards.
△ Less
Submitted 3 July, 2022; v1 submitted 11 April, 2022;
originally announced April 2022.
-
Unifying Cardiovascular Modelling with Deep Reinforcement Learning for Uncertainty Aware Control of Sepsis Treatment
Authors:
Thesath Nanayakkara,
Gilles Clermont,
Christopher James Langmead,
David Swigon
Abstract:
Sepsis is a potentially life threatening inflammatory response to infection or severe tissue damage. It has a highly variable clinical course, requiring constant monitoring of the patient's state to guide the management of intravenous fluids and vasopressors, among other interventions. Despite decades of research, there's still debate among experts on optimal treatment. Here, we combine for the fi…
▽ More
Sepsis is a potentially life threatening inflammatory response to infection or severe tissue damage. It has a highly variable clinical course, requiring constant monitoring of the patient's state to guide the management of intravenous fluids and vasopressors, among other interventions. Despite decades of research, there's still debate among experts on optimal treatment. Here, we combine for the first time, distributional deep reinforcement learning with mechanistic physiological models to find personalized sepsis treatment strategies. Our method handles partial observability by leveraging known cardiovascular physiology, introducing a novel physiology-driven recurrent autoencoder, and quantifies the uncertainty of its own results. Moreover, we introduce a framework for uncertainty aware decision support with humans in the loop. We show that our method learns physiologically explainable, robust policies that are consistent with clinical knowledge. Further our method consistently identifies high risk states that lead to death, which could potentially benefit from more frequent vasopressor administration, providing valuable guidance for future research
△ Less
Submitted 12 June, 2021; v1 submitted 21 January, 2021;
originally announced January 2021.