-
Towards Foundation Models for Critical Care Time Series
Authors:
Manuel Burger,
Fedor Sergeev,
Malte Londschien,
Daphné Chopard,
Hugo Yèche,
Eike Gerdes,
Polina Leshetkina,
Alexander Morgenroth,
Zeynep Babür,
Jasmina Bogojeska,
Martin Faltys,
Rita Kuznetsova,
Gunnar Rätsch
Abstract:
Notable progress has been made in generalist medical large language models across various healthcare areas. However, large-scale modeling of in-hospital time series data - such as vital signs, lab results, and treatments in critical care - remains underexplored. Existing datasets are relatively small, but combining them can enhance patient diversity and improve model robustness. To effectively uti…
▽ More
Notable progress has been made in generalist medical large language models across various healthcare areas. However, large-scale modeling of in-hospital time series data - such as vital signs, lab results, and treatments in critical care - remains underexplored. Existing datasets are relatively small, but combining them can enhance patient diversity and improve model robustness. To effectively utilize these combined datasets for large-scale modeling, it is essential to address the distribution shifts caused by varying treatment policies, necessitating the harmonization of treatment variables across the different datasets. This work aims to establish a foundation for training large-scale multi-variate time series models on critical care data and to provide a benchmark for machine learning models in transfer learning across hospitals to study and address distribution shift challenges. We introduce a harmonized dataset for sequence modeling and transfer learning research, representing the first large-scale collection to include core treatment variables. Future plans involve expanding this dataset to support further advancements in transfer learning and the development of scalable, generalizable models for critical healthcare applications.
△ Less
Submitted 25 November, 2024;
originally announced November 2024.
-
Towards Dynamic Feature Acquisition on Medical Time Series by Maximizing Conditional Mutual Information
Authors:
Fedor Sergeev,
Paola Malsot,
Gunnar Rätsch,
Vincent Fortuin
Abstract:
Knowing which features of a multivariate time series to measure and when is a key task in medicine, wearables, and robotics. Better acquisition policies can reduce costs while maintaining or even improving the performance of downstream predictors. Inspired by the maximization of conditional mutual information, we propose an approach to train acquirers end-to-end using only the downstream loss. We…
▽ More
Knowing which features of a multivariate time series to measure and when is a key task in medicine, wearables, and robotics. Better acquisition policies can reduce costs while maintaining or even improving the performance of downstream predictors. Inspired by the maximization of conditional mutual information, we propose an approach to train acquirers end-to-end using only the downstream loss. We show that our method outperforms random acquisition policy, matches a model with an unrestrained budget, but does not yet overtake a static acquisition strategy. We highlight the assumptions and outline avenues for future work.
△ Less
Submitted 18 July, 2024;
originally announced July 2024.
-
Role of mesoscale eddies in transport of Fukushima-derived cesium isotopes in the ocean
Authors:
M. V. Budyansky,
V. A. Goryachev,
D. D. Kaplunenko,
V. B. Lobanov,
S. V. Prants,
A. F. Sergeev,
N. V. Shlyk,
M. Yu. Uleysky
Abstract:
We present the results of in-situ measurements of $^{134}$Cs and $^{137}$Cs released from the Fukushima Nuclear Power Plant (FNPP) collected at surface and different depths in the western North Pacific in June and July 2012. It was found that 15 month after the incident concentrations of radiocesium in the Japan and Okhotsk seas were at background or slightly increased level, while they had increa…
▽ More
We present the results of in-situ measurements of $^{134}$Cs and $^{137}$Cs released from the Fukushima Nuclear Power Plant (FNPP) collected at surface and different depths in the western North Pacific in June and July 2012. It was found that 15 month after the incident concentrations of radiocesium in the Japan and Okhotsk seas were at background or slightly increased level, while they had increased values in the subarctic front area east of Japan. The highest concentrations of $^{134}$Cs and $^{137}$Cs up to 13.5 ${\pm}$ 0.9 and 22.7 ${\pm}$ 1.5 Bq m$^{-3}$ have been found to exceed ten times the background levels before the accident. Maximal content of radiocesium was observed within subsurface and intermediate water layers inside the cores of anticyclonic eddies (100 - 500 m). Even slightly increased content of radiocesium was found at some eddies at depth of 1000 m. It is expected that convergence and subduction of surface water inside eddies are main mechanisms of downward transport of radionuclides. In situ observations are compared with the results of simulated advection of these radioisotopes by the AVISO altimetric velocity field. Different Lagrangian diagnostics are used to reconstruct the history and origin of synthetic tracers imitating measured seawater samples collected in each of those eddies. The results of observations are consistent with the simulated results. It is shown that the tracers, simulating water samples with increased radioactivity to be measured in the cruise, really visited the areas with presumably high level of contamination. Fast water advection between anticyclonic eddies and convergence of surface water inside eddies make them responsible for spreading, accumulation and downward transport of cesium rich water to the intermediate depth in the frontal zone.
△ Less
Submitted 9 October, 2014;
originally announced October 2014.
-
Collective and fractal properties of pion jets in the four-velocity space at intermediate energies
Authors:
V. A. Okorokov,
A. K. Ponosov,
F. M. Sergeev
Abstract:
Experimental results are presented for study of collective and fractal properties of soft pion jets in the space of relative four-dimensional velocities. Significant decreasing is obtained for mean square of second particle distances from jet axis for pion-proton interactions at initial energies $\sim 3$ GeV in comparison with hadron-nuclear collisions at close energies. The decreasing results i…
▽ More
Experimental results are presented for study of collective and fractal properties of soft pion jets in the space of relative four-dimensional velocities. Significant decreasing is obtained for mean square of second particle distances from jet axis for pion-proton interactions at initial energies $\sim 3$ GeV in comparison with hadron-nuclear collisions at close energies. The decreasing results in power dependence of distance variable on collision energy for range $\sim 2 - 4$ GeV. The observation allows us to estimate the low boundary of manifestation of color degree of freedom in pion jet production. Cluster dimension values were deduced for pion jets in various reactions. Fractional values of this dimension indicate on the manifestation of fractal-like properties by pion jets. Changing of mean kinetic energy of jet particles and fractal dimension with initial energy increasing is consistent with suggestion for presence of color degrees of freedom in pion jet production at intermediate energies.
△ Less
Submitted 2 February, 2010;
originally announced February 2010.
-
The $ΛK$ system production in the hadron interactions
Authors:
O. V. Bulekov,
N. D. Galanina,
V. S. Demidov,
A. L. Endalov,
I. E. Kiselevich,
M. A. Martemianov,
V. I. Mikhailichenko,
V. A. Okorokov,
A. K. Ponosov,
F. M. Sergeev,
N. A. Khaldeeva
Abstract:
The A-dependence is observed in $x_F$-distributions for the $ΛK^0$ system produced with the small transverse momentum in the neutron-nucleus interactions. For the $Λ$ hyperons similar dependence isn't seen. The result is interpreted as an effect from intermediate excitative nucleon state, which decays into strange particles. Such interpretation is confirmed experimental data on $ΛK$ pair product…
▽ More
The A-dependence is observed in $x_F$-distributions for the $ΛK^0$ system produced with the small transverse momentum in the neutron-nucleus interactions. For the $Λ$ hyperons similar dependence isn't seen. The result is interpreted as an effect from intermediate excitative nucleon state, which decays into strange particles. Such interpretation is confirmed experimental data on $ΛK$ pair production in the pion-nucleon interactions.
△ Less
Submitted 3 December, 1998;
originally announced December 1998.
