Temporal Multimodal Multivariate Learning
Authors:
Hyoshin Park,
Justice Darko,
Niharika Deshpande,
Venktesh Pandey,
Hui Su,
Masahiro Ono,
Dedrick Barkely,
Larkin Folsom,
Derek Posselt,
Steve Chien
Abstract:
We introduce temporal multimodal multivariate learning, a new family of decision making models that can indirectly learn and transfer online information from simultaneous observations of a probability distribution with more than one peak or more than one outcome variable from one time stage to another. We approximate the posterior by sequentially removing additional uncertainties across different…
▽ More
We introduce temporal multimodal multivariate learning, a new family of decision making models that can indirectly learn and transfer online information from simultaneous observations of a probability distribution with more than one peak or more than one outcome variable from one time stage to another. We approximate the posterior by sequentially removing additional uncertainties across different variables and time, based on data-physics driven correlation, to address a broader class of challenging time-dependent decision-making problems under uncertainty. Extensive experiments on real-world datasets ( i.e., urban traffic data and hurricane ensemble forecasting data) demonstrate the superior performance of the proposed targeted decision-making over the state-of-the-art baseline prediction methods across various settings.
△ Less
Submitted 14 June, 2022;
originally announced June 2022.
Multi-Modal Neuroimaging Analysis and Visualization Tool (MMVT)
Authors:
O. Felsenstein,
N. Peled,
E. Hahn,
A. P. Rockhill,
D. Frank,
A M. Libster,
Y. Nossenson,
L. Folsom,
T. Gholipour,
K. Macadams,
N. Rozengard,
A. C. Paulk,
D. Dougherty,
S. S. Cash,
A. S. Widge,
M. Hämäläinen,
S. Stufflebeam
Abstract:
Sophisticated visualization tools are essential for the presentation and exploration of human neuroimaging data. While two-dimensional orthogonal views of neuroimaging data are conventionally used to display activity and statistical analysis, three-dimensional (3D) representation is useful for showing the spatial distribution of a functional network, as well as its temporal evolution. For these pu…
▽ More
Sophisticated visualization tools are essential for the presentation and exploration of human neuroimaging data. While two-dimensional orthogonal views of neuroimaging data are conventionally used to display activity and statistical analysis, three-dimensional (3D) representation is useful for showing the spatial distribution of a functional network, as well as its temporal evolution. For these purposes, there is currently no open-source, 3D neuroimaging tool that can simultaneously visualize desired combinations of MRI, CT, EEG, MEG, fMRI, PET, and intracranial EEG (i.e., ECoG, depth electrodes, and DBS). Here we present the Multi-Modal Visualization Tool (MMVT), which is designed for researchers to interact with their neuroimaging functional and anatomical data through simultaneous visualization of these existing imaging modalities. MMVT contains two separate modules: The first includes complete stand-alone pre-processing pipelines, from raw data to statistical maps. The second module is an add-on to the open-source, 3D-rendering program Blender. It is an interactive graphical interface that enables users to simultaneously visualize multi-modality functional and statistical data on the cortex and in subcortical surfaces as well as the activity of invasive electrodes. This tool also enables highly accurate 3D visualization of neuroanatomy, including the location of invasive electrodes relative to brain structures. Each of the modules and module features can be integrated, separate from the tool, into existing data pipelines. MMVT leverages open-source software to build a comprehensive tool for data visualization and exploration This gives the tool a distinct advantage in both clinical and research domains as each has highly specialized visual and processing needs.
△ Less
Submitted 2 June, 2022; v1 submitted 20 December, 2019;
originally announced December 2019.
