-
Can Brain Signals Reveal Inner Alignment with Human Languages?
Authors:
William Han,
Jielin Qiu,
Jiacheng Zhu,
Mengdi Xu,
Douglas Weber,
Bo Li,
Ding Zhao
Abstract:
Brain Signals, such as Electroencephalography (EEG), and human languages have been widely explored independently for many downstream tasks, however, the connection between them has not been well explored. In this study, we explore the relationship and dependency between EEG and language. To study at the representation level, we introduced \textbf{MTAM}, a \textbf{M}ultimodal \textbf{T}ransformer \…
▽ More
Brain Signals, such as Electroencephalography (EEG), and human languages have been widely explored independently for many downstream tasks, however, the connection between them has not been well explored. In this study, we explore the relationship and dependency between EEG and language. To study at the representation level, we introduced \textbf{MTAM}, a \textbf{M}ultimodal \textbf{T}ransformer \textbf{A}lignment \textbf{M}odel, to observe coordinated representations between the two modalities. We used various relationship alignment-seeking techniques, such as Canonical Correlation Analysis and Wasserstein Distance, as loss functions to transfigure features. On downstream applications, sentiment analysis and relation detection, we achieved new state-of-the-art results on two datasets, ZuCo and K-EmoCon. Our method achieved an F1-score improvement of 1.7% on K-EmoCon and 9.3% on Zuco datasets for sentiment analysis, and 7.4% on ZuCo for relation detection. In addition, we provide interpretations of the performance improvement: (1) feature distribution shows the effectiveness of the alignment module for discovering and encoding the relationship between EEG and language; (2) alignment weights show the influence of different language semantics as well as EEG frequency features; (3) brain topographical maps provide an intuitive demonstration of the connectivity in the brain regions. Our code is available at \url{https://github.com/Jason-Qiu/EEG_Language_Alignment}.
△ Less
Submitted 4 May, 2024; v1 submitted 10 August, 2022;
originally announced August 2022.
-
Model-based optimal AML consolidation treatment
Authors:
Felix Jost,
Enrico Schalk,
Daniela Weber,
Hartmut Doehner,
Thomas Fischer,
Sebastian Sager
Abstract:
Neutropenia is an adverse event commonly arising during intensive chemotherapy of acute myeloid leukemia (AML). It is often associated with infectious complications. Mathematical modeling, simulation, and optimization of the treatment process would be a valuable tool to support clinical decision making, potentially resulting in less severe side effects and deeper remissions. However, until now, th…
▽ More
Neutropenia is an adverse event commonly arising during intensive chemotherapy of acute myeloid leukemia (AML). It is often associated with infectious complications. Mathematical modeling, simulation, and optimization of the treatment process would be a valuable tool to support clinical decision making, potentially resulting in less severe side effects and deeper remissions. However, until now, there has been no validated mathematical model available to simulate the effect of chemotherapy treatment on white blood cell (WBC) counts and leukemic cells simultaneously. We developed a population pharmacokinetic/pharmacodynamic (PK/PD) model combining a myelosuppression model considering endogenous granulocyte-colony stimulating factor (G-CSF), a PK model for cytarabine (Ara-C), a subcutaneous absorption model for exogenous G-CSF, and a two-compartment model for leukemic blasts. This model was fitted to data of 44 AML patients during consolidation therapy with a novel Ara-C plus G-CSF schedule from a phase II controlled clinical trial. Additionally, we were able to optimize treatment schedules with respect to disease progression, WBC nadirs, and the amount of Ara-C and G-CSF. The developed PK/PD model provided good prediction accuracies and an interpretation of the interaction between WBCs, G-CSF, and blasts. For 14 patients (those with available bone marrow blast counts), we achieved a median 4.2-fold higher WBC count at nadir, which is the most critical time during consolidation therapy. The simulation results showed that relative bone marrow blast counts remained below the clinically important threshold of 5%, with a median of 60% reduction in Ara-C.
△ Less
Submitted 18 April, 2020; v1 submitted 20 November, 2019;
originally announced November 2019.
-
Multichannel Electrophysiological Spike Sorting via Joint Dictionary Learning & Mixture Modeling
Authors:
David E. Carlson,
Joshua T. Vogelstein,
Qisong Wu,
Wenzhao Lian,
Mingyuan Zhou,
Colin R. Stoetzner,
Daryl Kipke,
Douglas Weber,
David B. Dunson,
Lawrence Carin
Abstract:
We propose a construction for joint feature learning and clustering of multichannel extracellular electrophysiological data across multiple recording periods for action potential detection and discrimination ("spike sorting"). Our construction improves over the previous state-of-the art principally in four ways. First, via sharing information across channels, we can better distinguish between sing…
▽ More
We propose a construction for joint feature learning and clustering of multichannel extracellular electrophysiological data across multiple recording periods for action potential detection and discrimination ("spike sorting"). Our construction improves over the previous state-of-the art principally in four ways. First, via sharing information across channels, we can better distinguish between single-unit spikes and artifacts. Second, our proposed "focused mixture model" (FMM) elegantly deals with units appearing, disappearing, or reappearing over multiple recording days, an important consideration for any chronic experiment. Third, by jointly learning features and clusters, we improve performance over previous attempts that proceeded via a two-stage ("frequentist") learning process. Fourth, by directly modeling spike rate, we improve detection of sparsely spiking neurons. Moreover, our Bayesian construction seamlessly handles missing data. We present state-of-the-art performance without requiring manually tuning of many hyper-parameters on both a public dataset with partial ground truth and a new experimental dataset.
△ Less
Submitted 4 August, 2013; v1 submitted 2 April, 2013;
originally announced April 2013.
