-
Cognitive Networks and Performance Drive fMRI-Based State Classification Using DNN Models
Authors:
Murat Kucukosmanoglu,
Javier O. Garcia,
Justin Brooks,
Kanika Bansal
Abstract:
Deep neural network (DNN) models have demonstrated impressive performance in various domains, yet their application in cognitive neuroscience is limited due to their lack of interpretability. In this study we employ two structurally different and complementary DNN-based models, a one-dimensional convolutional neural network (1D-CNN) and a bidirectional long short-term memory network (BiLSTM), to c…
▽ More
Deep neural network (DNN) models have demonstrated impressive performance in various domains, yet their application in cognitive neuroscience is limited due to their lack of interpretability. In this study we employ two structurally different and complementary DNN-based models, a one-dimensional convolutional neural network (1D-CNN) and a bidirectional long short-term memory network (BiLSTM), to classify individual cognitive states from fMRI BOLD data, with a focus on understanding the cognitive underpinnings of the classification decisions. We show that despite the architectural differences, both models consistently produce a robust relationship between prediction accuracy and individual cognitive performance, such that low performance leads to poor prediction accuracy. To achieve model explainability, we used permutation techniques to calculate feature importance, allowing us to identify the most critical brain regions influencing model predictions. Across models, we found the dominance of visual networks, suggesting that task-driven state differences are primarily encoded in visual processing. Attention and control networks also showed relatively high importance, however, default mode and temporal-parietal networks demonstrated negligible contribution in differentiating cognitive states. Additionally, we observed individual trait-based effects and subtle model-specific differences, such that 1D-CNN showed slightly better overall performance, while BiLSTM showed better sensitivity for individual behavior; these initial findings require further research and robustness testing to be fully established. Our work underscores the importance of explainable DNN models in uncovering the neural mechanisms underlying cognitive state transitions, providing a foundation for future work in this domain.
△ Less
Submitted 14 August, 2024;
originally announced September 2024.
-
Symbolic dynamics of joint brain states during dyadic coordination
Authors:
Italo Ivo Lima Dias Pinto,
Zhibin Zhou,
Javier O. Garcia,
Ramesh Srinivasan
Abstract:
We propose a novel approach to investigate the brain mechanisms that support coordination of behavior between individuals. Brain states in single individuals defined by the patterns of functional connectivity between brain regions are used to create joint symbolic representations of the evolution of brain states in two or more individuals performing a task together. These symbolic dynamics can be…
▽ More
We propose a novel approach to investigate the brain mechanisms that support coordination of behavior between individuals. Brain states in single individuals defined by the patterns of functional connectivity between brain regions are used to create joint symbolic representations of the evolution of brain states in two or more individuals performing a task together. These symbolic dynamics can be analyzed to reveal aspects of the dynamics of joint brain states that are related to coordination or other interactive behaviors. We apply this approach to simultaneous electroencephalographic (EEG) data from pairs of subjects engaged in two different modes of finger-tapping coordination tasks (synchronization and syncopation) under different interaction conditions (Uncoupled, Leader-Follower, and Mutual) to explore the neural mechanisms of multi-person motor coordination. Our results reveal that the dyads exhibit mostly the same joint symbols in different interaction conditions - the most important differences are reflected in the symbolic dynamics. Recurrence analysis shows that interaction influences the dwell time in specific joint symbols and the structure of joint symbol sequences (motif length). In synchronization, increasing feedback promotes stability with longer dwell times and motif length. In syncopation, Leader-Follower interactions enhance stability (increase dwell time and motif length), but Mutual feedback dramatically reduces stability. Network analysis reveals distinct topological changes with task and feedback. In synchronization, stronger coupling stabilizes a few states restricting the pattern of flow between states, preserving a core-periphery structure of the joint brain states. In syncopation, a more distributed flow amongst a larger set of joint brain states reduces the dominance of core joint brain states.
△ Less
Submitted 3 January, 2025; v1 submitted 23 August, 2024;
originally announced August 2024.
-
Optimizing parameter search for community detection in time evolving networks of complex systems
Authors:
ItaloIvo Lima Dias Pinto,
Javier Omar Garcia,
Kanika Bansal
Abstract:
Network representations have been effectively employed to analyze complex systems across various areas and applications, leading to the development of network science as a core tool to study systems with multiple components and complex interactions. There is a growing interest in understanding the temporal dynamics of complex networks to decode the underlying dynamic processes through the temporal…
▽ More
Network representations have been effectively employed to analyze complex systems across various areas and applications, leading to the development of network science as a core tool to study systems with multiple components and complex interactions. There is a growing interest in understanding the temporal dynamics of complex networks to decode the underlying dynamic processes through the temporal changes in network structure. Community detection algorithms, which are specialized clustering algorithms, have been instrumental in studying these temporal changes. They work by grouping nodes into communities based on the structure and intensity of network connections over time aiming to maximize modularity of the network partition. However, the performance of these algorithms is highly influenced by the selection of resolution parameters of the modularity function used, which dictate the scale of the represented network, both in size of communities and the temporal resolution of dynamic structure. The selection of these parameters has often been subjective and heavily reliant on the characteristics of the data used to create the network structure. Here, we introduce a method to objectively determine the values of the resolution parameters based on the elements of self-organization. We propose two key approaches: (1) minimization of the biases in spatial scale network characterization and (2) maximization of temporal scale-freeness. We demonstrate the effectiveness of these approaches using benchmark network structures as well as real-world datasets. To implement our method, we also provide an automated parameter selection software package that can be applied to a wide range of complex systems.
△ Less
Submitted 23 July, 2023;
originally announced July 2023.
-
Flexibility of brain regions during working memory curtails cognitive consequences to lack of sleep
Authors:
Nina Lauharatanahirun,
Kanika Bansal,
Steven M. Thurman,
Jean M. Vettel,
Barry Giesbrecht,
Scott Grafton,
James C. Elliott,
Erin Flynn-Evans,
Emily Falk,
Javier O. Garcia
Abstract:
Previous research has shown a clear relationship between sleep and memory, examining the impact of sleep deprivation on key cognitive processes over very short durations or in special populations. Here, we show, in a longitudinal 16 week study, that naturalistic, unfettered sleep modulations in healthy adults have significant impacts on the brain. Using a dynamic networks approach combined with hi…
▽ More
Previous research has shown a clear relationship between sleep and memory, examining the impact of sleep deprivation on key cognitive processes over very short durations or in special populations. Here, we show, in a longitudinal 16 week study, that naturalistic, unfettered sleep modulations in healthy adults have significant impacts on the brain. Using a dynamic networks approach combined with hierarchical statistical modelling, we show that the flexibility of particular brain regions that span a large network including regions in occipital, temporal, and frontal cortex increased when participants performed a working memory task following low sleep episodes. Critically, performance itself did not change as a function of sleep, implying adaptability in brain networks to compensate for having a poor night's sleep by recruiting the necessary resources to complete the task. We further explore whether this compensatory effect is driven by a (i) increase in the recruitment of network resources over time and/or (ii) an expansion of the network itself. Our results add to the literature linking sleep and memory, provide an analytical framework in which to investigate compensatory modulations in the brain, and highlight the brain's resilience to day-to-day fluctuations of external pressures to performance.
△ Less
Submitted 15 September, 2020;
originally announced September 2020.
-
Scale-specific dynamics of large-amplitude bursts in EEG capture behaviorally meaningful variability
Authors:
Kanika Bansal,
Javier O. Garcia,
Nina Lauharatanahirun,
Sarah F. Muldoon,
Paul Sajda,
Jean M. Vettel
Abstract:
Cascading large-amplitude bursts in neural activity, termed avalanches, are thought to provide insight into the complex spatially distributed interactions in neural systems. In human neuroimaging, for example, avalanches occurring during resting-state show scale-invariant dynamics, supporting the hypothesis that the brain operates near a critical point that enables long range spatial communication…
▽ More
Cascading large-amplitude bursts in neural activity, termed avalanches, are thought to provide insight into the complex spatially distributed interactions in neural systems. In human neuroimaging, for example, avalanches occurring during resting-state show scale-invariant dynamics, supporting the hypothesis that the brain operates near a critical point that enables long range spatial communication. In fact, it has been suggested that such scale-invariant dynamics, characterized by a power-law distribution in these avalanches, are universal in neural systems and emerge through a common mechanism. While the analysis of avalanches and subsequent criticality is increasingly seen as a framework for using complex systems theory to understand brain function, it is unclear how the framework would account for the omnipresent cognitive variability, whether across individuals and/or tasks. To address this, we analyzed avalanches in the EEG activity of healthy humans during rest as well as two distinct task conditions that varied in cognitive demands and produced behavioral measures unique to each individual. In both rest and task conditions we observed that avalanche dynamics demonstrate scale-invariant characteristics, but differ in their specific features, demonstrating individual variability. Using a new metric we call normalized engagement, which estimates the likelihood for a brain region to produce high-amplitude bursts, we also investigated regional features of avalanche dynamics. Normalized engagement showed not only the expected individual and task dependent variability, but also scale-specificity that correlated with individual behavior. Our findings expand our understanding of avalanche features and are supportive of the emerging theoretical idea that the dynamics of an active human brain operate close to a critical-like region and not a singular critical-state.
△ Less
Submitted 13 March, 2020;
originally announced March 2020.
-
Learning in brain-computer interface control evidenced by joint decomposition of brain and behavior
Authors:
Jennifer Stiso,
Marie-Constance Corsi,
Jean M. Vettel,
Javier O. Garcia,
Fabio Pasqualetti,
Fabrizio De Vico Fallani,
Timothy H. Lucas,
Danielle S. Bassett
Abstract:
Motor imagery-based brain-computer interfaces (BCIs) use an individuals ability to volitionally modulate localized brain activity as a therapy for motor dysfunction or to probe causal relations between brain activity and behavior. However, many individuals cannot learn to successfully modulate their brain activity, greatly limiting the efficacy of BCI for therapy and for basic scientific inquiry.…
▽ More
Motor imagery-based brain-computer interfaces (BCIs) use an individuals ability to volitionally modulate localized brain activity as a therapy for motor dysfunction or to probe causal relations between brain activity and behavior. However, many individuals cannot learn to successfully modulate their brain activity, greatly limiting the efficacy of BCI for therapy and for basic scientific inquiry. Previous research suggests that coherent activity across diverse cognitive systems is a hallmark of individuals who can successfully learn to control the BCI. However, little is known about how these distributed networks interact through time to support learning. Here, we address this gap in knowledge by constructing and applying a multimodal network approach to decipher brain-behavior relations in motor imagery-based brain-computer interface learning using MEG. Specifically, we employ a minimally constrained matrix decomposition method (non-negative matrix factorization) to simultaneously identify regularized, covarying subgraphs of functional connectivity, to assess their similarity to task performance, and to detect their time-varying expression. Individuals also displayed marked variation in the spatial properties of subgraphs such as the connectivity between the frontal lobe and the rest of the brain, and in the temporal properties of subgraphs such as the stage of learning at which they reached maximum expression. From these observations, we posit a conceptual model in which certain subgraphs support learning by modulating brain activity in regions important for sustaining attention. To test this model, we use tools that stipulate regional dynamics on a networked system (network control theory), and find that good learners display a single subgraph whose temporal expression tracked performance and whose architecture supports easy modulation of brain regions important for attention.
△ Less
Submitted 2 August, 2019; v1 submitted 31 July, 2019;
originally announced August 2019.
-
Cognitive chimera states in human brain networks
Authors:
Kanika Bansal,
Javier O. Garcia,
Steven H. Tompson,
Timothy Verstynen,
Jean M. Vettel,
Sarah F. Muldoon
Abstract:
The human brain is a complex dynamical system that gives rise to cognition through spatiotemporal patterns of coherent and incoherent activity between brain regions. As different regions dynamically interact to perform cognitive tasks, variable patterns of partial synchrony can be observed, forming chimera states. We propose that the emergence of such states plays a fundamental role in the cogniti…
▽ More
The human brain is a complex dynamical system that gives rise to cognition through spatiotemporal patterns of coherent and incoherent activity between brain regions. As different regions dynamically interact to perform cognitive tasks, variable patterns of partial synchrony can be observed, forming chimera states. We propose that the emergence of such states plays a fundamental role in the cognitive organization of the brain, and present a novel cognitively-informed, chimera-based framework to explore how large-scale brain architecture affects brain dynamics and function. Using personalized brain network models, we systematically study how regional brain stimulation produces different patterns of synchronization across predefined cognitive systems. We then analyze these emergent patterns within our novel framework to understand the impact of subject-specific and region-specific structural variability on brain dynamics. Our results suggest a classification of cognitive systems into four groups with differing levels of subject and regional variability that reflect their different functional roles.
△ Less
Submitted 5 July, 2018;
originally announced July 2018.
-
Compact Convolutional Neural Networks for Classification of Asynchronous Steady-state Visual Evoked Potentials
Authors:
Nicholas R. Waytowich,
Vernon Lawhern,
Javier O. Garcia,
Jennifer Cummings,
Josef Faller,
Paul Sajda,
Jean M. Vettel
Abstract:
Steady-State Visual Evoked Potentials (SSVEPs) are neural oscillations from the parietal and occipital regions of the brain that are evoked from flickering visual stimuli. SSVEPs are robust signals measurable in the electroencephalogram (EEG) and are commonly used in brain-computer interfaces (BCIs). However, methods for high-accuracy decoding of SSVEPs usually require hand-crafted approaches that…
▽ More
Steady-State Visual Evoked Potentials (SSVEPs) are neural oscillations from the parietal and occipital regions of the brain that are evoked from flickering visual stimuli. SSVEPs are robust signals measurable in the electroencephalogram (EEG) and are commonly used in brain-computer interfaces (BCIs). However, methods for high-accuracy decoding of SSVEPs usually require hand-crafted approaches that leverage domain-specific knowledge of the stimulus signals, such as specific temporal frequencies in the visual stimuli and their relative spatial arrangement. When this knowledge is unavailable, such as when SSVEP signals are acquired asynchronously, such approaches tend to fail. In this paper, we show how a compact convolutional neural network (Compact-CNN), which only requires raw EEG signals for automatic feature extraction, can be used to decode signals from a 12-class SSVEP dataset without the need for any domain-specific knowledge or calibration data. We report across subject mean accuracy of approximately 80% (chance being 8.3%) and show this is substantially better than current state-of-the-art hand-crafted approaches using canonical correlation analysis (CCA) and Combined-CCA. Furthermore, we analyze our Compact-CNN to examine the underlying feature representation, discovering that the deep learner extracts additional phase and amplitude related features associated with the structure of the dataset. We discuss how our Compact-CNN shows promise for BCI applications that allow users to freely gaze/attend to any stimulus at any time (e.g., asynchronous BCI) as well as provides a method for analyzing SSVEP signals in a way that might augment our understanding about the basic processing in the visual cortex.
△ Less
Submitted 9 October, 2018; v1 submitted 12 March, 2018;
originally announced March 2018.
-
Global Brain Dynamics During Social Exclusion Predict Subsequent Behavioral Conformity
Authors:
Nick Wasylyshyn,
Brett Hemenway,
Javier O. Garcia,
Christopher N. Cascio,
Matthew Brook O'Donnell,
C. Raymond Bingham,
Bruce Simons-Morton,
Jean M. Vettel,
Emily B. Falk
Abstract:
Individuals react differently to social experiences; for example, people who are more sensitive to negative social experiences, such as being excluded, may be more likely to adapt their behavior to fit in with others. We examined whether functional brain connectivity during social exclusion in the fMRI scanner can be used to predict subsequent conformity to peer norms. Adolescent males (N = 57) co…
▽ More
Individuals react differently to social experiences; for example, people who are more sensitive to negative social experiences, such as being excluded, may be more likely to adapt their behavior to fit in with others. We examined whether functional brain connectivity during social exclusion in the fMRI scanner can be used to predict subsequent conformity to peer norms. Adolescent males (N = 57) completed a two-part study on teen driving risk: a social exclusion task (Cyberball) during an fMRI session and a subsequent driving simulator session in which they drove alone and in the presence of a peer who expressed risk-averse or risk-accepting driving norms. We computed the difference in functional connectivity between social exclusion and social inclusion from each node in the brain to nodes in two brain networks, one previously associated with mentalizing (medial prefrontal cortex, temporoparietal junction, precuneus, temporal poles) and another with social pain (anterior cingulate cortex, anterior insula). Using cross-validated machine learning, this measure of global network connectivity during exclusion predicts the extent of conformity to peer pressure during driving in the subsequent experimental session. These findings extend our understanding of how global neural dynamics guide social behavior, revealing functional network activity that captures individual differences.
△ Less
Submitted 2 October, 2017;
originally announced October 2017.
-
Estimating direction in brain-behavior interactions: Proactive and reactive brain states in driving
Authors:
Javier O. Garcia,
Justin Brooks,
Scott Kerick,
Tony Johnson,
Tim Mullen,
Jean M. Vettel
Abstract:
Conventional neuroimaging analyses have revealed the computational specificity of localized brain regions, exploiting the power of the subtraction technique in fMRI and event-related potential analyses in EEG. Moving beyond this convention, many researchers have begun exploring network-based neurodynamics and coordination between brain regions as a function of behavioral parameters or environmenta…
▽ More
Conventional neuroimaging analyses have revealed the computational specificity of localized brain regions, exploiting the power of the subtraction technique in fMRI and event-related potential analyses in EEG. Moving beyond this convention, many researchers have begun exploring network-based neurodynamics and coordination between brain regions as a function of behavioral parameters or environmental statistics; however, most approaches average evoked activity across the experimental session to study task-dependent networks. Here, we examined on-going oscillatory activity and use a methodology to estimate directionality in brain-behavior interactions. After source reconstruction, activity within specific frequency bands in a priori regions of interest was linked to continuous behavioral measurements, and we used a predictive filtering scheme to estimate the asymmetry between brain-to-behavior and behavior-to-brain prediction. We applied this approach to a simulated driving task and examine directed relationships between brain activity and continuous driving behavior (steering or heading error). Our results indicated that two neuro-behavioral states emerge in this naturalistic environment: a Proactive brain state that actively plans the response to the sensory information, and a Reactive brain state that processes incoming information and reacts to environmental statistics.
△ Less
Submitted 14 June, 2016;
originally announced June 2016.
-
Mathematical and computational modeling for describing the basic behavior of free radicals and antioxidants within epithelial cells
Authors:
Alvaro Juan Ojeda Garcia
Abstract:
The traditional methods of the biology, based on illustrative descriptions and linear logic explanations, are discussed. This work aims to improve this approach by introducing alternative tools to describe and represent complex biological systems. Two models were developed, one mathematical and another computational, both were made in order to study the biological process between free radicals and…
▽ More
The traditional methods of the biology, based on illustrative descriptions and linear logic explanations, are discussed. This work aims to improve this approach by introducing alternative tools to describe and represent complex biological systems. Two models were developed, one mathematical and another computational, both were made in order to study the biological process between free radicals and antioxidants. Each model was used to study the same process but in different scenarios. The mathematical model was used to study the biological process in an epithelial cells culture; this model was validated with the experimental data of Anne Hanneken's research group from the Department of Molecular and Experimental Medicine, published by the journal Investigative Ophthalmology and Visual Science in July 2006. The computational model was used to study the same process in an individual. The model was made using C++ programming language, supported by the network theory of aging.
△ Less
Submitted 21 January, 2012;
originally announced January 2012.
