-
Non-invasive two-step strategy BCI: brain-muscle-hand interface
Authors:
Sun Ye,
Zuo Cuiming,
Zhang Rui,
Shi Bin,
Pang Yajing,
Gao Lingyun,
Zhao Bowei,
Wang Jing,
Yao Dezhong,
Liu Gang
Abstract:
Brain-computer interface enables direct interaction between brain and device. However, common brain-computer interfaces often employ one-step strategy that rely on non-natural paradigms, such as SSVEP-BCI and MI-BCI, are limited to specific scenarios, restricting their broader application. This paper first proposes a two-step strategic brain-muscular-hand interface (BMHI) based on biological evolu…
▽ More
Brain-computer interface enables direct interaction between brain and device. However, common brain-computer interfaces often employ one-step strategy that rely on non-natural paradigms, such as SSVEP-BCI and MI-BCI, are limited to specific scenarios, restricting their broader application. This paper first proposes a two-step strategic brain-muscular-hand interface (BMHI) based on biological evolutionary selection mechanism, by integrating the brain-muscle (BM) interface with the muscle-hand (MH) interface through crosstalk ("BMHI = BM + MH"). To verify the effectiveness of BMHI and the advantages of a two-step strategy inspired by natural evolution, we conducted offline, comparison (comparing BMHI (two-step) and brain-hand interface (one-step)), and online experiments (using BMHI to control a virtual/machine hand for daily tasks). The results show that: (1) BMHI is feasible and the prediction accuracy is 0.79; (2) Unlike traditional multi-layer neural networks that attempt to establish a direct brain-signal-to-action mapping through a single end-to-end process (brain-hand interface), BMHI incorporates the neuro-muscular transmission mechanisms evolved in biological systems as an intermediate constraint layer. This phased decoding strategy can reduce training time by approximately 18-fold and improve decoding accuracy; (3) In the online control experiment, both the virtual hand and the manipulator were able to successfully complete tasks, like moving objects such as boxes or plates and holding water glasses. The results show that BMHI adopts a two-step decoding strategy that mimics natural human neural motor pathways, improves training efficiency and prediction accuracy, and promotes the development of BCI technology to a more natural interaction mode.
△ Less
Submitted 27 May, 2025;
originally announced June 2025.
-
Synthetic Biology meets Neuromorphic Computing: Towards a bio-inspired Olfactory Perception System
Authors:
Kevin Max,
Larissa Sames,
Shimeng Ye,
Jan Steinkühler,
Federico Corradi
Abstract:
In this study, we explore how the combination of synthetic biology, neuroscience modeling, and neuromorphic electronic systems offers a new approach to creating an artificial system that mimics the natural sense of smell. We argue that a co-design approach offers significant advantages in replicating the complex dynamics of odor sensing and processing. We investigate a hybrid system of synthetic s…
▽ More
In this study, we explore how the combination of synthetic biology, neuroscience modeling, and neuromorphic electronic systems offers a new approach to creating an artificial system that mimics the natural sense of smell. We argue that a co-design approach offers significant advantages in replicating the complex dynamics of odor sensing and processing. We investigate a hybrid system of synthetic sensory neurons that provides three key features: a) receptor-gated ion channels, b) interface between synthetic biology and semiconductors and c) event-based encoding and computing based on spiking networks. This research seeks to develop a platform for ultra-sensitive, specific, and energy-efficient odor detection, with potential implications for environmental monitoring, medical diagnostics, and security.
△ Less
Submitted 14 April, 2025;
originally announced April 2025.
-
Accurate Prediction of Antibody Function and Structure Using Bio-Inspired Antibody Language Model
Authors:
Hongtai Jing,
Zhengtao Gao,
Sheng Xu,
Tao Shen,
Zhangzhi Peng,
Shwai He,
Tao You,
Shuang Ye,
Wei Lin,
Siqi Sun
Abstract:
In recent decades, antibodies have emerged as indispensable therapeutics for combating diseases, particularly viral infections. However, their development has been hindered by limited structural information and labor-intensive engineering processes. Fortunately, significant advancements in deep learning methods have facilitated the precise prediction of protein structure and function by leveraging…
▽ More
In recent decades, antibodies have emerged as indispensable therapeutics for combating diseases, particularly viral infections. However, their development has been hindered by limited structural information and labor-intensive engineering processes. Fortunately, significant advancements in deep learning methods have facilitated the precise prediction of protein structure and function by leveraging co-evolution information from homologous proteins. Despite these advances, predicting the conformation of antibodies remains challenging due to their unique evolution and the high flexibility of their antigen-binding regions. Here, to address this challenge, we present the Bio-inspired Antibody Language Model (BALM). This model is trained on a vast dataset comprising 336 million 40% non-redundant unlabeled antibody sequences, capturing both unique and conserved properties specific to antibodies. Notably, BALM showcases exceptional performance across four antigen-binding prediction tasks. Moreover, we introduce BALMFold, an end-to-end method derived from BALM, capable of swiftly predicting full atomic antibody structures from individual sequences. Remarkably, BALMFold outperforms those well-established methods like AlphaFold2, IgFold, ESMFold, and OmegaFold in the antibody benchmark, demonstrating significant potential to advance innovative engineering and streamline therapeutic antibody development by reducing the need for unnecessary trials.
△ Less
Submitted 31 August, 2023;
originally announced August 2023.
-
AmadeusGPT: a natural language interface for interactive animal behavioral analysis
Authors:
Shaokai Ye,
Jessy Lauer,
Mu Zhou,
Alexander Mathis,
Mackenzie W. Mathis
Abstract:
The process of quantifying and analyzing animal behavior involves translating the naturally occurring descriptive language of their actions into machine-readable code. Yet, codifying behavior analysis is often challenging without deep understanding of animal behavior and technical machine learning knowledge. To limit this gap, we introduce AmadeusGPT: a natural language interface that turns natura…
▽ More
The process of quantifying and analyzing animal behavior involves translating the naturally occurring descriptive language of their actions into machine-readable code. Yet, codifying behavior analysis is often challenging without deep understanding of animal behavior and technical machine learning knowledge. To limit this gap, we introduce AmadeusGPT: a natural language interface that turns natural language descriptions of behaviors into machine-executable code. Large-language models (LLMs) such as GPT3.5 and GPT4 allow for interactive language-based queries that are potentially well suited for making interactive behavior analysis. However, the comprehension capability of these LLMs is limited by the context window size, which prevents it from remembering distant conversations. To overcome the context window limitation, we implement a novel dual-memory mechanism to allow communication between short-term and long-term memory using symbols as context pointers for retrieval and saving. Concretely, users directly use language-based definitions of behavior and our augmented GPT develops code based on the core AmadeusGPT API, which contains machine learning, computer vision, spatio-temporal reasoning, and visualization modules. Users then can interactively refine results, and seamlessly add new behavioral modules as needed. We benchmark AmadeusGPT and show we can produce state-of-the-art performance on the MABE 2022 behavior challenge tasks. Note, an end-user would not need to write any code to achieve this. Thus, collectively AmadeusGPT presents a novel way to merge deep biological knowledge, large-language models, and core computer vision modules into a more naturally intelligent system. Code and demos can be found at: https://github.com/AdaptiveMotorControlLab/AmadeusGPT.
△ Less
Submitted 10 July, 2023;
originally announced July 2023.
-
Template-based eukaryotic genome editing directed by SviCas3
Authors:
Wang-Yu Tong,
Yong Li,
Shou-Dong Ye,
An-Jing Wang,
Yan-Yan Tang,
Mei-Li Li,
Zhong-Fan Yu,
Ting-Ting Xia,
Qing-Yang Liu,
Si-Qi Zhu
Abstract:
RNA-guided gene editing based on the CRISPR-Cas system is currently the most effective genome editing technique. Here, we report that the SviCas3 from the subtype I-B-Svi Cas system in Streptomyces virginiae IBL14 is an RNA-guided and DNA-guided DNA endonuclease suitable for the HDR-directed gene and/or base editing of eukaryotic cell genomes. The genome editing efficiency of SviCas3 guided by DNA…
▽ More
RNA-guided gene editing based on the CRISPR-Cas system is currently the most effective genome editing technique. Here, we report that the SviCas3 from the subtype I-B-Svi Cas system in Streptomyces virginiae IBL14 is an RNA-guided and DNA-guided DNA endonuclease suitable for the HDR-directed gene and/or base editing of eukaryotic cell genomes. The genome editing efficiency of SviCas3 guided by DNA is no less than that of SviCas3 guided by RNA. In particular, t-DNA, as a template and a guide, does not require a proto-spacer-adjacent motif, demonstrating that CRISPR, as the basis for crRNA design, is not required for the SviCas3-mediated gene and base editing. This discovery will broaden our understanding of enzyme diversity in CRISPR-Cas systems, will provide important tools for the creation and modification of living things and the treatment of human genetic diseases, and will usher in a new era of DNA-guided gene editing and base editing.
△ Less
Submitted 9 May, 2023;
originally announced May 2023.
-
SuperAnimal pretrained pose estimation models for behavioral analysis
Authors:
Shaokai Ye,
Anastasiia Filippova,
Jessy Lauer,
Steffen Schneider,
Maxime Vidal,
Tian Qiu,
Alexander Mathis,
Mackenzie Weygandt Mathis
Abstract:
Quantification of behavior is critical in applications ranging from neuroscience, veterinary medicine and animal conservation efforts. A common key step for behavioral analysis is first extracting relevant keypoints on animals, known as pose estimation. However, reliable inference of poses currently requires domain knowledge and manual labeling effort to build supervised models. We present a serie…
▽ More
Quantification of behavior is critical in applications ranging from neuroscience, veterinary medicine and animal conservation efforts. A common key step for behavioral analysis is first extracting relevant keypoints on animals, known as pose estimation. However, reliable inference of poses currently requires domain knowledge and manual labeling effort to build supervised models. We present a series of technical innovations that enable a new method, collectively called SuperAnimal, to develop unified foundation models that can be used on over 45 species, without additional human labels. Concretely, we introduce a method to unify the keypoint space across differently labeled datasets (via our generalized data converter) and for training these diverse datasets in a manner such that they don't catastrophically forget keypoints given the unbalanced inputs (via our keypoint gradient masking and memory replay approaches). These models show excellent performance across six pose benchmarks. Then, to ensure maximal usability for end-users, we demonstrate how to fine-tune the models on differently labeled data and provide tooling for unsupervised video adaptation to boost performance and decrease jitter across frames. If the models are fine-tuned, we show SuperAnimal models are 10-100$\times$ more data efficient than prior transfer-learning-based approaches. We illustrate the utility of our models in behavioral classification in mice and gait analysis in horses. Collectively, this presents a data-efficient solution for animal pose estimation.
△ Less
Submitted 30 December, 2023; v1 submitted 14 March, 2022;
originally announced March 2022.
-
Local Causal Structure Learning and its Discovery Between Type 2 Diabetes and Bone Mineral Density
Authors:
Wei Wang,
Gangqiang Hu,
Bo Yuan,
Shandong Ye,
Chao Chen,
YaYun Cui,
Xi Zhang,
Liting Qian
Abstract:
Type 2 diabetes (T2DM), one of the most prevalent chronic diseases, affects the glucose metabolism of the human body, which decreases the quantity of life and brings a heavy burden on social medical care. Patients with T2DM are more likely to suffer bone fragility fracture as diabetes affects bone mineral density (BMD). However, the discovery of the determinant factors of BMD in a medical way is e…
▽ More
Type 2 diabetes (T2DM), one of the most prevalent chronic diseases, affects the glucose metabolism of the human body, which decreases the quantity of life and brings a heavy burden on social medical care. Patients with T2DM are more likely to suffer bone fragility fracture as diabetes affects bone mineral density (BMD). However, the discovery of the determinant factors of BMD in a medical way is expensive and time-consuming. In this paper, we propose a novel algorithm, Prior-Knowledge-driven local Causal structure Learning (PKCL), to discover the underlying causal mechanism between BMD and its factors from the clinical data. Since there exist limited data but redundant prior knowledge for medicine, PKCL adequately utilize the prior knowledge to mine the local causal structure for the target relationship. Combining the medical prior knowledge with the discovered causal relationships, PKCL can achieve more reliable results without long-standing medical statistical experiments. Extensive experiments are conducted on a newly provided clinical data set. The experimental study of PKCL on the data is proved to highly corresponding with existing medical knowledge, which demonstrates the superiority and effectiveness of PKCL. To illustrate the importance of prior knowledge, the result of the algorithm without prior knowledge is also investigated.
△ Less
Submitted 27 June, 2020;
originally announced June 2020.
