Foundation Models for Wearable Movement Data in Mental Health Research
Authors:
Franklin Y. Ruan,
Aiwei Zhang,
Jenny Y. Oh,
SouYoung Jin,
Nicholas C. Jacobson
Abstract:
Pretrained foundation models and transformer architectures have driven the success of large language models (LLMs) and other modern AI breakthroughs. However, similar advancements in health data modeling remain limited due to the need for innovative adaptations. Wearable movement data offers a valuable avenue for exploration, as it's a core feature in nearly all commercial smartwatches, well estab…
▽ More
Pretrained foundation models and transformer architectures have driven the success of large language models (LLMs) and other modern AI breakthroughs. However, similar advancements in health data modeling remain limited due to the need for innovative adaptations. Wearable movement data offers a valuable avenue for exploration, as it's a core feature in nearly all commercial smartwatches, well established in clinical and mental health research, and the sequential nature of the data shares similarities to language. We introduce the Pretrained Actigraphy Transformer (PAT), the first open source foundation model designed for time-series wearable movement data. Leveraging transformer-based architectures and novel techniques, such as patch embeddings, and pretraining on data from 29,307 participants in a national U.S. sample, PAT achieves state-of-the-art performance in several mental health prediction tasks. PAT is also lightweight and easily interpretable, making it a robust tool for mental health research.
GitHub: https://github.com/njacobsonlab/Pretrained-Actigraphy-Transformer/
△ Less
Submitted 28 June, 2025; v1 submitted 21 November, 2024;
originally announced November 2024.
