-
Fitting the Message to the Moment: Designing Calendar-Aware Stress Messaging with Large Language Models
Authors:
Pranav Rao,
Maryam Taj,
Alex Mariakakis,
Joseph Jay Williams,
Ananya Bhattacharjee
Abstract:
Existing stress-management tools fail to account for the timing and contextual specificity of students' daily lives, often providing static or misaligned support. Digital calendars contain rich, personal indicators of upcoming responsibilities, yet this data is rarely leveraged for adaptive wellbeing interventions. In this short paper, we explore how large language models (LLMs) might use digital…
▽ More
Existing stress-management tools fail to account for the timing and contextual specificity of students' daily lives, often providing static or misaligned support. Digital calendars contain rich, personal indicators of upcoming responsibilities, yet this data is rarely leveraged for adaptive wellbeing interventions. In this short paper, we explore how large language models (LLMs) might use digital calendar data to deliver timely and personalized stress support. We conducted a one-week study with eight university students using a functional technology probe that generated daily stress-management messages based on participants' calendar events. Through semi-structured interviews and thematic analysis, we found that participants valued interventions that prioritized stressful events and adopted a concise, but colloquial tone. These findings reveal key design implications for LLM-based stress-management tools, including the need for structured questioning and tone calibration to foster relevance and trust.
△ Less
Submitted 29 May, 2025;
originally announced May 2025.
-
Investigating the Role of Situational Disruptors in Engagement with Digital Mental Health Tools
Authors:
Ananya Bhattacharjee,
Joseph Jay Williams,
Miranda Beltzer,
Jonah Meyerhoff,
Harsh Kumar,
Haochen Song,
David C. Mohr,
Alex Mariakakis,
Rachel Kornfield
Abstract:
Challenges in engagement with digital mental health (DMH) tools are commonly addressed through technical enhancements and algorithmic interventions. This paper shifts the focus towards the role of users' broader social context as a significant factor in engagement. Through an eight-week text messaging program aimed at enhancing psychological wellbeing, we recruited 20 participants to help us ident…
▽ More
Challenges in engagement with digital mental health (DMH) tools are commonly addressed through technical enhancements and algorithmic interventions. This paper shifts the focus towards the role of users' broader social context as a significant factor in engagement. Through an eight-week text messaging program aimed at enhancing psychological wellbeing, we recruited 20 participants to help us identify situational engagement disruptors (SEDs), including personal responsibilities, professional obligations, and unexpected health issues. In follow-up design workshops with 25 participants, we explored potential solutions that address such SEDs: prioritizing self-care through structured goal-setting, alternative framings for disengagement, and utilization of external resources. Our findings challenge conventional perspectives on engagement and offer actionable design implications for future DMH tools.
△ Less
Submitted 25 February, 2025; v1 submitted 13 February, 2025;
originally announced February 2025.
-
Perfectly to a Tee: Understanding User Perceptions of Personalized LLM-Enhanced Narrative Interventions
Authors:
Ananya Bhattacharjee,
Sarah Yi Xu,
Pranav Rao,
Yuchen Zeng,
Jonah Meyerhoff,
Syed Ishtiaque Ahmed,
David C Mohr,
Michael Liut,
Alex Mariakakis,
Rachel Kornfield,
Joseph Jay Williams
Abstract:
Stories about overcoming personal struggles can effectively illustrate the application of psychological theories in real life, yet they may fail to resonate with individuals' experiences. In this work, we employ large language models (LLMs) to create tailored narratives that acknowledge and address unique challenging thoughts and situations faced by individuals. Our study, involving 346 young adul…
▽ More
Stories about overcoming personal struggles can effectively illustrate the application of psychological theories in real life, yet they may fail to resonate with individuals' experiences. In this work, we employ large language models (LLMs) to create tailored narratives that acknowledge and address unique challenging thoughts and situations faced by individuals. Our study, involving 346 young adults across two settings, demonstrates that personalized LLM-enhanced stories were perceived to be better than human-written ones in conveying key takeaways, promoting reflection, and reducing belief in negative thoughts. These stories were not only seen as more relatable but also similarly authentic to human-written ones, highlighting the potential of LLMs in helping young adults manage their struggles. The findings of this work provide crucial design considerations for future narrative-based digital mental health interventions, such as the need to maintain relatability without veering into implausibility and refining the wording and tone of AI-enhanced content.
△ Less
Submitted 12 May, 2025; v1 submitted 25 September, 2024;
originally announced September 2024.
-
Users' Perspectives on Multimodal Menstrual Tracking Using Consumer Health Devices
Authors:
Georgianna Lin,
Brenna Li,
Helen Li,
Chloe Zhao,
Khai N Truong,
Alex Mariakakis
Abstract:
Previous menstrual health literature highlights a variety of signals not included in existing menstrual trackers because they are either difficult to gather or are not typically associated with menstrual health. Since it has become increasingly convenient to collect biomarkers through wearables and other consumer-grade devices, our work examines how people incorporate unconventional signals (e.g.,…
▽ More
Previous menstrual health literature highlights a variety of signals not included in existing menstrual trackers because they are either difficult to gather or are not typically associated with menstrual health. Since it has become increasingly convenient to collect biomarkers through wearables and other consumer-grade devices, our work examines how people incorporate unconventional signals (e.g., blood glucose levels, heart rate) into their understanding of menstrual health. In this paper, we describe a three-month-long study on fifty participants' experiences as they tracked their health using physiological sensors and daily diaries. We analyzed their experiences with both conventional and unconventional menstrual health signals through surveys and interviews conducted throughout the study. We delve into the various aspects of menstrual health that participants sought to affirm using unconventional signals, explore how these signals influenced their daily behaviors, and examine how multimodal menstrual tracking expanded their scope of menstrual health. Finally, we provide design recommendations for future multimodal menstrual trackers.
△ Less
Submitted 5 September, 2024;
originally announced September 2024.
-
Understanding the Role of Large Language Models in Personalizing and Scaffolding Strategies to Combat Academic Procrastination
Authors:
Ananya Bhattacharjee,
Yuchen Zeng,
Sarah Yi Xu,
Dana Kulzhabayeva,
Minyi Ma,
Rachel Kornfield,
Syed Ishtiaque Ahmed,
Alex Mariakakis,
Mary P Czerwinski,
Anastasia Kuzminykh,
Michael Liut,
Joseph Jay Williams
Abstract:
Traditional interventions for academic procrastination often fail to capture the nuanced, individual-specific factors that underlie them. Large language models (LLMs) hold immense potential for addressing this gap by permitting open-ended inputs, including the ability to customize interventions to individuals' unique needs. However, user expectations and potential limitations of LLMs in this conte…
▽ More
Traditional interventions for academic procrastination often fail to capture the nuanced, individual-specific factors that underlie them. Large language models (LLMs) hold immense potential for addressing this gap by permitting open-ended inputs, including the ability to customize interventions to individuals' unique needs. However, user expectations and potential limitations of LLMs in this context remain underexplored. To address this, we conducted interviews and focus group discussions with 15 university students and 6 experts, during which a technology probe for generating personalized advice for managing procrastination was presented. Our results highlight the necessity for LLMs to provide structured, deadline-oriented steps and enhanced user support mechanisms. Additionally, our results surface the need for an adaptive approach to questioning based on factors like busyness. These findings offer crucial design implications for the development of LLM-based tools for managing procrastination while cautioning the use of LLMs for therapeutic guidance.
△ Less
Submitted 21 December, 2023;
originally announced December 2023.
-
Understanding User Perspectives on Prompts for Brief Reflection on Troubling Emotions
Authors:
Ananya Bhattacharjee,
Pan Chen,
Linjia Zhou,
Abhijoy Mandal,
Jai Aggarwal,
Katie O'Leary,
Anne Hsu,
Alex Mariakakis,
Joseph Jay Williams
Abstract:
We investigate users' perspectives on an online reflective question activity (RQA) that prompts people to externalize their underlying emotions on a troubling situation. Inspired by principles of cognitive behavioral therapy, our 15-minute activity encourages self-reflection without a human or automated conversational partner. A deployment of our RQA on Amazon Mechanical Turk suggests that people…
▽ More
We investigate users' perspectives on an online reflective question activity (RQA) that prompts people to externalize their underlying emotions on a troubling situation. Inspired by principles of cognitive behavioral therapy, our 15-minute activity encourages self-reflection without a human or automated conversational partner. A deployment of our RQA on Amazon Mechanical Turk suggests that people perceive several benefits from our RQA, including structured awareness of their thoughts and problem-solving around managing their emotions. Quantitative evidence from a randomized experiment suggests people find that our RQA makes them feel less worried by their selected situation and worth the minimal time investment. A further two-week technology probe deployment with 11 participants indicates that people see benefits to doing this activity repeatedly, although the activity may get monotonous over time. In summary, this work demonstrates the promise of online reflection activities that carefully leverage principles of psychology in their design.
△ Less
Submitted 20 December, 2021;
originally announced December 2021.
-
Online Mobile App Usage as an Indicator of Sleep Behavior and Job Performance
Authors:
Chunjong Park,
Morelle Arian,
Xin Liu,
Leon Sasson,
Jeffrey Kahn,
Shwetak Patel,
Alex Mariakakis,
Tim Althoff
Abstract:
Sleep is critical to human function, mediating factors like memory, mood, energy, and alertness; therefore, it is commonly conjectured that a good night's sleep is important for job performance. However, both real-world sleep behavior and job performance are hard to measure at scale. In this work, we show that people's everyday interactions with online mobile apps can reveal insights into their jo…
▽ More
Sleep is critical to human function, mediating factors like memory, mood, energy, and alertness; therefore, it is commonly conjectured that a good night's sleep is important for job performance. However, both real-world sleep behavior and job performance are hard to measure at scale. In this work, we show that people's everyday interactions with online mobile apps can reveal insights into their job performance in real-world contexts. We present an observational study in which we objectively tracked the sleep behavior and job performance of salespeople (N = 15) and athletes (N = 19) for 18 months, using a mattress sensor and online mobile app. We first demonstrate that cumulative sleep measures are correlated with job performance metrics, showing that an hour of daily sleep loss for a week was associated with a 9.0% and 9.5% reduction in performance of salespeople and athletes, respectively. We then examine the utility of online app interaction time as a passively collectible and scalable performance indicator. We show that app interaction time is correlated with the performance of the athletes, but not the salespeople. To support that our app-based performance indicator captures meaningful variation in psychomotor function and is robust against potential confounds, we conducted a second study to evaluate the relationship between sleep behavior and app interaction time in a cohort of 274 participants. Using a generalized additive model to control for per-participant random effects, we demonstrate that participants who lost one hour of daily sleep for a week exhibited 5.0% slower app interaction times. We also find that app interaction time exhibits meaningful chronobiologically consistent correlations with sleep history, time awake, and circadian rhythms. Our findings reveal an opportunity for online app developers to generate new insights regarding cognition and productivity.
△ Less
Submitted 24 February, 2021;
originally announced February 2021.
-
SplitSR: An End-to-End Approach to Super-Resolution on Mobile Devices
Authors:
Xin Liu,
Yuang Li,
Josh Fromm,
Yuntao Wang,
Ziheng Jiang,
Alex Mariakakis,
Shwetak Patel
Abstract:
Super-resolution (SR) is a coveted image processing technique for mobile apps ranging from the basic camera apps to mobile health. Existing SR algorithms rely on deep learning models with significant memory requirements, so they have yet to be deployed on mobile devices and instead operate in the cloud to achieve feasible inference time. This shortcoming prevents existing SR methods from being use…
▽ More
Super-resolution (SR) is a coveted image processing technique for mobile apps ranging from the basic camera apps to mobile health. Existing SR algorithms rely on deep learning models with significant memory requirements, so they have yet to be deployed on mobile devices and instead operate in the cloud to achieve feasible inference time. This shortcoming prevents existing SR methods from being used in applications that require near real-time latency. In this work, we demonstrate state-of-the-art latency and accuracy for on-device super-resolution using a novel hybrid architecture called SplitSR and a novel lightweight residual block called SplitSRBlock. The SplitSRBlock supports channel-splitting, allowing the residual blocks to retain spatial information while reducing the computation in the channel dimension. SplitSR has a hybrid design consisting of standard convolutional blocks and lightweight residual blocks, allowing people to tune SplitSR for their computational budget. We evaluate our system on a low-end ARM CPU, demonstrating both higher accuracy and up to 5 times faster inference than previous approaches. We then deploy our model onto a smartphone in an app called ZoomSR to demonstrate the first-ever instance of on-device, deep learning-based SR. We conducted a user study with 15 participants to have them assess the perceived quality of images that were post-processed by SplitSR. Relative to bilinear interpolation -- the existing standard for on-device SR -- participants showed a statistically significant preference when looking at both images (Z=-9.270, p<0.01) and text (Z=-6.486, p<0.01).
△ Less
Submitted 20 January, 2021;
originally announced January 2021.
-
Project Calico: Wearable Chemical Sensors for Environmental Monitoring
Authors:
Alex Mariakakis,
Sifang Chen,
Bichlien Nguyen,
Kirsten Bray,
Molly Blank,
Jonathan Lester,
Lauren Ryan,
Paul Johns,
Gonzalo Ramos,
Asta Roseway
Abstract:
Environmental hazards often go unnoticed because they are invisible to the naked eye, posing risks to our health over time. Project Calico aims to raise awareness of these risks by augmenting everyday fashion with color-changing chemical sensors that can be observed at a glance or captured by a smartphone camera. Project Calico leverages existing cosmetic and fabrication processes to democratize e…
▽ More
Environmental hazards often go unnoticed because they are invisible to the naked eye, posing risks to our health over time. Project Calico aims to raise awareness of these risks by augmenting everyday fashion with color-changing chemical sensors that can be observed at a glance or captured by a smartphone camera. Project Calico leverages existing cosmetic and fabrication processes to democratize environmental sensing, enabling creators to make their own accessories. We present two fashionable instantiations of Project Calico involving UV irradiation. EcoHair, created by hair treatment, is UV-sensitive hair that intensifies in color saturation depending on the UV intensity. EcoPatches, created by inkjet printing, can be worn as temporary tattoos that change their color to reflect cumulative UV exposure over time. We present findings from two focus groups regarding the Project Calico vision and gathered insights from their overall impressions and projected use patterns.
△ Less
Submitted 6 July, 2020; v1 submitted 27 June, 2020;
originally announced June 2020.