Inferring Mood-While-Eating with Smartphone Sensing and Community-Based Model Personalization
Authors:
Wageesha Bangamuarachchi,
Anju Chamantha,
Lakmal Meegahapola,
Haeeun Kim,
Salvador Ruiz-Correa,
Indika Perera,
Daniel Gatica-Perez
Abstract:
The interplay between mood and eating episodes has been extensively researched, revealing a connection between the two. Previous studies have relied on questionnaires and mobile phone self-reports to investigate the relationship between mood and eating. However, current literature exhibits several limitations: a lack of investigation into the generalization of mood inference models trained with da…
▽ More
The interplay between mood and eating episodes has been extensively researched, revealing a connection between the two. Previous studies have relied on questionnaires and mobile phone self-reports to investigate the relationship between mood and eating. However, current literature exhibits several limitations: a lack of investigation into the generalization of mood inference models trained with data from various everyday life situations to specific contexts like eating; an absence of studies using sensor data to explore the intersection of mood and eating; and inadequate examination of model personalization techniques within limited label settings, a common challenge in mood inference (i.e., far fewer negative mood reports compared to positive or neutral reports). In this study, we sought to examine everyday eating behavior and mood using two datasets of college students in Mexico (N_mex = 84, 1843 mood-while-eating reports) and eight countries (N_mul = 678, 24K mood-while-eating reports), which contain both passive smartphone sensing and self-report data. Our results indicate that generic mood inference models experience a decline in performance in specific contexts, such as during eating, highlighting the issue of sub-context shifts in mobile sensing. Moreover, we discovered that population-level (non-personalized) and hybrid (partially personalized) modeling techniques fall short in the commonly used three-class mood inference task (positive, neutral, negative). To overcome these limitations, we implemented a novel community-based personalization approach. Our findings demonstrate that mood-while-eating can be inferred with accuracies 63.8% (with F1-score of 62.5) for the MEX dataset and 88.3% (with F1-score of 85.7) with the MUL dataset using community-based models, surpassing those achieved with traditional methods.
△ Less
Submitted 5 March, 2025; v1 submitted 1 June, 2023;
originally announced June 2023.
Sensing Eating Events in Context: A Smartphone-Only Approach
Authors:
Wageesha Bangamuarachchi,
Anju Chamantha,
Lakmal Meegahapola,
Salvador Ruiz-Correa,
Indika Perera,
Daniel Gatica-Perez
Abstract:
While the task of automatically detecting eating events has been examined in prior work using various wearable devices, the use of smartphones as standalone devices to infer eating events remains an open issue. This paper proposes a framework that infers eating vs. non-eating events from passive smartphone sensing and evaluates it on a dataset of 58 college students. First, we show that time of th…
▽ More
While the task of automatically detecting eating events has been examined in prior work using various wearable devices, the use of smartphones as standalone devices to infer eating events remains an open issue. This paper proposes a framework that infers eating vs. non-eating events from passive smartphone sensing and evaluates it on a dataset of 58 college students. First, we show that time of the day and features from modalities such as screen usage, accelerometer, app usage, and location are indicative of eating and non-eating events. Then, we show that eating events can be inferred with an AUROC (area under the receiver operating characteristics curve) of 0.65 using subject-independent machine learning models, which can be further improved up to 0.81 for subject-dependent and 0.81 for hybrid models using personalization techniques. Moreover, we show that users have different behavioral and contextual routines around eating episodes requiring specific feature groups to train fully personalized models. These findings are of potential value for future mobile food diary apps that are context-aware by enabling scalable sensing-based eating studies using only smartphones; detecting under-reported eating events, thus increasing data quality in self report-based studies; providing functionality to track food consumption and generate reminders for on-time collection of food diaries; and supporting mobile interventions towards healthy eating practices.
△ Less
Submitted 31 May, 2022; v1 submitted 27 May, 2022;
originally announced May 2022.
