-
Insights from Designing Context-Aware Meal Preparation Assistance for Older Adults with Mild Cognitive Impairment (MCI) and Their Care Partners
Authors:
Szeyi Chan,
Jiachen Li,
Siman Ao,
Yufei Wang,
Ibrahim Bilau,
Brian Jones,
Eunhwa Yang,
Elizabeth D Mynatt,
Xiang Zhi Tan
Abstract:
Older adults with mild cognitive impairment (MCI) often face challenges during meal preparation, such as forgetting ingredients, skipping steps, or leaving appliances on, which can compromise their safety and independence. Our study explores the design of context-aware assistive technologies for meal preparation using a user-centered iterative design process. Through three iterative phases of desi…
▽ More
Older adults with mild cognitive impairment (MCI) often face challenges during meal preparation, such as forgetting ingredients, skipping steps, or leaving appliances on, which can compromise their safety and independence. Our study explores the design of context-aware assistive technologies for meal preparation using a user-centered iterative design process. Through three iterative phases of design and feedback, evolving from low-tech lightbox to a digital screen, we gained insights into managing diverse contexts and personalizing assistance through collaboration with older adults with MCI and their care partners. We concluded our findings in three key contexts--routine-based, real-time, and situational--that informed strategies for designing context-aware meal prep assistance tailored to users' needs. Our results provide actionable insights for creating technologies to assist meal preparation that are personalized for the unique lifestyles of older adults with MCI, situated in the complex and dynamic homebound context, and respecting the collaboration between older adults and their care partners.
△ Less
Submitted 5 June, 2025;
originally announced June 2025.
-
Coherence-Driven Multimodal Safety Dialogue with Active Learning for Embodied Agents
Authors:
Sabit Hassan,
Hye-Young Chung,
Xiang Zhi Tan,
Malihe Alikhani
Abstract:
When assisting people in daily tasks, robots need to accurately interpret visual cues and respond effectively in diverse safety-critical situations, such as sharp objects on the floor. In this context, we present M-CoDAL, a multimodal-dialogue system specifically designed for embodied agents to better understand and communicate in safety-critical situations. The system leverages discourse coherenc…
▽ More
When assisting people in daily tasks, robots need to accurately interpret visual cues and respond effectively in diverse safety-critical situations, such as sharp objects on the floor. In this context, we present M-CoDAL, a multimodal-dialogue system specifically designed for embodied agents to better understand and communicate in safety-critical situations. The system leverages discourse coherence relations to enhance its contextual understanding and communication abilities. To train this system, we introduce a novel clustering-based active learning mechanism that utilizes an external Large Language Model (LLM) to identify informative instances. Our approach is evaluated using a newly created multimodal dataset comprising 1K safety violations extracted from 2K Reddit images. These violations are annotated using a Large Multimodal Model (LMM) and verified by human annotators. Results with this dataset demonstrate that our approach improves resolution of safety situations, user sentiment, as well as safety of the conversation. Next, we deploy our dialogue system on a Hello Robot Stretch robot and conduct a within-subject user study with real-world participants. In the study, participants role-play two safety scenarios with different levels of severity with the robot and receive interventions from our model and a baseline system powered by OpenAI's ChatGPT. The study results corroborate and extend the findings from the automated evaluation, showing that our proposed system is more persuasive in a real-world embodied agent setting.
△ Less
Submitted 25 February, 2025; v1 submitted 17 October, 2024;
originally announced October 2024.
-
Person Transfer in the Field: Examining Real World Sequential Human-Robot Interaction Between Two Robots
Authors:
Xiang Zhi Tan,
Elizabeth J. Carter,
Aaron Steinfeld
Abstract:
With more robots being deployed in the world, users will likely interact with multiple robots sequentially when receiving services. In this paper, we describe an exploratory field study in which unsuspecting participants experienced a ``person transfer'' -- a scenario in which they first interacted with one stationary robot before another mobile robot joined to complete the interaction. In our 7-h…
▽ More
With more robots being deployed in the world, users will likely interact with multiple robots sequentially when receiving services. In this paper, we describe an exploratory field study in which unsuspecting participants experienced a ``person transfer'' -- a scenario in which they first interacted with one stationary robot before another mobile robot joined to complete the interaction. In our 7-hour study spanning 4 days, we recorded 18 instances of person transfers with 40+ individuals. We also interviewed 11 participants after the interaction to further understand their experience. We used the recorded video and interview data to extract interesting insights about in-the-field sequential human-robot interaction, such as mobile robot handovers, trust in person transfer, and the importance of the robots' positions. Our findings expose pitfalls and present important factors to consider when designing sequential human-robot interaction.
△ Less
Submitted 10 June, 2024;
originally announced June 2024.
-
Trajectories of long duration balloons launched from McMurdo Station in Antarctica
Authors:
Christopher Geach,
Shaul Hanany,
Chiou Yang Tan,
Xin Zhi Tan
Abstract:
The Columbia Scientific Ballooning Facility operates stratospheric balloon flights out of McMurdo Station in Antarctica. We use balloon trajectory data from 40 flights between 1991 and 2016 to give the first quantification of trajectory statistics. We provide the probabilities as a function of time for the payload to be between given latitudes, and we quantify the southernmost and northernmost lat…
▽ More
The Columbia Scientific Ballooning Facility operates stratospheric balloon flights out of McMurdo Station in Antarctica. We use balloon trajectory data from 40 flights between 1991 and 2016 to give the first quantification of trajectory statistics. We provide the probabilities as a function of time for the payload to be between given latitudes, and we quantify the southernmost and northernmost latitudes a payload is likely to attain. We find that for the median flight duration of 19 days, there is 90% probability the balloon would drift as far south as $88^{\circ}$S or as far north as $71^{\circ}$S; shorter flights are likely to experience smaller ranges in latitude. These statistics, which are available digitally in the public domain, will enable scientists planning future balloon flights make informed decisions during both mission design and execution.
△ Less
Submitted 20 May, 2021; v1 submitted 10 May, 2021;
originally announced May 2021.
-
Optical Design of PICO, a Concept for a Space Mission to Probe Inflation and Cosmic Origins
Authors:
Karl Young,
Marcelo Alvarez,
Nicholas Battaglia,
Jamie Bock,
Julian Borrill,
David Chuss,
Brendan Crill,
Jacques Delabrouille,
Mark Devlin,
Laura Fissel,
Raphael Flauger,
Daniel Green,
Kris Gorski,
Shaul Hanany,
Richard Hills,
Johannes Hubmayr,
Bradley Johnson,
Bill Jones,
Lloyd Knox,
Al Kogut,
Charles Lawrence,
Tomotake Matsumura,
Jim McGuire,
Jeff McMahon,
Roger O'Brient
, et al. (6 additional authors not shown)
Abstract:
The Probe of Inflation and Cosmic Origins (PICO) is a probe-class mission concept currently under study by NASA. PICO will probe the physics of the Big Bang and the energy scale of inflation, constrain the sum of neutrino masses, measure the growth of structures in the universe, and constrain its reionization history by making full sky maps of the cosmic microwave background with sensitivity 80 ti…
▽ More
The Probe of Inflation and Cosmic Origins (PICO) is a probe-class mission concept currently under study by NASA. PICO will probe the physics of the Big Bang and the energy scale of inflation, constrain the sum of neutrino masses, measure the growth of structures in the universe, and constrain its reionization history by making full sky maps of the cosmic microwave background with sensitivity 80 times higher than the Planck space mission. With bands at 21-799 GHz and arcmin resolution at the highest frequencies, PICO will make polarization maps of Galactic synchrotron and dust emission to observe the role of magnetic fields in Milky Way's evolution and star formation. We discuss PICO's optical system, focal plane, and give current best case noise estimates. The optical design is a two-reflector optimized open-Dragone design with a cold aperture stop. It gives a diffraction limited field of view (DLFOV) with throughput of 910 square cm sr at 21 GHz. The large 82 square degree DLFOV hosts 12,996 transition edge sensor bolometers distributed in 21 frequency bands and maintained at 0.1 K. We use focal plane technologies that are currently implemented on operating CMB instruments including three-color multi-chroic pixels and multiplexed readouts. To our knowledge, this is the first use of an open-Dragone design for mm-wave astrophysical observations, and the only monolithic CMB instrument to have such a broad frequency coverage. With current best case estimate polarization depth of 0.65 microK(CMB}-arcmin over the entire sky, PICO is the most sensitive CMB instrument designed to date.
△ Less
Submitted 3 August, 2018;
originally announced August 2018.
