Showing 1–4 of 4 results for author: Macintyre, B

Adaptive 3D UI Placement in Mixed Reality Using Deep Reinforcement Learning

Authors: Feiyu Lu, Mengyu Chen, Hsiang Hsu, Pranav Deshpande, Cheng Yao Wang, Blair MacIntyre

Abstract: Mixed Reality (MR) could assist users' tasks by continuously integrating virtual content with their view of the physical environment. However, where and how to place these content to best support the users has been a challenging problem due to the dynamic nature of MR experiences. In contrast to prior work that investigates optimization-based methods, we are exploring how reinforcement learning (R… ▽ More Mixed Reality (MR) could assist users' tasks by continuously integrating virtual content with their view of the physical environment. However, where and how to place these content to best support the users has been a challenging problem due to the dynamic nature of MR experiences. In contrast to prior work that investigates optimization-based methods, we are exploring how reinforcement learning (RL) could assist with continuous 3D content placement that is aware of users' poses and their surrounding environments. Through an initial exploration and preliminary evaluation, our results demonstrate the potential of RL to position content that maximizes the reward for users on the go. We further identify future directions for research that could harness the power of RL for personalized and optimized UI and content placement in MR. △ Less

Submitted 30 April, 2025; originally announced April 2025.

Comments: In Extended Abstracts of the CHI Conference on Human Factors in Computing Systems (CHI EA '24)

Journal ref: In CHI EA 2024. ACM, New York, NY, USA, Article 32 (2024)

Examining the Effects of Immersive and Non-Immersive Presenter Modalities on Engagement and Social Interaction in Co-located Augmented Presentations

Authors: Matt Gottsacker, Mengyu Chen, David Saffo, Feiyu Lu, Benjamin Lee, Blair MacIntyre

Abstract: Head-worn augmented reality (AR) allows audiences to be immersed and engaged in stories told by live presenters. While presenters may also be in AR to have the same level of immersion and awareness as their audience, this symmetric presentation style may diminish important social cues such as eye contact. In this work, we examine the effects this (a)symmetry has on engagement, group awareness, and… ▽ More Head-worn augmented reality (AR) allows audiences to be immersed and engaged in stories told by live presenters. While presenters may also be in AR to have the same level of immersion and awareness as their audience, this symmetric presentation style may diminish important social cues such as eye contact. In this work, we examine the effects this (a)symmetry has on engagement, group awareness, and social interaction in co-located one-on-one augmented presentations. We developed a presentation system incorporating 2D/3D content that audiences can view and interact with in AR, with presenters controlling and delivering the presentation in either a symmetric style in AR, or an asymmetric style with a handheld tablet. We conducted a within- and between-subjects evaluation with 12 participant pairs to examine the differences between these symmetric and asymmetric presentation modalities. From our findings, we extracted four themes and derived strategies and guidelines for designers interested in augmented presentations. △ Less

Submitted 17 March, 2025; originally announced March 2025.

Content Generation for Workforce Training

Authors: Holly Rushmeier, Kapil Chalil Madathil, Jessica Hodgins, Beth Mynatt, Tony Derose, Blair Macintyre, other workshop participants

Abstract: Efficient workforce training is needed in today's world in which technology is continually changing the nature of work. Students need to be prepared to enter the workforce. Employees need to become lifelong learners to stay up-to-date in their work and to adapt when job functions are eliminated. The training needs are across all industries - including manufacturing, construction, and healthcare. C… ▽ More Efficient workforce training is needed in today's world in which technology is continually changing the nature of work. Students need to be prepared to enter the workforce. Employees need to become lifelong learners to stay up-to-date in their work and to adapt when job functions are eliminated. The training needs are across all industries - including manufacturing, construction, and healthcare. Computing systems, in particular Virtual/Augmented Reality systems, have been adopted in many training application and show even more promise in the future. However, there are fundamental limitations in today's systems that limit the domains where computing systems can be applied and the extent to which they can be deployed. These limitations need to be addressed by new computing research. In particular research is needed at multiple levels: - Application Data Collection Level Requiring High Security and Privacy Protections - Training Material Authoring Level - Software Systems Level - Hardware Level To accomplish these research goals, a training community needs to be established to do research in end-to-end training systems and to create a community of learning and domain experts available for consulting for in depth computing research on individual system components. △ Less

Submitted 11 December, 2019; originally announced December 2019.

Comments: A Computing Community Consortium (CCC) workshop report, 21 pages

Report number: ccc2019report_7

VisAR: Bringing Interactivity to Static Data Visualizations through Augmented Reality

Authors: Taeheon Kim, Bahador Saket, Alex Endert, Blair MacIntyre

Abstract: Static visualizations have analytic and expressive value. However, many interactive tasks cannot be completed using static visualizations. As datasets grow in size and complexity, static visualizations start losing their analytic and expressive power for interactive data exploration. Despite this limitation of static visualizations, there are still many cases where visualizations are limited to be… ▽ More Static visualizations have analytic and expressive value. However, many interactive tasks cannot be completed using static visualizations. As datasets grow in size and complexity, static visualizations start losing their analytic and expressive power for interactive data exploration. Despite this limitation of static visualizations, there are still many cases where visualizations are limited to being static (e.g., visualizations on presentation slides or posters). We believe in many of these cases, static visualizations will benefit from allowing users to perform interactive tasks on them. Inspired by the introduction of numerous commercial personal augmented reality (AR) devices, we propose an AR solution that allows interactive data exploration of datasets on static visualizations. In particular, we present a prototype system named VisAR that uses the Microsoft Hololens to enable users to complete interactive tasks on static visualizations. △ Less

Submitted 4 August, 2017; originally announced August 2017.