Accessible Text Descriptions for UpSet Plots
Authors:
Andrew McNutt,
Maggie K McCracken,
Ishrat Jahan Eliza,
Daniel Hajas,
Jake Wagoner,
Nate Lanza,
Jack Wilburn,
Sarah Creem-Regehr,
Alexander Lex
Abstract:
Data visualizations are typically not accessible to blind and low-vision (BLV) users. Automatically generating text descriptions offers an enticing mechanism for democratizing access to the information held in complex scientific charts, yet appropriate procedures for generating those texts remain elusive. Pursuing this issue, we study a single complex chart form: UpSet plots. UpSet Plots are a com…
▽ More
Data visualizations are typically not accessible to blind and low-vision (BLV) users. Automatically generating text descriptions offers an enticing mechanism for democratizing access to the information held in complex scientific charts, yet appropriate procedures for generating those texts remain elusive. Pursuing this issue, we study a single complex chart form: UpSet plots. UpSet Plots are a common way to analyze set data, an area largely unexplored by prior accessibility literature. By analyzing the patterns present in real-world examples, we develop a system for automatically captioning any UpSet plot. We evaluated the utility of our captions via semi-structured interviews with (N=11) BLV users and found that BLV users find them informative. In extensions, we find that sighted users can use our texts similarly to UpSet plots and that they are better than naive LLM usage.
△ Less
Submitted 21 March, 2025;
originally announced March 2025.
Stay in Touch! Shape and Shadow Influence Surface Contact in XR Displays
Authors:
Haley Adams,
Holly Gagnon,
Sarah Creem-Regehr,
Jeanine Stefanucci,
Bobby Bodenheimer
Abstract:
The information provided to a person's visual system by extended reality (XR) displays is not a veridical match to the information provided by the real world. Due in part to graphical limitations in XR head-mounted displays (HMDs), which vary by device, our perception of space may be altered. However, we do not yet know which properties of virtual objects rendered by HMDs -- particularly augmented…
▽ More
The information provided to a person's visual system by extended reality (XR) displays is not a veridical match to the information provided by the real world. Due in part to graphical limitations in XR head-mounted displays (HMDs), which vary by device, our perception of space may be altered. However, we do not yet know which properties of virtual objects rendered by HMDs -- particularly augmented reality displays -- influence our ability to understand space. In the current research, we evaluate how immersive graphics affect spatial perception across three unique XR displays: virtual reality (VR), video see-through augmented reality (VST AR), and optical see-through augmented reality (OST AR). We manipulated the geometry of the presented objects as well as the shading techniques for objects' cast shadows. Shape and shadow were selected for evaluation as they play an important role in determining where an object is in space by providing points of contact between an object and its environment -- be it real or virtual. Our results suggest that a non-photorealistic (NPR) shading technique, in this case for cast shadows, may be used to improve depth perception by enhancing perceived surface contact in XR. Further, the benefit of NPR graphics is more pronounced in AR than in VR displays. One's perception of ground contact is influenced by an object's shape, as well. However, the relationship between shape and surface contact perception is more complicated.
△ Less
Submitted 5 January, 2022;
originally announced January 2022.
