-
Illustrating Transition Scenarios to Renewable Energy in Hawaii with ProjecTable
Authors:
Tracy Bui,
Kari Noe,
Marissa Halim,
Nurit Kirshenbaum,
Jason Leigh
Abstract:
Creating engaging and immersive data visualization tools has become increasingly significant for a wide range of users who want to display their data in a meaningful way. However, this can be limiting for individuals with varying levels of coding expertise. There are specific needs, such as visualizing complex data in easily understandable ways, highlighting real-world problems, or telling a story…
▽ More
Creating engaging and immersive data visualization tools has become increasingly significant for a wide range of users who want to display their data in a meaningful way. However, this can be limiting for individuals with varying levels of coding expertise. There are specific needs, such as visualizing complex data in easily understandable ways, highlighting real-world problems, or telling a story with data. The Makawalu Visualization Environment (VE) package aims to address these needs through three distinct modular tools: Author, Presenter, and Editor. These tools work together to facilitate different use cases based on the user's requirements. This paper discusses the latest version of the ProjecTable and focuses on the design and usage of the Makawalu VE Author and Presenter tools.
△ Less
Submitted 14 December, 2024;
originally announced December 2024.
-
ArticulatePro: A Comparative Study on a Proactive and Non-Proactive Assistant in a Climate Data Exploration Task
Authors:
Roderick Tabalba,
Christopher J. Lee,
Giorgio Tran,
Nurit Kirshenbaum,
Jason Leigh
Abstract:
Recent advances in Natural Language Interfaces (NLIs) and Large Language Models (LLMs) have transformed our approach to NLP tasks, shifting the focus towards a more Pragmatics-based approach. This shift enables more natural interactions between humans and voice assistants, which have been historically difficult to achieve. Pragmatics involves understanding how users often talk out of turn, interru…
▽ More
Recent advances in Natural Language Interfaces (NLIs) and Large Language Models (LLMs) have transformed our approach to NLP tasks, shifting the focus towards a more Pragmatics-based approach. This shift enables more natural interactions between humans and voice assistants, which have been historically difficult to achieve. Pragmatics involves understanding how users often talk out of turn, interrupt one another, or provide relevant information without being explicitly asked (maxim of quantity). To explore this, we developed a digital assistant that continuously listens to conversations and proactively generates relevant visualizations during data exploration tasks. In a within-subject study, participants interacted with both proactive and non-proactive versions of a voice assistant while exploring the Hawaii Climate Data Portal (HCDP). Results suggest that the proactive assistant enhanced user engagement and facilitated quicker insights. Our study highlights the potential of Pragmatic, proactive AI in NLIs and identifies key challenges in its implementation, offering insights for future research.
△ Less
Submitted 19 September, 2024; v1 submitted 16 September, 2024;
originally announced September 2024.
-
Space to Teach: Content-Rich Canvases for Visually-Intensive Education
Authors:
Jesse Harden,
Nurit Kirshenbaum,
Roderick Tabalba,
Ryan Theriot,
Michael Rogers,
Mahdi Belcaid,
Chris North,
Luc Renambot,
Lance Long,
Andrew Johnson,
Jason Leigh
Abstract:
With the decreasing cost of consumer display technologies making it easier for universities to have larger displays in classrooms, and the ubiquitous use of online tools such as collaborative whiteboards for remote learning during the COVID-19 pandemic, combining the two can be useful in higher education. This is especially true in visually intensive classes, such as data visualization courses, th…
▽ More
With the decreasing cost of consumer display technologies making it easier for universities to have larger displays in classrooms, and the ubiquitous use of online tools such as collaborative whiteboards for remote learning during the COVID-19 pandemic, combining the two can be useful in higher education. This is especially true in visually intensive classes, such as data visualization courses, that can benefit from additional "space to teach," coined after the "space to think" sense-making idiom. In this paper, we reflect on our approach to using SAGE3, a collaborative whiteboard with advanced features, in higher education to teach visually intensive classes, provide examples of activities from our own visually-intensive courses, and present student feedback. We gather our observations into usage patterns for using content-rich canvases in education.
△ Less
Submitted 4 September, 2024;
originally announced September 2024.
-
Macro-Queries: An Exploration into Guided Chart Generation from High Level Prompts
Authors:
Christopher J. Lee,
Giorgio Tran,
Roderick Tabalba,
Jason Leigh,
Ryan Longman
Abstract:
This paper explores the intersection of data visualization and Large Language Models (LLMs). Driven by the need to make a broader range of data visualization types accessible for novice users, we present a guided LLM-based pipeline designed to transform data, guided by high-level user questions (referred to as macro-queries), into a diverse set of useful visualizations. This approach leverages var…
▽ More
This paper explores the intersection of data visualization and Large Language Models (LLMs). Driven by the need to make a broader range of data visualization types accessible for novice users, we present a guided LLM-based pipeline designed to transform data, guided by high-level user questions (referred to as macro-queries), into a diverse set of useful visualizations. This approach leverages various prompting techniques, fine-tuning inspired by Abela's Chart Taxonomy, and integrated SQL tool usage.
△ Less
Submitted 22 August, 2024;
originally announced August 2024.
-
Abstracted Trajectory Visualization for Explainability in Reinforcement Learning
Authors:
Yoshiki Takagi,
Roderick Tabalba,
Nurit Kirshenbaum,
Jason Leigh
Abstract:
Explainable AI (XAI) has demonstrated the potential to help reinforcement learning (RL) practitioners to understand how RL models work. However, XAI for users who do not have RL expertise (non-RL experts), has not been studied sufficiently. This results in a difficulty for the non-RL experts to participate in the fundamental discussion of how RL models should be designed for an incoming society wh…
▽ More
Explainable AI (XAI) has demonstrated the potential to help reinforcement learning (RL) practitioners to understand how RL models work. However, XAI for users who do not have RL expertise (non-RL experts), has not been studied sufficiently. This results in a difficulty for the non-RL experts to participate in the fundamental discussion of how RL models should be designed for an incoming society where humans and AI coexist. Solving such a problem would enable RL experts to communicate with the non-RL experts in producing machine learning solutions that better fit our society. We argue that abstracted trajectories, that depicts transitions between the major states of the RL model, will be useful for non-RL experts to build a mental model of the agents. Our early results suggest that by leveraging a visualization of the abstracted trajectories, users without RL expertise are able to infer the behavior patterns of RL.
△ Less
Submitted 5 February, 2024;
originally announced February 2024.
-
Virtual Heritage at iGrid 2000
Authors:
Dave Pape,
Josephine Anstey,
Bryan Carter,
Jason Leigh,
Maria Roussou,
Tim Portlock
Abstract:
As part of the iGrid Research Demonstration at INET 2000, we created two Virtual Cultural Heritage environments - "Virtual Harlem" and "Shared Miletus". The purpose of these applications was to explore possibilities in using the combination of high-speed international networks and virtual reality (VR) displays for cultural heritage education. Our ultimate goal is to enable the construction of tele…
▽ More
As part of the iGrid Research Demonstration at INET 2000, we created two Virtual Cultural Heritage environments - "Virtual Harlem" and "Shared Miletus". The purpose of these applications was to explore possibilities in using the combination of high-speed international networks and virtual reality (VR) displays for cultural heritage education. Our ultimate goal is to enable the construction of tele-immersive museums and classes. In this paper we present an overview of the infrastructure used for these applications, and some details of their construction.
△ Less
Submitted 16 November, 2023;
originally announced November 2023.
