-
MLMC: Interactive multi-label multi-classifier evaluation without confusion matrices
Authors:
Aleksandar Doknic,
Torsten Möller
Abstract:
Machine learning-based classifiers are commonly evaluated by metrics like accuracy, but deeper analysis is required to understand their strengths and weaknesses. MLMC is a visual exploration tool that tackles the challenge of multi-label classifier comparison and evaluation. It offers a scalable alternative to confusion matrices which are commonly used for such tasks, but don't scale well with a l…
▽ More
Machine learning-based classifiers are commonly evaluated by metrics like accuracy, but deeper analysis is required to understand their strengths and weaknesses. MLMC is a visual exploration tool that tackles the challenge of multi-label classifier comparison and evaluation. It offers a scalable alternative to confusion matrices which are commonly used for such tasks, but don't scale well with a large number of classes or labels. Additionally, MLMC allows users to view classifier performance from an instance perspective, a label perspective, and a classifier perspective. Our user study shows that the techniques implemented by MLMC allow for a powerful multi-label classifier evaluation while preserving user friendliness.
△ Less
Submitted 24 January, 2025;
originally announced January 2025.
-
Better Together? The Role of Explanations in Supporting Novices in Individual and Collective Deliberations about AI
Authors:
Timothée Schmude,
Laura Koesten,
Torsten Möller,
Sebastian Tschiatschek
Abstract:
Deploying AI systems in public institutions can have far-reaching consequences for many people, making it a matter of public interest. Providing opportunities for stakeholders to come together, understand these systems, and debate their merits and harms is thus essential. Explainable AI often focuses on individuals, but deliberation benefits from group settings, which are underexplored. To address…
▽ More
Deploying AI systems in public institutions can have far-reaching consequences for many people, making it a matter of public interest. Providing opportunities for stakeholders to come together, understand these systems, and debate their merits and harms is thus essential. Explainable AI often focuses on individuals, but deliberation benefits from group settings, which are underexplored. To address this gap, we present findings from an interview study with 8 focus groups and 12 individuals. Our findings provide insight into how explanations support AI novices in deliberating alone and in groups. Participants used modular explanations with four information categories to solve tasks and decide about an AI system's deployment. We found that the explanations supported groups in creating shared understanding and in finding arguments for and against the system's deployment. In comparison, individual participants engaged with explanations in more depth and performed better in the study tasks, but missed an exchange with others. Based on our findings, we provide suggestions on how explanations should be designed to work in group settings and describe their potential use in real-world contexts. With this, our contributions inform XAI research that aims to enable AI novices to understand and deliberate AI systems in the public sector.
△ Less
Submitted 23 April, 2025; v1 submitted 18 November, 2024;
originally announced November 2024.
-
MAVIL: Design of a Multidimensional Assessment of Visual Data Literacy and its Application in a Representative Survey
Authors:
Antonia Saske,
Torsten Möller,
Laura Koesten,
Judith Staudner,
Sylvia Kritzinger
Abstract:
The ability to read, interpret, and critique data visualizations has mainly been assessed using data visualization tasks like value retrieval. Although evidence on different facets of Visual Data Literacy (VDL) is well established in visualization research and includes numeracy, graph familiarity, or aesthetic elements, they have not been sufficiently considered in ability assessments. Here, VDL i…
▽ More
The ability to read, interpret, and critique data visualizations has mainly been assessed using data visualization tasks like value retrieval. Although evidence on different facets of Visual Data Literacy (VDL) is well established in visualization research and includes numeracy, graph familiarity, or aesthetic elements, they have not been sufficiently considered in ability assessments. Here, VDL is considered a multidimensional ability whose facets can be partially self-assessed. We introduce an assessment in which VDL is deconstructed as a process of understanding, in reference to frameworks from the learning sciences. MAVIL, Multidimensional Assessment of Visual Data Literacy, is composed of six ability dimensions: General Impression/Abstract Thinking, Graph Elements/Familiarity, Aesthetic Perception, Visualization Criticism, Data Reading Tasks and Numeracy/Topic Knowledge. MAVIL was designed for general audiences and implemented in a survey (n=438), representative of Austria's age groups (18-74 years) and gender split. The survey mirrors the population's VDL and shows the perception of two climate data visualizations, a line and bar chart. We found that $48\%$ of respondents make mistakes with the simple charts, while $5\%$ believe that they cannot summarize the visualization content. About a quarter have deficits in comprehending simple data units, and $19-20\%$ are unfamiliar with each displayed chart type.
△ Less
Submitted 31 October, 2024;
originally announced October 2024.
-
RSVP for VPSA : A Meta Design Study on Rapid Suggestive Visualization Prototyping for Visual Parameter Space Analysis
Authors:
Manfred Klaffenboeck,
Michael Gleicher,
Johannes Sorger,
Michael Wimmer,
Torsten Möller
Abstract:
Visual Parameter Space Analysis (VPSA) enables domain scientists to explore input-output relationships of computational models. Existing VPSA applications often feature multi-view visualizations designed by visualization experts for a specific scenario, making it hard for domain scientists to adapt them to their problems without professional help. We present RSVP, the Rapid Suggestive Visualizatio…
▽ More
Visual Parameter Space Analysis (VPSA) enables domain scientists to explore input-output relationships of computational models. Existing VPSA applications often feature multi-view visualizations designed by visualization experts for a specific scenario, making it hard for domain scientists to adapt them to their problems without professional help. We present RSVP, the Rapid Suggestive Visualization Prototyping system encoding VPSA knowledge to enable domain scientists to prototype custom visualization dashboards tailored to their specific needs. The system implements a task-oriented, multi-view visualization recommendation strategy over a visualization design space optimized for VPSA to guide users in meeting their analytical demands. We derived the VPSA knowledge implemented in the system by conducting an extensive meta design study over the body of work on VPSA. We show how this process can be used to perform a data and task abstraction, extract a common visualization design space, and derive a task-oriented VisRec strategy. User studies indicate that the system is user-friendly and can uncover novel insights.
△ Less
Submitted 11 September, 2024;
originally announced September 2024.
-
Detection and Tracking of MAVs Using a Rosette Scanning Pattern LiDAR
Authors:
Sándor Gazdag,
Tom Möller,
Anita Keszler,
András L. Majdik
Abstract:
The use of commercial Micro Aerial Vehicles (MAVs) has surged in the past decade, offering societal benefits but also raising risks such as airspace violations and privacy concerns. Due to the increased security risks, the development of autonomous drone detection and tracking systems has become a priority. In this study, we tackle this challenge, by using non-repetitive rosette scanning pattern L…
▽ More
The use of commercial Micro Aerial Vehicles (MAVs) has surged in the past decade, offering societal benefits but also raising risks such as airspace violations and privacy concerns. Due to the increased security risks, the development of autonomous drone detection and tracking systems has become a priority. In this study, we tackle this challenge, by using non-repetitive rosette scanning pattern LiDARs, particularly focusing on increasing the detection distance by leveraging the characteristics of the sensor. The presented method utilizes a particle filter with a velocity component for the detection and tracking of the drone, which offers added re-detection capability. A Pan-Tilt platform is utilized to take advantage of the specific characteristics of the rosette scanning pattern LiDAR by keeping the tracked object in the center where the measurement is most dense. The detection capabilities and accuracy of the system are validated through indoor experiments, while the maximum detection distance is shown in our outdoor experiments. Our approach achieved accuracy on par with the state-of-the-art indoor method while increasing the maximum detection range by approximately 80\% beyond the state-of-the-art outdoor method.
△ Less
Submitted 24 February, 2025; v1 submitted 16 August, 2024;
originally announced August 2024.
-
Tensions between Preference and Performance: Designing for Visual Exploration of Multi-frequency Medical Network Data
Authors:
Christian Knoll,
Laura Koesten,
Isotta Rigoni,
Serge Vulliémoz,
Torsten Möller
Abstract:
The analysis of complex high-dimensional data is a common task in many domains, resulting in bespoke visual exploration tools. Expectations and practices of domain experts as users do not always align with visualization theory. In this paper, we report on a design study in the medical domain where we developed two high-fidelity prototypes encoding EEG-derived brain network data with different type…
▽ More
The analysis of complex high-dimensional data is a common task in many domains, resulting in bespoke visual exploration tools. Expectations and practices of domain experts as users do not always align with visualization theory. In this paper, we report on a design study in the medical domain where we developed two high-fidelity prototypes encoding EEG-derived brain network data with different types of visualizations. We evaluate these prototypes regarding effectiveness, efficiency, and preference with two groups: participants with domain knowledge (domain experts in medical research) and those without domain knowledge, both groups having little or no visualization experience. A requirement analysis and study of low-fidelity prototypes revealed a strong preference for a novel and aesthetically pleasing visualization design, as opposed to a design that is considered more optimal based on visualization theory. Our study highlights the pros and cons of both approaches, discussing trade-offs between task-specific measurements and subjective preference. While the aesthetically pleasing and novel low-fidelity prototype was favored, the results of our evaluation show that, in most cases, this was not reflected in participants' performance or subjective preference for the high-fidelity prototypes.
△ Less
Submitted 5 April, 2024;
originally announced April 2024.
-
An Image-based Typology for Visualization
Authors:
Jian Chen,
Petra Isenberg,
Robert S. Laramee,
Tobias Isenberg,
Michael Sedlmair,
Torsten Moeller,
Rui Li
Abstract:
We present and discuss the results of a qualitative analysis of visualization images to derive an image-based typology of visualizations. For each image, we seek to identify its main focus or the essential stimuli. As a result, we derived 10 image-based visualization types. We describe coding decisions we made in the derivation process. The resulting image typology can serve a number of purposes:…
▽ More
We present and discuss the results of a qualitative analysis of visualization images to derive an image-based typology of visualizations. For each image, we seek to identify its main focus or the essential stimuli. As a result, we derived 10 image-based visualization types. We describe coding decisions we made in the derivation process. The resulting image typology can serve a number of purposes: enabling researchers and practitioners to identify visual design styles, facilitating the categorization of visualization images for the purpose of research and teaching, enabling researchers to study the evolution of the community and its research output over time, and facilitating a discussion of standardization in visualization. In addition, the tool and dataset enable scholars to closely examine the images and how they are published and communicated in our community. osf.io/dxjwt presents a pre-registration and all supplemental materials.
△ Less
Submitted 6 January, 2025; v1 submitted 6 March, 2024;
originally announced March 2024.
-
Engineering Weighted Connectivity Augmentation Algorithms
Authors:
Marcelo Fonseca Faraj,
Ernestine Großmann,
Felix Joos,
Thomas Möller,
Christian Schulz
Abstract:
Increasing the connectivity of a graph is a pivotal challenge in robust network design. The weighted connectivity augmentation problem is a common version of the problem that takes link costs into consideration. The problem is then to find a minimum cost subset of a given set of weighted links that increases the connectivity of a graph by one when the links are added to the edge set of the input i…
▽ More
Increasing the connectivity of a graph is a pivotal challenge in robust network design. The weighted connectivity augmentation problem is a common version of the problem that takes link costs into consideration. The problem is then to find a minimum cost subset of a given set of weighted links that increases the connectivity of a graph by one when the links are added to the edge set of the input instance. In this work, we give a first implementation of recently discovered better-than-2 approximations. Furthermore, we propose three new heuristic and one exact approach. These include a greedy algorithm considering link costs and the number of unique cuts covered, an approach based on minimum spanning trees and a local search algorithm that may improve a given solution by swapping links of paths. Our exact approach uses an ILP formulation with efficient cut enumeration as well as a fast initialization routine. We then perform an extensive experimental evaluation which shows that our algorithms are faster and yield the best solutions compared to the current state-of-the-art as well as the recently discovered better-than-2 approximation algorithms. Our novel local search algorithm can improve solution quality even further.
△ Less
Submitted 12 February, 2024;
originally announced February 2024.
-
Information That Matters: Exploring Information Needs of People Affected by Algorithmic Decisions
Authors:
Timothée Schmude,
Laura Koesten,
Torsten Möller,
Sebastian Tschiatschek
Abstract:
Every AI system that makes decisions about people has a group of stakeholders that are personally affected by these decisions. However, explanations of AI systems rarely address the information needs of this stakeholder group, who often are AI novices. This creates a gap between conveyed information and information that matters to those who are impacted by the system's decisions, such as domain ex…
▽ More
Every AI system that makes decisions about people has a group of stakeholders that are personally affected by these decisions. However, explanations of AI systems rarely address the information needs of this stakeholder group, who often are AI novices. This creates a gap between conveyed information and information that matters to those who are impacted by the system's decisions, such as domain experts and decision subjects. To address this, we present the "XAI Novice Question Bank," an extension of the XAI Question Bank containing a catalog of information needs from AI novices in two use cases: employment prediction and health monitoring. The catalog covers the categories of data, system context, system usage, and system specifications. We gathered information needs through task-based interviews where participants asked questions about two AI systems to decide on their adoption and received verbal explanations in response. Our analysis showed that participants' confidence increased after receiving explanations but that their understanding faced challenges. These included difficulties in locating information and in assessing their own understanding, as well as attempts to outsource understanding. Additionally, participants' prior perceptions of the systems' risks and benefits influenced their information needs. Participants who perceived high risks sought explanations about the intentions behind a system's deployment, while those who perceived low risks rather asked about the system's operation. Our work aims to support the inclusion of AI novices in explainability efforts by highlighting their information needs, aims, and challenges. We summarize our findings as five key implications that can inform the design of future explanations for lay stakeholder audiences.
△ Less
Submitted 28 October, 2024; v1 submitted 24 January, 2024;
originally announced January 2024.
-
Data journeys in popular science: Producing climate change and COVID-19 data visualizations at Scientific American
Authors:
Kathleen Gregory,
Laura Koesten,
Regina Schuster,
Torsten Möller,
Sarah Davies
Abstract:
Vast amounts of (open) data are increasingly used to make arguments about crisis topics such as climate change and global pandemics. Data visualizations are central to bringing these viewpoints to broader publics. However, visualizations often conceal the many contexts involved in their production, ranging from decisions made in research labs about collecting and sharing data to choices made in ed…
▽ More
Vast amounts of (open) data are increasingly used to make arguments about crisis topics such as climate change and global pandemics. Data visualizations are central to bringing these viewpoints to broader publics. However, visualizations often conceal the many contexts involved in their production, ranging from decisions made in research labs about collecting and sharing data to choices made in editorial rooms about which data stories to tell. In this paper, we examine how data visualizations about climate change and COVID-19 are produced in popular science magazines, using Scientific American, an established English-language popular science magazine, as a case study. To do this, we apply the analytical concept of data journeys (Leonelli, 2020) in a mixed methods study that centers on interviews with Scientific American staff and is supplemented by a visualization analysis of selected charts. In particular, we discuss the affordances of working with open data, the role of collaborative data practices, and how the magazine works to counter misinformation and increase transparency. This work provides an empirical contribution by providing insight into the data (visualization) practices of science communicators and demonstrating how the concept of data journeys can be used as an analytical framework.
△ Less
Submitted 27 March, 2024; v1 submitted 27 October, 2023;
originally announced October 2023.
-
Subjective visualization experiences: impact of visual design and experimental design
Authors:
Laura Koesten,
Drew Dimmery,
Michael Gleicher,
Torsten Möller
Abstract:
In contrast to objectively measurable aspects (such as accuracy, reading speed, or memorability), the subjective experience of visualizations has only recently gained importance, and we have less experience how to measure it. We explore how subjective experience is affected by chart design using multiple experimental methods. We measure the effects of changes in color, orientation, and source anno…
▽ More
In contrast to objectively measurable aspects (such as accuracy, reading speed, or memorability), the subjective experience of visualizations has only recently gained importance, and we have less experience how to measure it. We explore how subjective experience is affected by chart design using multiple experimental methods. We measure the effects of changes in color, orientation, and source annotation on the perceived readability and trustworthiness of simple bar charts. Three different experimental designs (single image rating, forced choice comparison, and semi-structured interviews) provide similar but different results. We find that these subjective experiences are different from what prior work on objective dimensions would predict. Seemingly inconsequential choices, like orientation, have large effects for some methods, indicating that study design alters decision-making strategies. Next to insights into the effect of chart design, we provide methodological insights, such as a suggested need to carefully isolate individual elements in charts to study subjective experiences.
△ Less
Submitted 13 October, 2023;
originally announced October 2023.
-
The Gulf of Interpretation: From Chart to Message and Back Again
Authors:
Christian Knoll,
Torsten Möller,
Kathleen Gregory,
Laura Koesten
Abstract:
Charts are used to communicate data visually, but often, we do not know whether a chart's intended message aligns with the message readers perceive. In this mixed-methods study, we investigate how data journalists encode data and how members of a broad audience engage with, experience, and understand these visualizations. We conducted workshops and interviews with school and university students, j…
▽ More
Charts are used to communicate data visually, but often, we do not know whether a chart's intended message aligns with the message readers perceive. In this mixed-methods study, we investigate how data journalists encode data and how members of a broad audience engage with, experience, and understand these visualizations. We conducted workshops and interviews with school and university students, job seekers, designers, and senior citizens to collect perceived messages and feedback on eight real-world charts. We analyzed these messages and compared them to the intended message. Our results help to understand the gulf that can exist between messages (that producers encode) and viewer interpretations. In particular, we find that consumers are often overwhelmed with the amount of data provided and are easily confused with terms that are not well known. Chart producers tend to follow strong conventions on how to visually encode particular information that might not always benefit consumers.
△ Less
Submitted 21 February, 2025; v1 submitted 9 October, 2023;
originally announced October 2023.
-
Who is the Audience? Designing Casual Data Visualizations for the 'General Public'
Authors:
Regina Schuster,
Laura Koesten,
Torsten Möller,
Kathleen Gregory
Abstract:
Casual data visualizations play a vital role in communicating data to lay audiences. Despite this, little is known about how data visualization practitioners make design decisions based on their envisioned target audiences using different media channels. We draw on the findings of a semi-structured interview study to explore how data visualization practitioners working in various settings conceptu…
▽ More
Casual data visualizations play a vital role in communicating data to lay audiences. Despite this, little is known about how data visualization practitioners make design decisions based on their envisioned target audiences using different media channels. We draw on the findings of a semi-structured interview study to explore how data visualization practitioners working in various settings conceptualize and design for lay audiences and how they evaluate their visualization designs. Our findings suggest that practitioners often use broad definitions of their target audience, yet they stress the importance of 'knowing the readers' for their design decisions. At the same time, commonly used evaluation and feedback mechanisms do not allow a deep knowledge of their readers but rely instead on tacit knowledge, simple usage metrics, or testing with colleagues. We conclude by calling for different forms of visualization evaluation that are feasible for practitioners to implement in their daily workflows.
△ Less
Submitted 3 October, 2023;
originally announced October 2023.
-
Applying Interdisciplinary Frameworks to Understand Algorithmic Decision-Making
Authors:
Timothée Schmude,
Laura Koesten,
Torsten Möller,
Sebastian Tschiatschek
Abstract:
We argue that explanations for "algorithmic decision-making" (ADM) systems can profit by adopting practices that are already used in the learning sciences. We shortly introduce the importance of explaining ADM systems, give a brief overview of approaches drawing from other disciplines to improve explanations, and present the results of our qualitative task-based study incorporating the "six facets…
▽ More
We argue that explanations for "algorithmic decision-making" (ADM) systems can profit by adopting practices that are already used in the learning sciences. We shortly introduce the importance of explaining ADM systems, give a brief overview of approaches drawing from other disciplines to improve explanations, and present the results of our qualitative task-based study incorporating the "six facets of understanding" framework. We close with questions guiding the discussion of how future studies can leverage an interdisciplinary approach.
△ Less
Submitted 26 May, 2023;
originally announced May 2023.
-
"The main message is that sustainability would help" -- Reflections on takeaway messages of climate change data visualizations
Authors:
Regina Schuster,
Laura Koesten,
Kathleen Gregory,
Torsten Möller
Abstract:
How do different audiences make sense of climate change data visualizations and what do they take away as a main message? To investigate this question, we are building on the results of a previous study, focusing on expert opinions regarding public climate change communication and the role of data visualizations. Hereby, we conducted semi-structured interviews with 17 experts in the fields of clim…
▽ More
How do different audiences make sense of climate change data visualizations and what do they take away as a main message? To investigate this question, we are building on the results of a previous study, focusing on expert opinions regarding public climate change communication and the role of data visualizations. Hereby, we conducted semi-structured interviews with 17 experts in the fields of climate change, science communication, or data visualization. We also interviewed six lay persons with no professional background in either of these areas. With this analysis, we aim to shed light on how lay audiences arrive at an understanding of climate change data visualizations and what they take away as a main message. For two exemplary data visualizations, we compare their takeaway messages with messages formulated by experts. Through a thematic analysis, we observe differences regarding the included contents, the length and abstraction of messages, and the sensemaking process between and among the participant groups.
△ Less
Submitted 6 May, 2023;
originally announced May 2023.
-
What is the message? Perspectives on Visual Data Communication
Authors:
Laura Koesten,
Kathleen Gregory,
Regina Schuster,
Christian Knoll,
Sarah Davies,
Torsten Möller
Abstract:
Data visualizations are used to communicate messages to diverse audiences. It is unclear whether interpretations of these visualizations match the messages their creators aim to convey. In a mixed-methods study, we investigate how data in the popular science magazine Scientific American are visually communicated and understood. We first analyze visualizations about climate change and pandemics pub…
▽ More
Data visualizations are used to communicate messages to diverse audiences. It is unclear whether interpretations of these visualizations match the messages their creators aim to convey. In a mixed-methods study, we investigate how data in the popular science magazine Scientific American are visually communicated and understood. We first analyze visualizations about climate change and pandemics published in the magazine over a fifty-year period. Acting as chart readers, we then interpret visualizations with and without textual elements, identifying takeaway messages and creating field notes. Finally, we compare a sample of our interpreted messages to the intended messages of chart producers, drawing on interviews conducted with magazine staff. These data allow us to explore understanding visualizations through three perspectives: that of the charts, visualization readers, and visualization producers. Building on our findings from a thematic analysis, we present in-depth insights into data visualization sensemaking, particularly regarding the role of messages and textual elements; we propose a message typology, and we consider more broadly how messages can be conceptualized and understood.
△ Less
Submitted 12 April, 2023;
originally announced April 2023.
-
Untangling Rhetoric, Pathos, and Aesthetics in Data Visualization
Authors:
Verena Ingrid Prantl,
Torsten Moeller,
Laura Koesten
Abstract:
In contemporary discourse, logos (reason) and, more recently, ethos (credibility) in data communication have been discussed extensively. While the concept of Pathos has enjoyed great interest in the VIS community over the past few years, its connection to similar but relevant concepts like aesthetics and rhetoric remains unexplored. In this paper, we provide definitions of these terms and explore…
▽ More
In contemporary discourse, logos (reason) and, more recently, ethos (credibility) in data communication have been discussed extensively. While the concept of Pathos has enjoyed great interest in the VIS community over the past few years, its connection to similar but relevant concepts like aesthetics and rhetoric remains unexplored. In this paper, we provide definitions of these terms and explore their overlaps and differences in light of their historical development. Examining the historical perspective offers a deeper understanding of how these approaches in science and philosophy have evolved over time, offering a more comprehensive embedding into the design process and its role within it. Drawing from Campbell's seven circumstances, we illustrate how pathos is being used as a rhetorical device in data visualizations today, at times inadvertently.
△ Less
Submitted 7 April, 2025; v1 submitted 8 April, 2023;
originally announced April 2023.
-
On the Impact of Explanations on Understanding of Algorithmic Decision-Making
Authors:
Timothée Schmude,
Laura Koesten,
Torsten Möller,
Sebastian Tschiatschek
Abstract:
Ethical principles for algorithms are gaining importance as more and more stakeholders are affected by "high-risk" algorithmic decision-making (ADM) systems. Understanding how these systems work enables stakeholders to make informed decisions and to assess the systems' adherence to ethical values. Explanations are a promising way to create understanding, but current explainable artificial intellig…
▽ More
Ethical principles for algorithms are gaining importance as more and more stakeholders are affected by "high-risk" algorithmic decision-making (ADM) systems. Understanding how these systems work enables stakeholders to make informed decisions and to assess the systems' adherence to ethical values. Explanations are a promising way to create understanding, but current explainable artificial intelligence (XAI) research does not always consider existent theories on how understanding is formed and evaluated. In this work, we aim to contribute to a better understanding of understanding by conducting a qualitative task-based study with 30 participants, including users and affected stakeholders. We use three explanation modalities (textual, dialogue, and interactive) to explain a "high-risk" ADM system to participants and analyse their responses both inductively and deductively, using the "six facets of understanding" framework by Wiggins & McTighe. Our findings indicate that the "six facets" framework is a promising approach to analyse participants' thought processes in understanding, providing categories for both rational and emotional understanding. We further introduce the "dialogue" modality as a valid explanation approach to increase participant engagement and interaction with the "explainer", allowing for more insight into their understanding in the process. Our analysis further suggests that individuality in understanding affects participants' perceptions of algorithmic fairness, demonstrating the interdependence between understanding and ADM assessment that previous studies have outlined. We posit that drawing from theories on learning and understanding like the "six facets" and leveraging explanation modalities can guide XAI research to better suit explanations to learning processes of individuals and consequently enable their assessment of ethical values of ADM systems.
△ Less
Submitted 17 May, 2023; v1 submitted 16 February, 2023;
originally announced February 2023.
-
"Being Simple on Complex Issues" -- Accounts on Visual Data Communication about Climate Change
Authors:
Regina Schuster,
Kathleen Gregory,
Torsten Möller,
Laura Koesten
Abstract:
Data visualizations play a critical role in both communicating scientific evidence about climate change and in stimulating engagement and action. To investigate how visualizations can be better utilized to communicate the complexities of climate change to different audiences, we conducted interviews with 17 experts in the fields of climate change, data visualization, and science communication, as…
▽ More
Data visualizations play a critical role in both communicating scientific evidence about climate change and in stimulating engagement and action. To investigate how visualizations can be better utilized to communicate the complexities of climate change to different audiences, we conducted interviews with 17 experts in the fields of climate change, data visualization, and science communication, as well as with 12 laypersons. Besides questions about climate change communication and various aspects of data visualizations, we also asked participants to share what they think is the main takeaway message for two exemplary climate change data visualizations. Through a thematic analysis, we observe differences regarding the included contents, the length and abstraction of messages, and the sensemaking process between and among the participant groups. On average, experts formulated shorter and more abstract messages, often referring to higher-level conclusions rather than specific details. We use our findings to reflect on design decisions for creating more effective visualizations, particularly in news media sources geared toward lay audiences. We hereby discuss the adaption of contents according to the needs of the audience, the trade-off between simplification and accuracy, as well as techniques to make a visualization attractive.
△ Less
Submitted 6 February, 2024; v1 submitted 18 November, 2022;
originally announced November 2022.
-
Not As Easy As You Think -- Experiences and Lessons Learnt from Trying to Create a Bottom-Up Visualization Image Typology
Authors:
Jian Chen,
Petra Isenberg,
Robert S. Laramee,
Tobias Isenberg,
Michael Sedlmair,
Torsten Moeller,
Han-Wei Shen
Abstract:
We present and discuss the results of a two-year qualitative analysis of images published in IEEE Visualization (VIS) papers. Specifically, we derive a typology of 13 visualization image types, coded to distinguish visualizations and several image characteristics. The categorization process required much more time and was more difficult than we initially thought. The resulting typology and image a…
▽ More
We present and discuss the results of a two-year qualitative analysis of images published in IEEE Visualization (VIS) papers. Specifically, we derive a typology of 13 visualization image types, coded to distinguish visualizations and several image characteristics. The categorization process required much more time and was more difficult than we initially thought. The resulting typology and image analysis may serve a number of purposes: to study the evolution of the community and its research output over time, to facilitate the categorization of visualization images for the purpose of teaching, to identify visual designs for evaluation purposes, or to enable progress towards standardization in visualization. In addition to the typology and image characterization, we provide a dataset of 6,833 tagged images and an online tool that can be used to explore and analyze the large set of tagged images. We thus facilitate a discussion of the diverse visualizations used and how they are published and communicated in our community.
△ Less
Submitted 13 October, 2022; v1 submitted 15 September, 2022;
originally announced September 2022.
-
Three-Dimensional Coherent Diffractive Imaging of Isolated Faceted Nanostructures
Authors:
Alessandro Colombo,
Simon Dold,
Patrice Kolb,
Nils Bernhardt,
Patrick Behrens,
Jonathan Correa,
Stefan Düsterer,
Benjamin Erk,
Linos Hecht,
Andrea Heilrath,
Robert Irsig,
Norman Iwe,
Jakob Jordan,
Björn Kruse,
Bruno Langbehn,
Bastian Manschwetus,
Franklin Martinez,
Karl-Heinz Meiwes-Broer,
Kevin Oldenburg,
Christopher Passow,
Christian Peltz,
Mario Sauppe,
Fabian Seel,
Rico Mayro P. Tanyag,
Rolf Treusch
, et al. (7 additional authors not shown)
Abstract:
The structure and dynamics of isolated nanosamples in free flight can be directly visualized via single-shot coherent diffractive imaging using the intense and short pulses of X-ray free-electron lasers. Wide-angle scattering images even encode three-dimensional morphological information of the samples, but the retrieval of this information remains a challenge. Up to now, effective three-dimension…
▽ More
The structure and dynamics of isolated nanosamples in free flight can be directly visualized via single-shot coherent diffractive imaging using the intense and short pulses of X-ray free-electron lasers. Wide-angle scattering images even encode three-dimensional morphological information of the samples, but the retrieval of this information remains a challenge. Up to now, effective three-dimensional morphology reconstructions from single shots were only achieved via fitting with highly constrained models, requiring a priori knowledge about possible geometrical shapes. Here we present a much more generic imaging approach. Relying on a model that allows for any sample morphology described by a convex polyhedron, we reconstruct wide-angle diffraction patterns from individual silver nanoparticles. In addition to known structural motives with high symmetries, we retrieve imperfect shapes and agglomerates which were not accessible previously. Our results open new routes towards true 3D structure determination of single nanoparticles and, ultimately, 3D movies of ultrafast nanoscale dynamics.
△ Less
Submitted 8 August, 2022;
originally announced August 2022.
-
FuNNscope: Visual microscope for interactively exploring the loss landscape of fully connected neural networks
Authors:
Aleksandar Doknic,
Torsten Möller
Abstract:
Despite their effective use in various fields, many aspects of neural networks are poorly understood. One important way to investigate the characteristics of neural networks is to explore the loss landscape. However, most models produce a high-dimensional non-convex landscape which is difficult to visualize. We discuss and extend existing visualization methods based on 1D- and 2D slicing with a no…
▽ More
Despite their effective use in various fields, many aspects of neural networks are poorly understood. One important way to investigate the characteristics of neural networks is to explore the loss landscape. However, most models produce a high-dimensional non-convex landscape which is difficult to visualize. We discuss and extend existing visualization methods based on 1D- and 2D slicing with a novel method that approximates the actual loss landscape geometry by using charts with interpretable axes. Based on the assumption that observations on small neural networks can generalize to more complex systems and provide us with helpful insights, we focus on small models in the range of a few dozen weights, which enables computationally cheap experiments and the use of an interactive dashboard. We observe symmetries around the zero vector, the influence of different layers on the global landscape, the different weight sensitivities around a minimizer, and how gradient descent navigates high-loss obstacles. The user study resulted in an average SUS (System Usability Scale) score with suggestions for improvement and opened up a number of possible application scenarios, such as autoencoders and ensemble networks.
△ Less
Submitted 9 April, 2022;
originally announced April 2022.
-
Sensitive vPSA -- Exploring Sensitivity in Visual Parameter Space Analysis
Authors:
Bernhard Fröhler,
Tim Elberfeld,
Torsten Möller,
Hans-Christian Hege,
Julia Maurer,
Christoph Heinzl
Abstract:
The sensitivity of parameters in computational science problems is difficult to assess, especially for algorithms with multiple input parameters and diverse outputs. This work seeks to explore sensitivity analysis in the visualization domain, introducing novel techniques for respective visual analyses of parameter sensitivity in multi-dimensional algorithms. First, the sensitivity analysis backgro…
▽ More
The sensitivity of parameters in computational science problems is difficult to assess, especially for algorithms with multiple input parameters and diverse outputs. This work seeks to explore sensitivity analysis in the visualization domain, introducing novel techniques for respective visual analyses of parameter sensitivity in multi-dimensional algorithms. First, the sensitivity analysis background is revisited, highlighting the definition of sensitivity analysis and approaches analyzing global and local sensitivity as well as the differences of sensitivity analysis to the more common uncertainty analysis. We introduce and explore parameter sensitivity using visualization techniques from overviews to details on demand, covering the analysis of all aspects of sensitivity in a prototypical implementation. The respective visualization techniques outline the algorithmic in- and outputs including indications, on how sensitive an input is with regard to the outputs. The detailed sensitivity information is communicated through constellation plots for the exploration of input and output spaces. A matrix view is discussed for localized information on the sensitivity of specific outputs to specific inputs. A 3D view provides the link of the parameter sensitivity to the spatial domain, in which the results of the multi-dimensional algorithms are embedded. The proposed sensitivity analysis techniques are implemented and evaluated in a prototype called Sensitivity Explorer. We show that Sensitivity Explorer reliably identifies the most influential parameters and provides insights into which of the output characteristics these affect as well as to which extent.
△ Less
Submitted 4 April, 2022;
originally announced April 2022.
-
An Arduino based heartbeat detection device (ArdMob-ECG) for real-time ECG analysis
Authors:
Tim Julian Möller,
Martin Voss,
Laura Kaltwasser
Abstract:
This technical paper provides a tutorial to build a low-cost (10-100 USD) and easy to assemble ECG device (ArdMob-ECG) that can be easily used for a variety of different scientific studies. The advantage of this device is that it automatically stores the data and has a built-in detection algorithm for heartbeats. Compared to a clinical ECG, this device entails a serial interface that can send trig…
▽ More
This technical paper provides a tutorial to build a low-cost (10-100 USD) and easy to assemble ECG device (ArdMob-ECG) that can be easily used for a variety of different scientific studies. The advantage of this device is that it automatically stores the data and has a built-in detection algorithm for heartbeats. Compared to a clinical ECG, this device entails a serial interface that can send triggers via USB directly to a computer and software (e.g. Unity, Matlab) with minimal delay due to its architecture. Its software and hardware is open-source and publicly available. The performance of the device regarding sensitivity and specificity is comparable to a professional clinical ECG and is assessed in this paper. Due to the open-source software, a variety of different research questions and individual alterations can be adapted using this ECG. The code as well as the circuit is publicly available and accessible for everyone to promote a better health system in remote areas, Open Science, and to boost scientific progress and the development of new paradigms that ultimately foster innovation.
△ Less
Submitted 1 April, 2022;
originally announced April 2022.
-
Histogram binning revisited with a focus on human perception
Authors:
Raphael Sahann,
Torsten Möller,
Johanna Schmidt
Abstract:
This paper presents a quantitative user study to evaluate how well users can visually perceive the underlying data distribution from a histogram representation. We used different sample and bin sizes and four different distributions (uniform, normal, bimodal, and gamma). The study results confirm that, in general, more bins correlate with fewer errors by the viewers. However, upon a certain number…
▽ More
This paper presents a quantitative user study to evaluate how well users can visually perceive the underlying data distribution from a histogram representation. We used different sample and bin sizes and four different distributions (uniform, normal, bimodal, and gamma). The study results confirm that, in general, more bins correlate with fewer errors by the viewers. However, upon a certain number of bins, the error rate cannot be improved by adding more bins. By comparing our study results with the outcomes of existing mathematical models for histogram binning (e.g., Sturges' formula, Scott's normal reference rule, the Rice Rule, or Freedman-Diaconis' choice), we can see that most of them overestimate the number of bins necessary to make the distribution visible to a human viewer.
△ Less
Submitted 14 September, 2021;
originally announced September 2021.
-
Semantic Answer Similarity for Evaluating Question Answering Models
Authors:
Julian Risch,
Timo Möller,
Julian Gutsch,
Malte Pietsch
Abstract:
The evaluation of question answering models compares ground-truth annotations with model predictions. However, as of today, this comparison is mostly lexical-based and therefore misses out on answers that have no lexical overlap but are still semantically similar, thus treating correct answers as false. This underestimation of the true performance of models hinders user acceptance in applications…
▽ More
The evaluation of question answering models compares ground-truth annotations with model predictions. However, as of today, this comparison is mostly lexical-based and therefore misses out on answers that have no lexical overlap but are still semantically similar, thus treating correct answers as false. This underestimation of the true performance of models hinders user acceptance in applications and complicates a fair comparison of different models. Therefore, there is a need for an evaluation metric that is based on semantics instead of pure string similarity. In this short paper, we present SAS, a cross-encoder-based metric for the estimation of semantic answer similarity, and compare it to seven existing metrics. To this end, we create an English and a German three-way annotated evaluation dataset containing pairs of answers along with human judgment of their semantic similarity, which we release along with an implementation of the SAS metric and the experiments. We find that semantic similarity metrics based on recent transformer models correlate much better with human judgment than traditional lexical similarity metrics on our two newly created datasets and one dataset from related work.
△ Less
Submitted 21 October, 2021; v1 submitted 13 August, 2021;
originally announced August 2021.
-
Multi-modal Retrieval of Tables and Texts Using Tri-encoder Models
Authors:
Bogdan Kostić,
Julian Risch,
Timo Möller
Abstract:
Open-domain extractive question answering works well on textual data by first retrieving candidate texts and then extracting the answer from those candidates. However, some questions cannot be answered by text alone but require information stored in tables. In this paper, we present an approach for retrieving both texts and tables relevant to a question by jointly encoding texts, tables and questi…
▽ More
Open-domain extractive question answering works well on textual data by first retrieving candidate texts and then extracting the answer from those candidates. However, some questions cannot be answered by text alone but require information stored in tables. In this paper, we present an approach for retrieving both texts and tables relevant to a question by jointly encoding texts, tables and questions into a single vector space. To this end, we create a new multi-modal dataset based on text and table datasets from related work and compare the retrieval performance of different encoding schemata. We find that dense vector embeddings of transformer models outperform sparse embeddings on four out of six evaluation datasets. Comparing different dense embedding models, tri-encoders with one encoder for each question, text and table, increase retrieval performance compared to bi-encoders with one encoder for the question and one for both text and tables. We release the newly created multi-modal dataset to the community so that it can be used for training and evaluation.
△ Less
Submitted 19 October, 2021; v1 submitted 9 August, 2021;
originally announced August 2021.
-
Document Domain Randomization for Deep Learning Document Layout Extraction
Authors:
Meng Ling,
Jian Chen,
Torsten Möller,
Petra Isenberg,
Tobias Isenberg,
Michael Sedlmair,
Robert S. Laramee,
Han-Wei Shen,
Jian Wu,
C. Lee Giles
Abstract:
We present document domain randomization (DDR), the first successful transfer of convolutional neural networks (CNNs) trained only on graphically rendered pseudo-paper pages to real-world document segmentation. DDR renders pseudo-document pages by modeling randomized textual and non-textual contents of interest, with user-defined layout and font styles to support joint learning of fine-grained cla…
▽ More
We present document domain randomization (DDR), the first successful transfer of convolutional neural networks (CNNs) trained only on graphically rendered pseudo-paper pages to real-world document segmentation. DDR renders pseudo-document pages by modeling randomized textual and non-textual contents of interest, with user-defined layout and font styles to support joint learning of fine-grained classes. We demonstrate competitive results using our DDR approach to extract nine document classes from the benchmark CS-150 and papers published in two domains, namely annual meetings of Association for Computational Linguistics (ACL) and IEEE Visualization (VIS). We compare DDR to conditions of style mismatch, fewer or more noisy samples that are more easily obtained in the real world. We show that high-fidelity semantic information is not necessary to label semantic classes but style mismatch between train and test can lower model accuracy. Using smaller training samples had a slightly detrimental effect. Finally, network models still achieved high test accuracy when correct labels are diluted towards confusing labels; this behavior hold across several classes.
△ Less
Submitted 20 May, 2021;
originally announced May 2021.
-
GermanQuAD and GermanDPR: Improving Non-English Question Answering and Passage Retrieval
Authors:
Timo Möller,
Julian Risch,
Malte Pietsch
Abstract:
A major challenge of research on non-English machine reading for question answering (QA) is the lack of annotated datasets. In this paper, we present GermanQuAD, a dataset of 13,722 extractive question/answer pairs. To improve the reproducibility of the dataset creation approach and foster QA research on other languages, we summarize lessons learned and evaluate reformulation of question/answer pa…
▽ More
A major challenge of research on non-English machine reading for question answering (QA) is the lack of annotated datasets. In this paper, we present GermanQuAD, a dataset of 13,722 extractive question/answer pairs. To improve the reproducibility of the dataset creation approach and foster QA research on other languages, we summarize lessons learned and evaluate reformulation of question/answer pairs as a way to speed up the annotation process. An extractive QA model trained on GermanQuAD significantly outperforms multilingual models and also shows that machine-translated training data cannot fully substitute hand-annotated training data in the target language. Finally, we demonstrate the wide range of applications of GermanQuAD by adapting it to GermanDPR, a training dataset for dense passage retrieval (DPR), and train and evaluate the first non-English DPR model.
△ Less
Submitted 26 April, 2021;
originally announced April 2021.
-
VIS30K: A Collection of Figures and Tables from IEEE Visualization Conference Publications
Authors:
Jian Chen,
Meng Ling,
Rui Li,
Petra Isenberg,
Tobias Isenberg,
Michael Sedlmair,
Torsten Möller,
Robert S. Laramee,
Han-Wei Shen,
Katharina Wünsche,
Qiru Wang
Abstract:
We present the VIS30K dataset, a collection of 29,689 images that represents 30 years of figures and tables from each track of the IEEE Visualization conference series (Vis, SciVis, InfoVis, VAST). VIS30K's comprehensive coverage of the scientific literature in visualization not only reflects the progress of the field but also enables researchers to study the evolution of the state-of-the-art and…
▽ More
We present the VIS30K dataset, a collection of 29,689 images that represents 30 years of figures and tables from each track of the IEEE Visualization conference series (Vis, SciVis, InfoVis, VAST). VIS30K's comprehensive coverage of the scientific literature in visualization not only reflects the progress of the field but also enables researchers to study the evolution of the state-of-the-art and to find relevant work based on graphical content. We describe the dataset and our semi-automatic collection process, which couples convolutional neural networks (CNN) with curation. Extracting figures and tables semi-automatically allows us to verify that no images are overlooked or extracted erroneously. To improve quality further, we engaged in a peer-search process for high-quality figures from early IEEE Visualization papers. With the resulting data, we also contribute VISImageNavigator (VIN, visimagenavigator.github.io), a web-based tool that facilitates searching and exploring VIS30K by author names, paper keywords, title and abstract, and years.
△ Less
Submitted 11 January, 2021; v1 submitted 22 December, 2020;
originally announced January 2021.
-
German's Next Language Model
Authors:
Branden Chan,
Stefan Schweter,
Timo Möller
Abstract:
In this work we present the experiments which lead to the creation of our BERT and ELECTRA based German language models, GBERT and GELECTRA. By varying the input training data, model size, and the presence of Whole Word Masking (WWM) we were able to attain SoTA performance across a set of document classification and named entity recognition (NER) tasks for both models of base and large size. We ad…
▽ More
In this work we present the experiments which lead to the creation of our BERT and ELECTRA based German language models, GBERT and GELECTRA. By varying the input training data, model size, and the presence of Whole Word Masking (WWM) we were able to attain SoTA performance across a set of document classification and named entity recognition (NER) tasks for both models of base and large size. We adopt an evaluation driven approach in training these models and our results indicate that both adding more data and utilizing WWM improve model performance. By benchmarking against existing German models, we show that these models are the best German models to date. Our trained models will be made publicly available to the research community.
△ Less
Submitted 3 December, 2020; v1 submitted 21 October, 2020;
originally announced October 2020.
-
embComp: Visual Interactive Comparison of Vector Embeddings
Authors:
Florian Heimerl,
Christoph Kralj,
Torsten Möller,
Michael Gleicher
Abstract:
This paper introduces embComp, a novel approach for comparing two embeddings that capture the similarity between objects, such as word and document embeddings. We survey scenarios where comparing these embedding spaces is useful. From those scenarios, we derive common tasks, introduce visual analysis methods that support these tasks, and combine them into a comprehensive system. One of embComp's c…
▽ More
This paper introduces embComp, a novel approach for comparing two embeddings that capture the similarity between objects, such as word and document embeddings. We survey scenarios where comparing these embedding spaces is useful. From those scenarios, we derive common tasks, introduce visual analysis methods that support these tasks, and combine them into a comprehensive system. One of embComp's central features are overview visualizations that are based on metrics for measuring differences in the local structure around objects. Summarizing these local metrics over the embeddings provides global overviews of similarities and differences. Detail views allow comparison of the local structure around selected objects and relating this local information to the global views. Integrating and connecting all of these components, embComp supports a range of analysis workflows that help understand similarities and differences between embedding spaces. We assess our approach by applying it in several use cases, including understanding corpora differences via word vector embeddings, and understanding algorithmic differences in generating embeddings.
△ Less
Submitted 1 June, 2021; v1 submitted 4 November, 2019;
originally announced November 2019.
-
Nonuniform Timeslicing of Dynamic Graphs Based on Visual Complexity
Authors:
Yong Wang,
Daniel Archambault,
Hammad Haleem,
Torsten Moeller,
Yanhong Wu,
Huamin Qu
Abstract:
Uniform timeslicing of dynamic graphs has been used due to its convenience and uniformity across the time dimension. However, uniform timeslicing does not take the data set into account, which can generate cluttered timeslices with edge bursts and empty timeslices with few interactions. The graph mining filed has explored nonuniform timeslicing methods specifically designed to preserve graph featu…
▽ More
Uniform timeslicing of dynamic graphs has been used due to its convenience and uniformity across the time dimension. However, uniform timeslicing does not take the data set into account, which can generate cluttered timeslices with edge bursts and empty timeslices with few interactions. The graph mining filed has explored nonuniform timeslicing methods specifically designed to preserve graph features for mining tasks. In this paper, we propose a nonuniform timeslicing approach for dynamic graph visualization. Our goal is to create timeslices of equal visual complexity. To this end, we adapt histogram equalization to create timeslices with a similar number of events, balancing the visual complexity across timeslices and conveying more important details of timeslices with bursting edges. A case study has been conducted, in comparison with uniform timeslicing, to demonstrate the effectiveness of our approach.
△ Less
Submitted 28 July, 2019;
originally announced July 2019.
-
cellPACKexplorer: Interactive Model Building for Volumetric Data of Complex Cells
Authors:
M. Schwarzl,
L. Autin,
G. Johnson,
T. Torsney-Weir,
T. Möller
Abstract:
Given an algorithm the quality of the output largely depends on a proper specification of the input parameters. A lot of work has been done to analyze tasks related to using a fixed model [25] and finding a good set of inputs. In this paper we present a different scenario, model building. In contrast to model usage the underlying algorithm, i.e. the underlying model, changes and therefore the asso…
▽ More
Given an algorithm the quality of the output largely depends on a proper specification of the input parameters. A lot of work has been done to analyze tasks related to using a fixed model [25] and finding a good set of inputs. In this paper we present a different scenario, model building. In contrast to model usage the underlying algorithm, i.e. the underlying model, changes and therefore the associated parameters also change. Developing a new algorithm requires a particular set of parameters that, on the one hand, give access to an expected range of outputs and, on the other hand, are still interpretable. As the model is developed and parameters are added, deleted, or changed different features of the outputs are of interest. Therefore it is important to find objective measures that quantify these features. In a model building process these features are prone to change and need to be adaptable as the model changes. We discuss these problems in the application of cellPACK, a tool that generates virtual 3D cells. Our analysis is based on an output set generated by sampling the input parameter space. Hence we also present techniques and metrics to analyze an ensemble of probabilistic volumes.
△ Less
Submitted 18 December, 2018;
originally announced December 2018.
-
Toward a deeper understanding of Visualization through keyword analysis
Authors:
Petra Isenberg,
Tobias Isenberg,
Michael Sedlmair,
Jian Chen,
Torsten Möller
Abstract:
We present the results of a comprehensive analysis of visualization paper keywords supplied for 4366 papers submitted to five main visualization conferences. We describe main keywords, topic areas, and 10-year historic trends from two datasets: (1) the standardized PCS taxonomy keywords in use for paper submissions for IEEE InfoVis, IEEE Vis-SciVis, IEEE VAST, EuroVis, and IEEE PacificVis since 20…
▽ More
We present the results of a comprehensive analysis of visualization paper keywords supplied for 4366 papers submitted to five main visualization conferences. We describe main keywords, topic areas, and 10-year historic trends from two datasets: (1) the standardized PCS taxonomy keywords in use for paper submissions for IEEE InfoVis, IEEE Vis-SciVis, IEEE VAST, EuroVis, and IEEE PacificVis since 2009 and (2) the author-chosen keywords for papers published in the IEEE Visualization conference series (now called IEEE VIS) since 2004. Our analysis of research topics in visualization can serve as a starting point to (a) help create a common vocabulary to improve communication among different visualization sub-groups, (b) facilitate the process of understanding differences and commonalities of the various research sub-fields in visualization, (c) provide an understanding of emerging new research trends, (d) facilitate the crucial step of finding the right reviewers for research submissions, and (e) it can eventually lead to a comprehensive taxonomy of visualization research. One additional tangible outcome of our work is an application that allows visualization researchers to easily browse the 2600+ keywords used for IEEE VIS papers during the past 10 years, aiming at more informed and, hence, more effective keyword selections for future visualization publications.
△ Less
Submitted 13 August, 2014;
originally announced August 2014.
-
Mixing Board Versus Mouse Interaction In Value Adjustment Tasks
Authors:
Steven Bergner,
Matthew Crider,
Arthur E. Kirkpatrick,
Torsten Möller
Abstract:
We present a controlled, quantitative study with 12 participants comparing interaction with a haptically enhanced mixing board against interaction with a mouse in an abstract task that is motivated by several practical parameter space exploration settings.
The study participants received 24 sets of one to eight integer values between 0 and 127, which they had to match by making adjustments with…
▽ More
We present a controlled, quantitative study with 12 participants comparing interaction with a haptically enhanced mixing board against interaction with a mouse in an abstract task that is motivated by several practical parameter space exploration settings.
The study participants received 24 sets of one to eight integer values between 0 and 127, which they had to match by making adjustments with physical or graphical sliders. Based on recorded slider motion path data, we developed an analysis algorithm that identifies and measures different types of activity intervals, including error time moving irrelevant sliders and end time in breaks after completing each trial item. Our results showed a significant increase in speed of the mixing board interaction accompanied by reduced perceived cognitive load when compared with the traditional mouse-based GUI interaction. The gains in speed are largely due to the improved times required for the hand to reach for the first slider (acquisition time) and also when moving between different ones, while the actual time spent manipulating relevant sliders is very similar for either input device. These results agree strongly with qualitative predictions from Fitts' Law that the larger targets afforded by the mixer handles contributed to its faster performance. For further investigation, we computed a measure of motion simultaneity based on velocity correlation, which allowed to identify types of items for which increased simultaneous adjustments occur.
For continuous parameter space exploration our findings suggest that mixing boards are a good option to provide detailed multi-value control. The strengths of this input method particularly show in settings where screen space is precious and undisrupted visual focus is crucial.
△ Less
Submitted 11 October, 2011;
originally announced October 2011.
