Azimuth: Systematic Error Analysis for Text Classification
Authors:
Gabrielle Gauthier-Melançon,
Orlando Marquez Ayala,
Lindsay Brin,
Chris Tyler,
Frédéric Branchaud-Charron,
Joseph Marinier,
Karine Grande,
Di Le
Abstract:
We present Azimuth, an open-source and easy-to-use tool to perform error analysis for text classification. Compared to other stages of the ML development cycle, such as model training and hyper-parameter tuning, the process and tooling for the error analysis stage are less mature. However, this stage is critical for the development of reliable and trustworthy AI systems. To make error analysis mor…
▽ More
We present Azimuth, an open-source and easy-to-use tool to perform error analysis for text classification. Compared to other stages of the ML development cycle, such as model training and hyper-parameter tuning, the process and tooling for the error analysis stage are less mature. However, this stage is critical for the development of reliable and trustworthy AI systems. To make error analysis more systematic, we propose an approach comprising dataset analysis and model quality assessment, which Azimuth facilitates. We aim to help AI practitioners discover and address areas where the model does not generalize by leveraging and integrating a range of ML techniques, such as saliency maps, similarity, uncertainty, and behavioral analyses, all in one tool. Our code and documentation are available at github.com/servicenow/azimuth.
△ Less
Submitted 18 December, 2022; v1 submitted 15 December, 2022;
originally announced December 2022.
Uncertainty as a Form of Transparency: Measuring, Communicating, and Using Uncertainty
Authors:
Umang Bhatt,
Javier Antorán,
Yunfeng Zhang,
Q. Vera Liao,
Prasanna Sattigeri,
Riccardo Fogliato,
Gabrielle Gauthier Melançon,
Ranganath Krishnan,
Jason Stanley,
Omesh Tickoo,
Lama Nachman,
Rumi Chunara,
Madhulika Srikumar,
Adrian Weller,
Alice Xiang
Abstract:
Algorithmic transparency entails exposing system properties to various stakeholders for purposes that include understanding, improving, and contesting predictions. Until now, most research into algorithmic transparency has predominantly focused on explainability. Explainability attempts to provide reasons for a machine learning model's behavior to stakeholders. However, understanding a model's spe…
▽ More
Algorithmic transparency entails exposing system properties to various stakeholders for purposes that include understanding, improving, and contesting predictions. Until now, most research into algorithmic transparency has predominantly focused on explainability. Explainability attempts to provide reasons for a machine learning model's behavior to stakeholders. However, understanding a model's specific behavior alone might not be enough for stakeholders to gauge whether the model is wrong or lacks sufficient knowledge to solve the task at hand. In this paper, we argue for considering a complementary form of transparency by estimating and communicating the uncertainty associated with model predictions. First, we discuss methods for assessing uncertainty. Then, we characterize how uncertainty can be used to mitigate model unfairness, augment decision-making, and build trustworthy systems. Finally, we outline methods for displaying uncertainty to stakeholders and recommend how to collect information required for incorporating uncertainty into existing ML pipelines. This work constitutes an interdisciplinary review drawn from literature spanning machine learning, visualization/HCI, design, decision-making, and fairness. We aim to encourage researchers and practitioners to measure, communicate, and use uncertainty as a form of transparency.
△ Less
Submitted 4 May, 2021; v1 submitted 15 November, 2020;
originally announced November 2020.
