-
Bounded logit attention: Learning to explain image classifiers
Authors:
Thomas Baumhauer,
Djordje Slijepcevic,
Matthias Zeppelzauer
Abstract:
Explainable artificial intelligence is the attempt to elucidate the workings of systems too complex to be directly accessible to human cognition through suitable side-information referred to as "explanations". We present a trainable explanation module for convolutional image classifiers we call bounded logit attention (BLA). The BLA module learns to select a subset of the convolutional feature map…
▽ More
Explainable artificial intelligence is the attempt to elucidate the workings of systems too complex to be directly accessible to human cognition through suitable side-information referred to as "explanations". We present a trainable explanation module for convolutional image classifiers we call bounded logit attention (BLA). The BLA module learns to select a subset of the convolutional feature map for each input instance, which then serves as an explanation for the classifier's prediction. BLA overcomes several limitations of the instancewise feature selection method "learning to explain" (L2X) introduced by Chen et al. (2018): 1) BLA scales to real-world sized image classification problems, and 2) BLA offers a canonical way to learn explanations of variable size. Due to its modularity BLA lends itself to transfer learning setups and can also be employed as a post-hoc add-on to trained classifiers. Beyond explainability, BLA may serve as a general purpose method for differentiable approximation of subset selection. In a user study we find that BLA explanations are preferred over explanations generated by the popular (Grad-)CAM method.
△ Less
Submitted 31 May, 2021;
originally announced May 2021.
-
Machine Unlearning: Linear Filtration for Logit-based Classifiers
Authors:
Thomas Baumhauer,
Pascal Schöttle,
Matthias Zeppelzauer
Abstract:
Recently enacted legislation grants individuals certain rights to decide in what fashion their personal data may be used, and in particular a "right to be forgotten". This poses a challenge to machine learning: how to proceed when an individual retracts permission to use data which has been part of the training process of a model? From this question emerges the field of machine unlearning, which c…
▽ More
Recently enacted legislation grants individuals certain rights to decide in what fashion their personal data may be used, and in particular a "right to be forgotten". This poses a challenge to machine learning: how to proceed when an individual retracts permission to use data which has been part of the training process of a model? From this question emerges the field of machine unlearning, which could be broadly described as the investigation of how to "delete training data from models". Our work complements this direction of research for the specific setting of class-wide deletion requests for classification models (e.g. deep neural networks). As a first step, we propose linear filtration as a intuitive, computationally efficient sanitization method. Our experiments demonstrate benefits in an adversarial setting over naive deletion schemes.
△ Less
Submitted 8 July, 2020; v1 submitted 7 February, 2020;
originally announced February 2020.
-
Higher random indestructibility of MAD families
Authors:
Thomas Baumhauer
Abstract:
We give a combinatorial characterization of when a maximal almost disjoint family of a weakly compact cardinal $κ$ is indestructible by the higher random forcing $\mathbb Q_κ$. We then use this characterisation to show that $\mathrm{add}(\mathbf{null}_κ) = \mathfrak b_κ= \mathfrak c_κ$ implies the existence $\mathbb Q_κ$-indestructible family. The results and proofs presented here are parallel to…
▽ More
We give a combinatorial characterization of when a maximal almost disjoint family of a weakly compact cardinal $κ$ is indestructible by the higher random forcing $\mathbb Q_κ$. We then use this characterisation to show that $\mathrm{add}(\mathbf{null}_κ) = \mathfrak b_κ= \mathfrak c_κ$ implies the existence $\mathbb Q_κ$-indestructible family. The results and proofs presented here are parallel to those for classical random forcing.
△ Less
Submitted 9 April, 2019;
originally announced April 2019.
-
The Higher Cichoń Diagram
Authors:
Thomas Baumhauer,
Martin Goldstern,
Saharon Shelah
Abstract:
For a strongly inacessible cardinal $κ$, we investigate the relationships between the following ideals:
- the ideal of meager sets in the ${<}κ$-box product topology
- the ideal of "null" sets in the sense of [Sh:1004] (arXiv:1202.5799)
- the ideal of nowhere stationary subsets of a (naturally defined) stationary set $S_{\rm pr}^κ\subseteq κ$.
In particular, we analyse the provable inequal…
▽ More
For a strongly inacessible cardinal $κ$, we investigate the relationships between the following ideals:
- the ideal of meager sets in the ${<}κ$-box product topology
- the ideal of "null" sets in the sense of [Sh:1004] (arXiv:1202.5799)
- the ideal of nowhere stationary subsets of a (naturally defined) stationary set $S_{\rm pr}^κ\subseteq κ$.
In particular, we analyse the provable inequalities between the cardinal characteristics for these ideals, and we give consistency results showing that certain inequalities are unprovable.
While some results from the classical case ($κ=ω$) can be easily generalized to our setting, some key results (such as a Fubini property for the ideal of null sets) do not hold; this leads to the surprising inequality cov(null)$\le$non(null). Also, concepts that did not exist in the classical case (in particular, the notion of stationary sets) will turn out to be relevant.
We construct several models to distinguish the various cardinal characteristics; the main tools are iterations with $\mathord<κ$-support (and a strong "Knaster" version of $κ^+$-cc) and one iteration with ${\le}κ$-support (and a version of $κ$-properness).
△ Less
Submitted 28 August, 2018; v1 submitted 22 June, 2018;
originally announced June 2018.
