-
If there's a Trigger Warning, then where's the Trigger? Investigating Trigger Warnings at the Passage Level
Authors:
Matti Wiegmann,
Jennifer Rakete,
Magdalena Wolska,
Benno Stein,
Martin Potthast
Abstract:
Trigger warnings are labels that preface documents with sensitive content if this content could be perceived as harmful by certain groups of readers. Since warnings about a document intuitively need to be shown before reading it, authors usually assign trigger warnings at the document level. What parts of their writing prompted them to assign a warning, however, remains unclear. We investigate for…
▽ More
Trigger warnings are labels that preface documents with sensitive content if this content could be perceived as harmful by certain groups of readers. Since warnings about a document intuitively need to be shown before reading it, authors usually assign trigger warnings at the document level. What parts of their writing prompted them to assign a warning, however, remains unclear. We investigate for the first time the feasibility of identifying the triggering passages of a document, both manually and computationally. We create a dataset of 4,135 English passages, each annotated with one of eight common trigger warnings. In a large-scale evaluation, we then systematically evaluate the effectiveness of fine-tuned and few-shot classifiers, and their generalizability. We find that trigger annotation belongs to the group of subjective annotation tasks in NLP, and that automatic trigger classification remains challenging but feasible.
△ Less
Submitted 15 April, 2024;
originally announced April 2024.
-
Argumentation in Waltz's "Emerging Structure of International Politics''
Authors:
Magdalena Wolska,
Bernd Fröhlich,
Katrin Girgensohn,
Sassan Gholiagha,
Dora Kiesel,
Jürgen Neyer,
Patrick Riehmann,
Mitja Sienknecht,
Benno Stein
Abstract:
We present an annotation scheme for argumentative and domain-specific aspects of scholarly articles on the theory of International Relations. At argumentation level we identify Claims and Support/Attack relations. At domain level we model discourse content in terms of Theory and Data-related statements. We annotate Waltz's 1993 text on structural realism and show that our scheme can be reliably ap…
▽ More
We present an annotation scheme for argumentative and domain-specific aspects of scholarly articles on the theory of International Relations. At argumentation level we identify Claims and Support/Attack relations. At domain level we model discourse content in terms of Theory and Data-related statements. We annotate Waltz's 1993 text on structural realism and show that our scheme can be reliably applied by domain experts enables insights on two research questions on justifications of claims.
△ Less
Submitted 30 December, 2023;
originally announced January 2024.
-
Trigger Warnings: Bootstrapping a Violence Detector for FanFiction
Authors:
Magdalena Wolska,
Christopher Schröder,
Ole Borchardt,
Benno Stein,
Martin Potthast
Abstract:
We present the first dataset and evaluation results on a newly defined computational task of trigger warning assignment. Labeled corpus data has been compiled from narrative works hosted on Archive of Our Own (AO3), a well-known fanfiction site. In this paper, we focus on the most frequently assigned trigger type--violence--and define a document-level binary classification task of whether or not t…
▽ More
We present the first dataset and evaluation results on a newly defined computational task of trigger warning assignment. Labeled corpus data has been compiled from narrative works hosted on Archive of Our Own (AO3), a well-known fanfiction site. In this paper, we focus on the most frequently assigned trigger type--violence--and define a document-level binary classification task of whether or not to assign a violence trigger warning to a fanfiction, exploiting warning labels provided by AO3 authors. SVM and BERT models trained in four evaluation setups on the corpora we compiled yield $F_1$ results ranging from 0.585 to 0.798, proving the violence trigger warning assignment to be a doable, however, non-trivial task.
△ Less
Submitted 9 September, 2022;
originally announced September 2022.
