2DSig-Detect: a semi-supervised framework for anomaly detection on image data using 2D-signatures
Authors:
Xinheng Xie,
Kureha Yamaguchi,
Margaux Leblanc,
Simon Malzard,
Varun Chhabra,
Victoria Nockles,
Yue Wu
Abstract:
The rapid advancement of machine learning technologies raises questions about the security of machine learning models, with respect to both training-time (poisoning) and test-time (evasion, impersonation, and inversion) attacks. Models performing image-related tasks, e.g. detection, and classification, are vulnerable to adversarial attacks that can degrade their performance and produce undesirable…
▽ More
The rapid advancement of machine learning technologies raises questions about the security of machine learning models, with respect to both training-time (poisoning) and test-time (evasion, impersonation, and inversion) attacks. Models performing image-related tasks, e.g. detection, and classification, are vulnerable to adversarial attacks that can degrade their performance and produce undesirable outcomes. This paper introduces a novel technique for anomaly detection in images called 2DSig-Detect, which uses a 2D-signature-embedded semi-supervised framework rooted in rough path theory. We demonstrate our method in adversarial settings for training-time and test-time attacks, and benchmark our framework against other state of the art methods. Using 2DSig-Detect for anomaly detection, we show both superior performance and a reduction in the computation time to detect the presence of adversarial perturbations in images.
△ Less
Submitted 20 March, 2025; v1 submitted 8 September, 2024;
originally announced September 2024.
A One-Parameter Diagnostic Classification Model with Familiar Measurement Properties
Authors:
Matthew J. Madison,
Stefanie A Wind,
Lientje Maas,
Kazuhiro Yamaguchi,
Sergio Haab
Abstract:
Diagnostic classification models (DCMs) are psychometric models designed to classify examinees according to their proficiency or non-proficiency of specified latent characteristics. These models are well-suited for providing diagnostic and actionable feedback to support formative assessment efforts. Several DCMs have been developed and applied in different settings. This study proposes a DCM with…
▽ More
Diagnostic classification models (DCMs) are psychometric models designed to classify examinees according to their proficiency or non-proficiency of specified latent characteristics. These models are well-suited for providing diagnostic and actionable feedback to support formative assessment efforts. Several DCMs have been developed and applied in different settings. This study proposes a DCM with functional form similar to the 1-parameter logistic item response theory model. Using data from a large-scale mathematics education research study, we demonstrate that the proposed DCM has measurement properties akin to the Rasch and 1-parameter logistic item response theory models, including test score sufficiency, item-free and person-free measurement, and invariant item and person ordering. We discuss the implications and limitations of these developments, as well as directions for future research.
△ Less
Submitted 31 July, 2023;
originally announced July 2023.
