-
Efficient Preimage Approximation for Neural Network Certification
Authors:
Anton Björklund,
Mykola Zaitsev,
Marta Kwiatkowska
Abstract:
The growing reliance on artificial intelligence in safety- and security-critical applications demands effective neural network certification. A challenging real-world use case is certification against ``patch attacks'', where adversarial patches or lighting conditions obscure parts of images, for example traffic signs. One approach to certification, which also gives quantitative coverage estimates…
▽ More
The growing reliance on artificial intelligence in safety- and security-critical applications demands effective neural network certification. A challenging real-world use case is certification against ``patch attacks'', where adversarial patches or lighting conditions obscure parts of images, for example traffic signs. One approach to certification, which also gives quantitative coverage estimates, utilizes preimages of neural networks, i.e., the set of inputs that lead to a specified output. However, these preimage approximation methods, including the state-of-the-art PREMAP algorithm, struggle with scalability. This paper presents novel algorithmic improvements to PREMAP involving tighter bounds, adaptive Monte Carlo sampling, and improved branching heuristics. We demonstrate efficiency improvements of at least an order of magnitude on reinforcement learning control benchmarks, and show that our method scales to convolutional neural networks that were previously infeasible. Our results demonstrate the potential of preimage approximation methodology for reliability and robustness certification.
△ Less
Submitted 28 May, 2025;
originally announced May 2025.
-
Analysis of clinical, dosimetric and radiomic features for predicting local failure after stereotactic radiotherapy of brain metastases in malignant melanoma
Authors:
Nanna E. Hartong,
Ilias Sachpazidis,
Oliver Blanck,
Lucas Etzel,
Jan C. Peeken,
Stephanie E. Combs,
Horst Urbach,
Maxim Zaitsev,
Dimos Baltas,
Ilinca Popp,
Anca-Ligia Grosu,
Tobias Fechter
Abstract:
Background: This study aimed to predict lesion-specific outcomes after stereotactic radiotherapy (SRT) in patients with brain metastases from malignant melanoma (MBM), using clinical, dosimetric pretherapeutic MRI data. Methods: In this multicenter retrospective study, 517 MBM from 130 patients treated with single-fraction or hypofractionated SRT across three centers were analyzed. From contrast-e…
▽ More
Background: This study aimed to predict lesion-specific outcomes after stereotactic radiotherapy (SRT) in patients with brain metastases from malignant melanoma (MBM), using clinical, dosimetric pretherapeutic MRI data. Methods: In this multicenter retrospective study, 517 MBM from 130 patients treated with single-fraction or hypofractionated SRT across three centers were analyzed. From contrast-enhanced T1-weighted MRI, 1576 radiomic features (RF) were extracted per lesion - 788 from the gross tumor volume (GTV), 788 from a 3 mm peritumoral margin. Clinical data, radiation dose and RF from one center were used for feature selection and model development via nested cross-validation; external validation was performed using the other two centers. Results: Local failure occurred in 72 of 517 lesions (13.9%). Predictive models based on clinical data (model 1), RF (model 2), or both (model 3) achieved c-indices of 0.60 +/- 0.15, 0.65 +/- 0.11, and 0.65 +/- 0.12. RF-based models outperformed the clinical model, while dosimetric data alone were not predictive. Most predictive RF came from the peritumoral margin (92%) vs. GTV (76%). On the first external dataset, all models performed similarly (c-index: 0.60-0.63), but showed poor generalization on the second (c-index < 0.50), likely due to differences in patient characteristics and imaging protocols. Conclusions: Information extracted from pretherapeutic MRI, particularly from the peritumoral area, can support accurate prediction of lesion-specific outcomes after SRT in MBM. When combined with clinical data, these imaging-derived markers offer valuable prognostic insights. However, generalizability remains challenging by heterogeneity in patient populations and MRI protocols.
△ Less
Submitted 22 May, 2025; v1 submitted 31 May, 2024;
originally announced May 2024.
-
Predicting dynamic, motion-related changes in B0 field in the brain at a 7 T MRI using a subject-specific fine-tuned U-net
Authors:
Stanislav Motyka,
Paul Weiser,
Beata Bachrata,
Lukas Hingerl,
Bernhard Strasser,
Gilbert Hangel,
Eva Niess,
Dario Goranovic,
Fabian Niess,
Maxim Zaitsev,
Simon Daniel Robinson,
Georg Langs,
Siegfried Trattnig,
Wolfgang Bogner
Abstract:
Subject movement during the magnetic resonance examination is inevitable and causes not only image artefacts but also deteriorates the homogeneity of the main magnetic field (B0), which is a prerequisite for high quality data. Thus, characterization of changes to B0, e.g. induced by patient movement, is important for MR applications that are prone to B0 inhomogeneities. We propose a deep learning…
▽ More
Subject movement during the magnetic resonance examination is inevitable and causes not only image artefacts but also deteriorates the homogeneity of the main magnetic field (B0), which is a prerequisite for high quality data. Thus, characterization of changes to B0, e.g. induced by patient movement, is important for MR applications that are prone to B0 inhomogeneities. We propose a deep learning based method to predict such changes within the brain from the change of the head position to facilitate retrospective or even real-time correction. A 3D U-net was trained on in vivo brain 7T MRI data. The input consisted of B0 maps and anatomical images at an initial position, and anatomical images at a different head position (obtained by applying a rigid-body transformation on the initial anatomical image). The output consisted of B0 maps at the new head positions. We further fine-tuned the network weights to each subject by measuring a limited number of head positions of the given subject, and trained the U-net with these data. Our approach was compared to established dynamic B0 field mapping via interleaved navigators, which suffer from limited spatial resolution and the need for undesirable sequence modifications. Qualitative and quantitative comparison showed similar performance between an interleaved navigator-equivalent method and proposed method. We therefore conclude that it is feasible to predict B0 maps from rigid subject movement and, when combined with external tracking hardware, this information could be used to improve the quality of magnetic resonance acquisitions without the use of navigators.
△ Less
Submitted 17 April, 2023;
originally announced April 2023.
