Skip to main content

Showing 1–35 of 35 results for author: Strümke, I

.
  1. arXiv:2503.16452  [pdf, other

    cs.HC cs.AI

    Towards Biomarker Discovery for Early Cerebral Palsy Detection: Evaluating Explanations Through Kinematic Perturbations

    Authors: Kimji N. Pellano, Inga Strümke, Daniel Groos, Lars Adde, Pål Haugen, Espen Alexander F. Ihlen

    Abstract: Cerebral Palsy (CP) is a prevalent motor disability in children, for which early detection can significantly improve treatment outcomes. While skeleton-based Graph Convolutional Network (GCN) models have shown promise in automatically predicting CP risk from infant videos, their "black-box" nature raises concerns about clinical explainability. To address this, we introduce a perturbation framework… ▽ More

    Submitted 19 February, 2025; originally announced March 2025.

    Comments: 19 pages, 14 figures

  2. arXiv:2501.09592  [pdf, other

    cs.SE

    Clinicians don't know what explanations they need: A case study on eliciting AI software explainability requirements

    Authors: Tor Sporsem, Stine Rasdal Finserås, Inga Strümke

    Abstract: This paper analyses how software developers elicit explainability requirements when creating a software application with an AI component, through a case study using AI in the medical context of predicting cerebral palsy (CP) risk in infants. Following a small software development team at a Norwegian hospital, we observe their process of simultaneously developing the AI application and discovering… ▽ More

    Submitted 22 January, 2025; v1 submitted 16 January, 2025; originally announced January 2025.

  3. arXiv:2412.16003  [pdf, other

    cs.LG cs.AI

    Choose Your Explanation: A Comparison of SHAP and GradCAM in Human Activity Recognition

    Authors: Felix Tempel, Daniel Groos, Espen Alexander F. Ihlen, Lars Adde, Inga Strümke

    Abstract: Explaining machine learning (ML) models using eXplainable AI (XAI) techniques has become essential to make them more transparent and trustworthy. This is especially important in high-stakes domains like healthcare, where understanding model decisions is critical to ensure ethical, sound, and trustworthy outcome predictions. However, users are often confused about which explanability method to choo… ▽ More

    Submitted 13 April, 2025; v1 submitted 20 December, 2024; originally announced December 2024.

  4. arXiv:2411.05874  [pdf, other

    cs.LG cs.AI

    Interplay between Federated Learning and Explainable Artificial Intelligence: a Scoping Review

    Authors: Luis M. Lopez-Ramos, Florian Leiser, Aditya Rastogi, Steven Hicks, Inga Strümke, Vince I. Madai, Tobias Budig, Ali Sunyaev, Adam Hilbert

    Abstract: The joint implementation of federated learning (FL) and explainable artificial intelligence (XAI) could allow training models from distributed data and explaining their inner workings while preserving essential aspects of privacy. Toward establishing the benefits and tensions associated with their interplay, this scoping review maps the publications that jointly deal with FL and XAI, focusing on p… ▽ More

    Submitted 10 April, 2025; v1 submitted 7 November, 2024; originally announced November 2024.

    Comments: 16 pages, 10 figures, submitted in IEEE Access

  5. Explaining Human Activity Recognition with SHAP: Validating Insights with Perturbation and Quantitative Measures

    Authors: Felix Tempel, Espen Alexander F. Ihlen, Lars Adde, Inga Strümke

    Abstract: In Human Activity Recognition (HAR), understanding the intricacy of body movements within high-risk applications is essential. This study uses SHapley Additive exPlanations (SHAP) to explain the decision-making process of Graph Convolution Networks (GCNs) when classifying activities with skeleton data. We employ SHAP to explain two real-world datasets: one for cerebral palsy (CP) classification an… ▽ More

    Submitted 21 March, 2025; v1 submitted 6 November, 2024; originally announced November 2024.

    Comments: Published in Computers in Biology and Medicine

  6. arXiv:2410.12820  [pdf, other

    cs.RO cs.AI cs.LG

    A transformer-based deep reinforcement learning approach to spatial navigation in a partially observable Morris Water Maze

    Authors: Marte Eggen, Inga Strümke

    Abstract: Navigation is a fundamental cognitive skill extensively studied in neuroscientific experiments and has lately gained substantial interest in artificial intelligence research. Recreating the task solved by rodents in the well-established Morris Water Maze (MWM) experiment, this work applies a transformer-based architecture using deep reinforcement learning -- an approach previously unexplored in th… ▽ More

    Submitted 1 October, 2024; originally announced October 2024.

  7. arXiv:2409.20060  [pdf, other

    cs.CV

    Lightweight Neural Architecture Search for Cerebral Palsy Detection

    Authors: Felix Tempel, Espen Alexander F. Ihlen, Inga Strümke

    Abstract: The neurological condition known as cerebral palsy (CP) first manifests in infancy or early childhood and has a lifelong impact on motor coordination and body movement. CP is one of the leading causes of childhood disabilities, and early detection is crucial for providing appropriate treatment. However, such detection relies on assessments by human experts trained in methods like general movement… ▽ More

    Submitted 30 September, 2024; originally announced September 2024.

  8. arXiv:2409.00001  [pdf, other

    cs.CV cs.AI cs.LG

    Evaluating Explainable AI Methods in Deep Learning Models for Early Detection of Cerebral Palsy

    Authors: Kimji N. Pellano, Inga Strümke, Daniel Groos, Lars Adde, Espen Alexander F. Ihlen

    Abstract: Early detection of Cerebral Palsy (CP) is crucial for effective intervention and monitoring. This paper tests the reliability and applicability of Explainable AI (XAI) methods using a deep learning method that predicts CP by analyzing skeletal data extracted from video recordings of infant movements. Specifically, we use XAI evaluation metrics -- namely faithfulness and stability -- to quantitativ… ▽ More

    Submitted 13 August, 2024; originally announced September 2024.

  9. arXiv:2402.12790  [pdf, other

    cs.LG

    From Movements to Metrics: Evaluating Explainable AI Methods in Skeleton-Based Human Activity Recognition

    Authors: Kimji N. Pellano, Inga Strümke, Espen Alexander F. Ihlen

    Abstract: The advancement of deep learning in human activity recognition (HAR) using 3D skeleton data is critical for applications in healthcare, security, sports, and human-computer interaction. This paper tackles a well-known gap in the field, which is the lack of testing in the applicability and reliability of XAI evaluation metrics in the skeleton-based HAR domain. We have tested established XAI metrics… ▽ More

    Submitted 20 February, 2024; originally announced February 2024.

  10. AutoGCN -- Towards Generic Human Activity Recognition with Neural Architecture Search

    Authors: Felix Tempel, Inga Strümke, Espen Alexander F. Ihlen

    Abstract: This paper introduces AutoGCN, a generic Neural Architecture Search (NAS) algorithm for Human Activity Recognition (HAR) using Graph Convolution Networks (GCNs). HAR has gained attention due to advances in deep learning, increased data availability, and enhanced computational capabilities. At the same time, GCNs have shown promising results in modeling relationships between body key points in a sk… ▽ More

    Submitted 12 March, 2024; v1 submitted 2 February, 2024; originally announced February 2024.

  11. arXiv:2312.10393  [pdf, other

    cs.LG cs.AI

    Lecture Notes in Probabilistic Diffusion Models

    Authors: Inga Strümke, Helge Langseth

    Abstract: Diffusion models are loosely modelled based on non-equilibrium thermodynamics, where \textit{diffusion} refers to particles flowing from high-concentration regions towards low-concentration regions. In statistics, the meaning is quite similar, namely the process of transforming a complex distribution $p_{\text{complex}}$ on $\mathbb{R}^d$ to a simple distribution $p_{\text{prior}}$ on the same dom… ▽ More

    Submitted 16 December, 2023; originally announced December 2023.

  12. arXiv:2309.09702  [pdf, other

    cs.LG cs.AI

    Information based explanation methods for deep learning agents -- with applications on large open-source chess models

    Authors: Patrik Hammersborg, Inga Strümke

    Abstract: With large chess-playing neural network models like AlphaZero contesting the state of the art within the world of computerised chess, two challenges present themselves: The question of how to explain the domain knowledge internalised by such models, and the problem that such models are not made openly available. This work presents the re-implementation of the concept detection methodology applied… ▽ More

    Submitted 18 September, 2023; originally announced September 2023.

    Comments: Additional code available at https://github.com/patrik-ha/ii-map

  13. arXiv:2307.12601  [pdf, other

    cs.LG

    Concept backpropagation: An Explainable AI approach for visualising learned concepts in neural network models

    Authors: Patrik Hammersborg, Inga Strümke

    Abstract: Neural network models are widely used in a variety of domains, often as black-box solutions, since they are not directly interpretable for humans. The field of explainable artificial intelligence aims at developing explanation methods to address this challenge, and several approaches have been developed over the recent years, including methods for investigating what type of knowledge these models… ▽ More

    Submitted 24 July, 2023; originally announced July 2023.

  14. Vacuum free energy, quark condensate shifts and magnetization in three-flavor chiral perturbation theory to $\mathcal{O}(p^6)$ in a uniform magnetic field

    Authors: Prabal Adhikari, Inga Strümke

    Abstract: We study three-flavor QCD in a uniform magnetic field using chiral perturbation theory ($χ$PT). We construct the vacuum free energy density, quark condensate shifts induced by the magnetic field and the renormalized magnetization to $\mathcal{O}(p^6)$ in the chiral expansion. We find that the calculation of the free energy is greatly simplified by cancellations among two-loop diagrams involving ch… ▽ More

    Submitted 13 November, 2023; v1 submitted 9 May, 2023; originally announced May 2023.

    Comments: 23 pages, 3 sets of figures, matches published version

  15. arXiv:2301.04993  [pdf, other

    cs.AI

    Against Algorithmic Exploitation of Human Vulnerabilities

    Authors: Inga Strümke, Marija Slavkovik, Clemens Stachl

    Abstract: Decisions such as which movie to watch next, which song to listen to, or which product to buy online, are increasingly influenced by recommender systems and user models that incorporate information on users' past behaviours, preferences, and digitally created content. Machine learning models that enable recommendations and that are trained on user data may unintentionally leverage information on h… ▽ More

    Submitted 12 January, 2023; originally announced January 2023.

    Comments: arXiv admin note: text overlap with arXiv:2203.00317

  16. arXiv:2212.04212  [pdf, other

    cs.RO

    Real-Time Counterfactual Explanations For Robotic Systems With Multiple Continuous Outputs

    Authors: Vilde B. Gjærum, Inga Strümke, Anastasios M. Lekkas, Tim Miller

    Abstract: Although many machine learning methods, especially from the field of deep learning, have been instrumental in addressing challenges within robotic applications, we cannot take full advantage of such methods before these can provide performance and safety guarantees. The lack of trust that impedes the use of these methods mainly stems from a lack of human understanding of what exactly machine learn… ▽ More

    Submitted 8 December, 2022; originally announced December 2022.

    Comments: 7 pages

  17. arXiv:2211.05500  [pdf, other

    cs.LG cs.AI

    Reinforcement Learning in an Adaptable Chess Environment for Detecting Human-understandable Concepts

    Authors: Patrik Hammersborg, Inga Strümke

    Abstract: Self-trained autonomous agents developed using machine learning are showing great promise in a variety of control settings, perhaps most remarkably in applications involving autonomous vehicles. The main challenge associated with self-learned agents in the form of deep neural networks, is their black-box nature: it is impossible for humans to interpret deep neural networks. Therefore, humans canno… ▽ More

    Submitted 10 November, 2022; originally announced November 2022.

    Comments: For associated code, see https://github.com/patrik-ha/explainable-minichess

  18. arXiv:2205.07858  [pdf, other

    cs.LG cs.AI q-bio.QM

    Predicting tacrolimus exposure in kidney transplanted patients using machine learning

    Authors: Andrea M. Storås, Anders Åsberg, Pål Halvorsen, Michael A. Riegler, Inga Strümke

    Abstract: Tacrolimus is one of the cornerstone immunosuppressive drugs in most transplantation centers worldwide following solid organ transplantation. Therapeutic drug monitoring of tacrolimus is necessary in order to avoid rejection of the transplanted organ or severe side effects. However, finding the right dose for a given patient is challenging, even for experienced clinicians. Consequently, a tool tha… ▽ More

    Submitted 9 May, 2022; originally announced May 2022.

  19. arXiv:2204.00617  [pdf, other

    eess.IV cs.AI cs.CV cs.LG

    Visual explanations for polyp detection: How medical doctors assess intrinsic versus extrinsic explanations

    Authors: Steven Hicks, Andrea Storås, Michael Riegler, Cise Midoglu, Malek Hammou, Thomas de Lange, Sravanthi Parasa, Pål Halvorsen, Inga Strümke

    Abstract: Deep learning has in recent years achieved immense success in all areas of computer vision and has the potential of assisting medical doctors in analyzing visual content for disease and other abnormalities. However, the current state of deep learning is very much a black box, making medical professionals highly skeptical about integrating these methods into clinical practice. Several methods have… ▽ More

    Submitted 23 March, 2022; originally announced April 2022.

  20. Interpretable machine learning in Physics

    Authors: Christophe Grojean, Ayan Paul, Zhuoni Qian, Inga Strümke

    Abstract: Adding interpretability to multivariate methods creates a powerful synergy for exploring complex physical systems with higher order correlations while bringing about a degree of clarity in the underlying dynamics of the system.

    Submitted 2 May, 2022; v1 submitted 11 March, 2022; originally announced March 2022.

    Comments: Submitted version of invited Comment Article for Nature Reviews Physics (2022)

    Report number: DESY-22-038, HU-EP-21/46

  21. Explaining a Deep Reinforcement Learning Docking Agent Using Linear Model Trees with User Adapted Visualization

    Authors: Vilde B. Gjærum, Inga Strümke, Ole Andreas Alsos, Anastasios M. Lekkas

    Abstract: Deep neural networks (DNNs) can be useful within the marine robotics field, but their utility value is restricted by their black-box nature. Explainable artificial intelligence methods attempt to understand how such black-boxes make their decisions. In this work, linear model trees (LMTs) are used to approximate the DNN controlling an autonomous surface vessel (ASV) in a simulated environment and… ▽ More

    Submitted 1 March, 2022; originally announced March 2022.

  22. arXiv:2203.00317   

    cs.LG cs.CY

    Explainability for identification of vulnerable groups in machine learning models

    Authors: Inga Strümke, Marija Slavkovik

    Abstract: If a prediction model identifies vulnerable individuals or groups, the use of that model may become an ethical issue. But can we know that this is what a model does? Machine learning fairness as a field is focused on the just treatment of individuals and groups under information processing with machine learning methods. While considerable attention has been given to mitigating discrimination of pr… ▽ More

    Submitted 6 September, 2022; v1 submitted 1 March, 2022; originally announced March 2022.

    Comments: The statements about existing methods are outdated and the authors are still working on updating the text

  23. arXiv:2201.07026  [pdf, other

    cs.LG econ.EM stat.ML

    Socioeconomic disparities and COVID-19: the causal connections

    Authors: Tannista Banerjee, Ayan Paul, Vishak Srikanth, Inga Strümke

    Abstract: The analysis of causation is a challenging task that can be approached in various ways. With the increasing use of machine learning based models in computational socioeconomics, explaining these models while taking causal connections into account is a necessity. In this work, we advocate the use of an explanatory framework from cooperative game theory augmented with $do$ calculus, namely causal Sh… ▽ More

    Submitted 18 January, 2022; originally announced January 2022.

  24. arXiv:2111.02936  [pdf, other

    cs.RO cs.LG

    Causal versus Marginal Shapley Values for Robotic Lever Manipulation Controlled using Deep Reinforcement Learning

    Authors: Sindre Benjamin Remman, Inga Strümke, Anastasios M. Lekkas

    Abstract: We investigate the effect of including domain knowledge about a robotic system's causal relations when generating explanations. To this end, we compare two methods from explainable artificial intelligence, the popular KernelSHAP and the recent causal SHAP, on a deep neural network trained using deep reinforcement learning on the task of controlling a lever using a robotic manipulator. A primary di… ▽ More

    Submitted 4 November, 2021; originally announced November 2021.

    Comments: Submitted to the American Control Conference 2022

  25. arXiv:2109.01658  [pdf, other

    cs.LG cs.AI eess.IV

    Artificial Intelligence in Dry Eye Disease

    Authors: Andrea M. Storås, Inga Strümke, Michael A. Riegler, Jakob Grauslund, Hugo L. Hammer, Anis Yazidi, Pål Halvorsen, Kjell G. Gundersen, Tor P. Utheim, Catherine Jackson

    Abstract: Dry eye disease (DED) has a prevalence of between 5 and 50\%, depending on the diagnostic criteria used and population under study. However, it remains one of the most underdiagnosed and undertreated conditions in ophthalmology. Many tests used in the diagnosis of DED rely on an experienced observer for image interpretation, which may be considered subjective and result in variation in diagnosis.… ▽ More

    Submitted 2 September, 2021; originally announced September 2021.

  26. arXiv:2109.00855  [pdf, other

    cs.LG stat.ME stat.ML

    Inferring feature importance with uncertainties in high-dimensional data

    Authors: Pål Vegard Johnsen, Inga Strümke, Signe Riemer-Sørensen, Andrew Thomas DeWan, Mette Langaas

    Abstract: Estimating feature importance is a significant aspect of explaining data-based models. Besides explaining the model itself, an equally relevant question is which features are important in the underlying data generating process. We present a Shapley value based framework for inferring the importance of individual features, including uncertainty in the estimator. We build upon the recently published… ▽ More

    Submitted 20 September, 2021; v1 submitted 2 September, 2021; originally announced September 2021.

  27. Beyond Cuts in Small Signal Scenarios -- Enhanced Sneutrino Detectability Using Machine Learning

    Authors: Daniel Alvestad, Nikolai Fomin, Jörn Kersten, Steffen Maeland, Inga Strümke

    Abstract: We investigate enhancing the sensitivity of new physics searches at the LHC by machine learning in the case of background dominance and a high degree of overlap between the observables for signal and background. We use two different models, XGBoost and a deep neural network, to exploit correlations between observables and compare this approach to the traditional cut-and-count method. We consider d… ▽ More

    Submitted 7 July, 2023; v1 submitted 6 August, 2021; originally announced August 2021.

    Comments: Published in The European Physical Journal C. The Version of Record is available online at: https://doi.org/10.1140/epjc/s10052-023-11532-9

    Journal ref: Eur. Phys. J. C 83, 379 (2023)

  28. The social dilemma in artificial intelligence development and why we have to solve it

    Authors: Inga Strümke, Marija Slavkovik, Vince I. Madai

    Abstract: While the demand for ethical artificial intelligence (AI) systems increases, the number of unethical uses of AI accelerates, even though there is no shortage of ethical guidelines. We argue that a possible underlying cause for this is that AI developers face a social dilemma in AI development ethics, preventing the widespread adaptation of ethical best practices. We define the social dilemma for A… ▽ More

    Submitted 17 November, 2021; v1 submitted 27 July, 2021; originally announced July 2021.

  29. arXiv:2102.10936  [pdf, other

    cs.LG cs.AI stat.ML

    Shapley values for feature selection: The good, the bad, and the axioms

    Authors: Daniel Fryer, Inga Strümke, Hien Nguyen

    Abstract: The Shapley value has become popular in the Explainable AI (XAI) literature, thanks, to a large extent, to a solid theoretical foundation, including four "favourable and fair" axioms for attribution in transferable utility games. The Shapley value is provably the only solution concept satisfying these axioms. In this paper, we introduce the Shapley value and draw attention to its recent uses as a… ▽ More

    Submitted 22 February, 2021; originally announced February 2021.

    Comments: 8 pages, 5 figures

  30. arXiv:2007.06011  [pdf, other

    stat.ML cs.LG

    Explaining the data or explaining a model? Shapley values that uncover non-linear dependencies

    Authors: Daniel Vidali Fryer, Inga Strümke, Hien Nguyen

    Abstract: Shapley values have become increasingly popular in the machine learning literature thanks to their attractive axiomatisation, flexibility, and uniqueness in satisfying certain notions of `fairness'. The flexibility arises from the myriad potential forms of the Shapley value \textit{game formulation}. Amongst the consequences of this flexibility is that there are now many types of Shapley values be… ▽ More

    Submitted 6 March, 2021; v1 submitted 12 July, 2020; originally announced July 2020.

    Comments: 26 pages, 7 figures, 2 tables

  31. arXiv:2001.09593  [pdf, other

    stat.ME stat.CO

    Shapley value confidence intervals for attributing variance explained

    Authors: Daniel Fryer, Inga Strumke, Hien Nguyen

    Abstract: The coefficient of determination, the $R^2$, is often used to measure the variance explained by an affine combination of multiple explanatory covariates. An attribution of this explanatory contribution to each of the individual covariates is often sought in order to draw inference regarding the importance of each covariate with respect to the response phenomenon. A recent method for ascertaining s… ▽ More

    Submitted 8 August, 2020; v1 submitted 27 January, 2020; originally announced January 2020.

  32. arXiv:1804.11314  [pdf, other

    hep-ph

    Gaugino Mediation with Large Trilinears

    Authors: Jan Heisig, Joern Kersten, Nick Murphy, Inga Strümke

    Abstract: Gaugino mediation is an attractive supersymmetry breaking scheme naturally avoiding flavor problems by suppressing the soft sfermion masses at a high-energy scale. We consider an extension of the original model which yields non-vanishing trilinear scalar couplings. This increases the viable parameter space predicting a sufficiently large Higgs mass. Assuming the gravitino to be the lightest superp… ▽ More

    Submitted 30 April, 2018; originally announced April 2018.

    Comments: Talk given at Corfu Summer Institute 2017, School and Workshops on Elementary Particle Physics and Gravity, September 2017. To appear in proceedings

    Report number: TTK-18-16

  33. Signal mixture estimation for degenerate heavy Higgses using a deep neural network

    Authors: Anders Kvellestad, Steffen Maeland, Inga Strümke

    Abstract: If a new signal is established in future LHC data, a next question will be to determine the signal composition, in particular whether the signal is due to multiple near-degenerate states. We investigate the performance of a deep learning approach to signal mixture estimation for the challenging scenario of a ditau signal coming from a pair of degenerate Higgs bosons of opposite CP charge. This con… ▽ More

    Submitted 13 December, 2018; v1 submitted 20 April, 2018; originally announced April 2018.

    Comments: v2, 12 pages, 7 figures, published in EPJC

  34. arXiv:1711.01265  [pdf, other

    astro-ph.HE astro-ph.IM astro-ph.SR hep-ex

    Science with e-ASTROGAM (A space mission for MeV-GeV gamma-ray astrophysics)

    Authors: A. De Angelis, V. Tatischeff, I. A. Grenier, J. McEnery, M. Mallamaci, M. Tavani, U. Oberlack, L. Hanlon, R. Walter, A. Argan, P. Von Ballmoos, A. Bulgarelli, A. Bykov, M. Hernanz, G. Kanbach, I. Kuvvetli, M. Pearce, A. Zdziarski, J. Conrad, G. Ghisellini, A. Harding, J. Isern, M. Leising, F. Longo, G. Madejski , et al. (226 additional authors not shown)

    Abstract: e-ASTROGAM (enhanced ASTROGAM) is a breakthrough Observatory space mission, with a detector composed by a Silicon tracker, a calorimeter, and an anticoincidence system, dedicated to the study of the non-thermal Universe in the photon energy range from 0.3 MeV to 3 GeV - the lower energy limit can be pushed to energies as low as 150 keV for the tracker, and to 30 keV for calorimetric detection. The… ▽ More

    Submitted 8 August, 2018; v1 submitted 3 November, 2017; originally announced November 2017.

    Comments: Published on Journal of High Energy Astrophysics (Elsevier)

    Journal ref: Journal of High Energy Astrophysics, 2018, 19, 1-106

  35. Trilinear-Augmented Gaugino Mediation

    Authors: Jan Heisig, Jörn Kersten, Nick Murphy, Inga Strümke

    Abstract: We consider a gaugino-mediated supersymmetry breaking scenario where in addition to the gauginos the Higgs fields couple directly to the field that breaks supersymmetry. This yields non-vanishing trilinear scalar couplings in general, which can lead to large mixing in the stop sector providing a sufficiently large Higgs mass. Using the most recent release of FeynHiggs, we show the implications on… ▽ More

    Submitted 31 May, 2017; v1 submitted 9 January, 2017; originally announced January 2017.

    Comments: 13 pages + references, 4 figures, v4: corrected plot labels in figs. 1-3

    Report number: TTK-17-02, CP3-Origins-2017-002

    Journal ref: JHEP 05 (2017) 003