-
Impact of deep learning model uncertainty on manual corrections to auto-segmentation in prostate cancer radiotherapy
Authors:
Viktor Rogowski,
Angelica Svalkvist,
Matteo Maspero,
Tomas Janssen,
Federica Carmen Maruccio,
Jenny Gorgisyan,
Jonas Scherman,
Ida Häggström,
Victor Wåhlstrand,
Adalsteinn Gunnlaugsson,
Martin P Nilsson,
Mathieu Moreau,
Nándor Vass,
Niclas Pettersson,
Christian Jamtheim Gustafsson
Abstract:
Background: Deep learning (DL)-based organ segmentation is increasingly used in radiotherapy, yet voxel-wise DL uncertainty maps are rarely presented to clinicians. Purpose: This study assessed how DL-generated uncertainty maps impact radiation oncologists during manual correction of prostate radiotherapy DL segmentations. Methods: Two nnUNet models were trained by 10-fold cross-validation on 434…
▽ More
Background: Deep learning (DL)-based organ segmentation is increasingly used in radiotherapy, yet voxel-wise DL uncertainty maps are rarely presented to clinicians. Purpose: This study assessed how DL-generated uncertainty maps impact radiation oncologists during manual correction of prostate radiotherapy DL segmentations. Methods: Two nnUNet models were trained by 10-fold cross-validation on 434 MRI-only prostate cancer cases to segment the prostate and rectum. Each model was evaluated on 35 independent cases. Voxel-wise uncertainty was calculated using the SoftMax standard deviation (n=10) and visualized as a color-coded map. Four oncologists performed segmentation in two steps: Step 1: Rated segmentation quality and confidence using Likert scales and edited DL segmentations without uncertainty maps. Step 2 ($\geq 4$ weeks later): Repeated step 1, but with uncertainty maps available. Segmentation time was recorded for both steps, and oncologists provided qualitative free-text feedback. Histogram analysis compared voxel edits across uncertainty levels. Results: DL segmentations showed high agreement with oncologist edits. Quality ratings varied: rectum segmentation ratings slightly decreased overall in step 2, while prostate ratings differed among oncologists. Confidence ratings also varied. Three oncologists reduced segmentation time with uncertainty maps, saving 1-2 minutes per case. Histogram analysis showed 50% fewer edits for step 2 in low-uncertainty areas. Conclusions: Presenting DL segmentation uncertainty information to radiation oncologists influences their decision-making, quality perception, and confidence in the DL segmentations. Low-uncertainty regions were edited less frequently, indicating increased trust in DL predictions. Uncertainty maps improve efficiency by reducing segmentation time and can be a valuable clinical tool, enhancing radiotherapy planning efficiency.
△ Less
Submitted 27 February, 2025; v1 submitted 26 February, 2025;
originally announced February 2025.
-
Investigating team maturity in an agile automotive reorganization
Authors:
Lucas Gren,
Niclas Pettersson
Abstract:
About seven years ago, Volvo Cars initiated a large-scale agile transformation. Midst this journey, a significant restructuring of the R&D department took place. Our study aims to illuminate how team maturity levels are impacted during such comprehensive reorganizations. We collected data from 63 teams to comprehend the effects of organizational changes on these agile teams. Additionally, qualitat…
▽ More
About seven years ago, Volvo Cars initiated a large-scale agile transformation. Midst this journey, a significant restructuring of the R&D department took place. Our study aims to illuminate how team maturity levels are impacted during such comprehensive reorganizations. We collected data from 63 teams to comprehend the effects of organizational changes on these agile teams. Additionally, qualitative data was gathered to validate our findings and explore underlying reasons. Contrary to what was expected, the reorganization did not significantly alter the distribution of team maturity. High turnover rates and frequent reorganizations were identified as key factors to why the less mature teams remained in the early stages of team development. Conversely, teams in the second category remained stable at a higher maturity stage, primarily because the teams themselves remained largely intact, with only management structures changing. In conclusion, while reorganizations may hinder some teams' development, others maintain stability at a higher level of maturity despite substantial managerial changes.
△ Less
Submitted 18 September, 2024;
originally announced September 2024.
-
Mutation Testing Optimisations using the Clang Front-end
Authors:
Sten Vercammen,
Serge Demeyer,
Markus Borg,
Niklas Pettersson,
Görel Hedin
Abstract:
Mutation testing is the state-of-the-art technique for assessing the fault detection capacity of a test suite. Unfortunately, a full mutation analysis is often prohibitively expensive. The CppCheck project for instance, demands a build time of 5.8 minutes and a test execution time of 17 seconds on our desktop computer. An unoptimised mutation analysis, for 55,000 generated mutants took 11.8 days i…
▽ More
Mutation testing is the state-of-the-art technique for assessing the fault detection capacity of a test suite. Unfortunately, a full mutation analysis is often prohibitively expensive. The CppCheck project for instance, demands a build time of 5.8 minutes and a test execution time of 17 seconds on our desktop computer. An unoptimised mutation analysis, for 55,000 generated mutants took 11.8 days in total, of which 4.3 days is spent on (re)compiling the project. In this paper we present a feasibility study, investigating how a number of optimisation strategies can be implemented based on the Clang front-end. These optimisation strategies allow to eliminate the compilation and execution overhead in order to support efficient mutation testing for the C language family. We provide a proof-of-concept tool that achieves a speedup of between 2x and 30x. We make a detailed analysis of the speedup induced by the optimisations, elaborate on the lessons learned and point out avenues for further improvements.
△ Less
Submitted 31 October, 2022;
originally announced October 2022.
-
Future physics opportunities for high-density QCD at the LHC with heavy-ion and proton beams
Authors:
Z. Citron,
A. Dainese,
J. F. Grosse-Oetringhaus,
J. M. Jowett,
Y. -J. Lee,
U. A. Wiedemann,
M. Winn,
A. Andronic,
F. Bellini,
E. Bruna,
E. Chapon,
H. Dembinski,
D. d'Enterria,
I. Grabowska-Bold,
G. M. Innocenti,
C. Loizides,
S. Mohapatra,
C. A. Salgado,
M. Verweij,
M. Weber,
J. Aichelin,
A. Angerami,
L. Apolinario,
F. Arleo,
N. Armesto
, et al. (160 additional authors not shown)
Abstract:
The future opportunities for high-density QCD studies with ion and proton beams at the LHC are presented. Four major scientific goals are identified: the characterisation of the macroscopic long wavelength Quark-Gluon Plasma (QGP) properties with unprecedented precision, the investigation of the microscopic parton dynamics underlying QGP properties, the development of a unified picture of particle…
▽ More
The future opportunities for high-density QCD studies with ion and proton beams at the LHC are presented. Four major scientific goals are identified: the characterisation of the macroscopic long wavelength Quark-Gluon Plasma (QGP) properties with unprecedented precision, the investigation of the microscopic parton dynamics underlying QGP properties, the development of a unified picture of particle production and QCD dynamics from small (pp) to large (nucleus--nucleus) systems, the exploration of parton densities in nuclei in a broad ($x$, $Q^2$) kinematic range and the search for the possible onset of parton saturation. In order to address these scientific goals, high-luminosity Pb-Pb and p-Pb programmes are considered as priorities for Runs 3 and 4, complemented by high-multiplicity studies in pp collisions and a short run with oxygen ions. High-luminosity runs with intermediate-mass nuclei, for example Ar or Kr, are considered as an appealing case for extending the heavy-ion programme at the LHC beyond Run 4. The potential of the High-Energy LHC to probe QCD matter with newly-available observables, at twice larger center-of-mass energies than the LHC, is investigated.
△ Less
Submitted 25 February, 2019; v1 submitted 17 December, 2018;
originally announced December 2018.
