-
Beyond Pretty Pictures: Combined Single- and Multi-Image Super-resolution for Sentinel-2 Images
Authors:
Aditya Retnanto,
Son Le,
Sebastian Mueller,
Armin Leitner,
Michael Riffler,
Konrad Schindler,
Yohan Iddawela
Abstract:
Super-resolution aims to increase the resolution of satellite images by reconstructing high-frequency details, which go beyond naïve upsampling. This has particular relevance for Earth observation missions like Sentinel-2, which offer frequent, regular coverage at no cost; but at coarse resolution. Its pixel footprint is too large to capture small features like houses, streets, or hedge rows. To a…
▽ More
Super-resolution aims to increase the resolution of satellite images by reconstructing high-frequency details, which go beyond naïve upsampling. This has particular relevance for Earth observation missions like Sentinel-2, which offer frequent, regular coverage at no cost; but at coarse resolution. Its pixel footprint is too large to capture small features like houses, streets, or hedge rows. To address this, we present SEN4X, a hybrid super-resolution architecture that combines the advantages of single-image and multi-image techniques. It combines temporal oversampling from repeated Sentinel-2 acquisitions with a learned prior from high-resolution Pléiades Neo data. In doing so, SEN4X upgrades Sentinel-2 imagery to 2.5 m ground sampling distance. We test the super-resolved images on urban land-cover classification in Hanoi, Vietnam. We find that they lead to a significant performance improvement over state-of-the-art super-resolution baselines.
△ Less
Submitted 2 June, 2025; v1 submitted 30 May, 2025;
originally announced May 2025.
-
ECOSoundSet: a finely annotated dataset for the automated acoustic identification of Orthoptera and Cicadidae in North, Central and temperate Western Europe
Authors:
David Funosas,
Elodie Massol,
Yves Bas,
Svenja Schmidt,
Dominik Arend,
Alexander Gebhard,
Luc Barbaro,
Sebastian König,
Rafael Carbonell Font,
David Sannier,
Fernand Deroussen,
Jérôme Sueur,
Christian Roesti,
Tomi Trilar,
Wolfgang Forstmeier,
Lucas Roger,
Eloïsa Matheu,
Piotr Guzik,
Julien Barataud,
Laurent Pelozuelo,
Stéphane Puissant,
Sandra Mueller,
Björn Schuller,
Jose M. Montoya,
Andreas Triantafyllopoulos
, et al. (1 additional authors not shown)
Abstract:
Currently available tools for the automated acoustic recognition of European insects in natural soundscapes are limited in scope. Large and ecologically heterogeneous acoustic datasets are currently needed for these algorithms to cross-contextually recognize the subtle and complex acoustic signatures produced by each species, thus making the availability of such datasets a key requisite for their…
▽ More
Currently available tools for the automated acoustic recognition of European insects in natural soundscapes are limited in scope. Large and ecologically heterogeneous acoustic datasets are currently needed for these algorithms to cross-contextually recognize the subtle and complex acoustic signatures produced by each species, thus making the availability of such datasets a key requisite for their development. Here we present ECOSoundSet (European Cicadidae and Orthoptera Sound dataSet), a dataset containing 10,653 recordings of 200 orthopteran and 24 cicada species (217 and 26 respective taxa when including subspecies) present in North, Central, and temperate Western Europe (Andorra, Belgium, Denmark, mainland France and Corsica, Germany, Ireland, Luxembourg, Monaco, Netherlands, United Kingdom, Switzerland), collected partly through targeted fieldwork in South France and Catalonia and partly through contributions from various European entomologists. The dataset is composed of a combination of coarsely labeled recordings, for which we can only infer the presence, at some point, of their target species (weak labeling), and finely annotated recordings, for which we know the specific time and frequency range of each insect sound present in the recording (strong labeling). We also provide a train/validation/test split of the strongly labeled recordings, with respective approximate proportions of 0.8, 0.1 and 0.1, in order to facilitate their incorporation in the training and evaluation of deep learning algorithms. This dataset could serve as a meaningful complement to recordings already available online for the training of deep learning algorithms for the acoustic classification of orthopterans and cicadas in North, Central, and temperate Western Europe.
△ Less
Submitted 29 April, 2025;
originally announced April 2025.
-
Steering Feedback in Dynamic Driving Simulators: Road-Induced and Non-Road-Induced Harshness
Authors:
Maximilian Böhle,
Bernhard Schick,
Steffen Müller
Abstract:
Steering feedback plays a substantial role in the validity of driving simulators for the virtual development of modern vehicles. Established objective steering characteristics typically assess the feedback behavior in the frequency range of up to 30 Hz while factors such as steering wheel and vehicle body vibrations at higher frequencies are mainly approached as comfort issues. This work investiga…
▽ More
Steering feedback plays a substantial role in the validity of driving simulators for the virtual development of modern vehicles. Established objective steering characteristics typically assess the feedback behavior in the frequency range of up to 30 Hz while factors such as steering wheel and vehicle body vibrations at higher frequencies are mainly approached as comfort issues. This work investigates the influence of steering wheel and vehicle body excitations in the frequency range between 30 and 100 Hz on the subjective evaluation of steering feedback in a dynamic driving simulator. A controlled subject study with 42 participants was performed to compare a reference vehicle with an electrical power steering system to four variants of its virtual representation on a dynamic driving simulator. The effects of road-induced excitations were investigated by comparing a semi-empirical and a physics-based tire model, while the influence of non-road-induced excitations was investigated by implementing engine and wheel orders. The simulator variants were evaluated in comparison to the reference vehicle during closed-loop driving on a country road in a single-blind within-subjects design. The subjective evaluation focused on the perception of road feedback compared to the reference vehicle. The statistical analysis of subjective results shows that there is a strong effect of non-road-induced steering and vehicle body excitations, while the effect of road-induced excitations is considerably less pronounced.
△ Less
Submitted 15 April, 2025;
originally announced April 2025.
-
Automating Physics-Based Reasoning for SysML Model Validation
Authors:
Candice Chambers,
Summer Mueller,
Parth Ganeriwala,
Chiradeep Sen,
Siddhartha Bhattacharyya
Abstract:
System and software design benefits greatly from formal modeling, allowing for automated analysis and verification early in the design phase. Current methods excel at checking information flow and component interactions, ensuring consistency, and identifying dependencies within Systems Modeling Language (SysML) models. However, these approaches often lack the capability to perform physics-based re…
▽ More
System and software design benefits greatly from formal modeling, allowing for automated analysis and verification early in the design phase. Current methods excel at checking information flow and component interactions, ensuring consistency, and identifying dependencies within Systems Modeling Language (SysML) models. However, these approaches often lack the capability to perform physics-based reasoning about a system's behavior represented in SysML models, particularly in the electromechanical domain. This significant gap critically hinders the ability to automatically and effectively verify the correctness and consistency of the model's behavior against well-established underlying physical principles. Therefore, this paper presents an approach that leverages existing research on function representation, including formal languages, graphical representations, and reasoning algorithms, and integrates them with physics-based verification techniques. Four case studies (coffeemaker, vacuum cleaner, hairdryer, and wired speaker) are inspected to illustrate the model's practicality and effectiveness in performing physics-based reasoning on systems modeled in SysML. This automated physics-based reasoning is broken into two main categories: (i) structural, which is performed on BDD and IBD, and (ii) functional, which is then performed on activity diagrams. This work advances the field of automated reasoning by providing a framework for verifying structural and functional correctness and consistency with physical laws within SysML models.
△ Less
Submitted 30 January, 2025;
originally announced January 2025.
-
Automatic brain tumor segmentation in 2D intra-operative ultrasound images using magnetic resonance imaging tumor annotations
Authors:
Mathilde Faanes,
Ragnhild Holden Helland,
Ole Solheim,
Sébastien Muller,
Ingerid Reinertsen
Abstract:
Automatic segmentation of brain tumors in intra-operative ultrasound (iUS) images could facilitate localization of tumor tissue during resection surgery. The lack of large annotated datasets limits the current models performances. In this paper, we investigated the use of tumor annotations in magnetic resonance imaging (MRI) scans, which are more accessible than annotations in iUS images, for trai…
▽ More
Automatic segmentation of brain tumors in intra-operative ultrasound (iUS) images could facilitate localization of tumor tissue during resection surgery. The lack of large annotated datasets limits the current models performances. In this paper, we investigated the use of tumor annotations in magnetic resonance imaging (MRI) scans, which are more accessible than annotations in iUS images, for training of deep learning models for iUS brain tumor segmentation. We used 180 annotated MRI scans with corresponding unannotated iUS images, and 29 annotated iUS images. Image registration was performed to transfer the MRI annotations to the corresponding iUS images before training the nnU-Net model with different configurations of the data and label origins. The results showed no significant difference in Dice score for a model trained with only MRI annotated tumors compared to models trained with only iUS annotations and both, and to expert annotations, indicating that MRI tumor annotations can be used as a substitute for iUS tumor annotations to train a deep learning model for automatic brain tumor segmentation in iUS images. The best model obtained an average Dice score of $0.62\pm0.31$, compared to $0.67\pm0.25$ for an expert neurosurgeon, where the performance on larger tumors were similar, but lower for the models on smaller tumors. In addition, the results showed that removing smaller tumors from the training sets improved the results. The main models are available here: https://github.com/mathildefaanes/us_brain_tumor_segmentation/tree/main
△ Less
Submitted 15 August, 2025; v1 submitted 21 November, 2024;
originally announced November 2024.
-
Situation Awareness for Driver-Centric Driving Style Adaptation
Authors:
Johann Haselberger,
Bonifaz Stuhr,
Bernhard Schick,
Steffen Müller
Abstract:
There is evidence that the driving style of an autonomous vehicle is important to increase the acceptance and trust of the passengers. The driving situation has been found to have a significant influence on human driving behavior. However, current driving style models only partially incorporate driving environment information, limiting the alignment between an agent and the given situation. Theref…
▽ More
There is evidence that the driving style of an autonomous vehicle is important to increase the acceptance and trust of the passengers. The driving situation has been found to have a significant influence on human driving behavior. However, current driving style models only partially incorporate driving environment information, limiting the alignment between an agent and the given situation. Therefore, we propose a situation-aware driving style model based on different visual feature encoders pretrained on fleet data, as well as driving behavior predictors, which are adapted to the driving style of a specific driver. Our experiments show that the proposed method outperforms static driving styles significantly and forms plausible situation clusters. Furthermore, we found that feature encoders pretrained on our dataset lead to more precise driving behavior modeling. In contrast, feature encoders pretrained supervised and unsupervised on different data sources lead to more specific situation clusters, which can be utilized to constrain and control the driving style adaptation for specific situations. Moreover, in a real-world setting, where driving style adaptation is happening iteratively, we found the MLP-based behavior predictors achieve good performance initially but suffer from catastrophic forgetting. In contrast, behavior predictors based on situationdependent statistics can learn iteratively from continuous data streams by design. Overall, our experiments show that important information for driving behavior prediction is contained within the visual feature encoder. The dataset is publicly available at huggingface.co/datasets/jHaselberger/SADC-Situation-Awareness-for-Driver-Centric-Driving-Style-Adaptation.
△ Less
Submitted 28 March, 2024;
originally announced March 2024.
-
Steering Feedback in Dynamic Driving Simulators: The Influence of Steering Wheel Vibration and Vehicle Motion Frequency
Authors:
Maximilian Böhle,
Bernhard Schick,
Steffen Müller
Abstract:
The validity of the subjective evaluation of steering feedback in driving simulators is crucial for modern vehicle development. Although there are established objective steering characteristics for the assessment of both stationary and dynamic feedback behaviour, factors such as steering wheel vibrations and vehicle body motion, particularly in high-frequency ranges, present challenges in simulato…
▽ More
The validity of the subjective evaluation of steering feedback in driving simulators is crucial for modern vehicle development. Although there are established objective steering characteristics for the assessment of both stationary and dynamic feedback behaviour, factors such as steering wheel vibrations and vehicle body motion, particularly in high-frequency ranges, present challenges in simulator fidelity. This work investigates the influence of steering wheel vibration and vehicle body motion frequency content on the subjective evaluation of steering feedback during closed-loop driving in a dynamic driving simulator. A controlled subject study with 30 participants consisting of a back-to-back comparison of a reference vehicle with an electrical power steering system and three variants of its virtual representation on a dynamic driving simulator was performed. Subjective evaluation focused on the representation of road feedback in comparison to the reference vehicle. The statistical analysis of subjective results show that there is a significant influence of the frequency content of both steering wheel torque and vehicle motion on the subjective evaluation of steering feedback in a dynamic driving simulator. The results suggest an influence of frequency content on the subjective evaluation quality of steering feedback characteristics that are not associated with the dynamic feedback behaviour in the context of established performance indicators.
△ Less
Submitted 15 April, 2025; v1 submitted 26 March, 2024;
originally announced March 2024.
-
Exploring the Influence of Driving Context on Lateral Driving Style Preferences: A Simulator-Based Study
Authors:
Johann Haselberger,
Maximilian Böhle,
Bernhard Schick,
Steffen Müller
Abstract:
Technological advancements focus on developing comfortable and acceptable driving characteristics in autonomous vehicles. Present driving functions predominantly possess predefined parameters, and there is no universally accepted driving style for autonomous vehicles. While driving may be technically safe and the likelihood of road accidents is reduced, passengers may still feel insecure due to a…
▽ More
Technological advancements focus on developing comfortable and acceptable driving characteristics in autonomous vehicles. Present driving functions predominantly possess predefined parameters, and there is no universally accepted driving style for autonomous vehicles. While driving may be technically safe and the likelihood of road accidents is reduced, passengers may still feel insecure due to a mismatch in driving styles between the human and the autonomous system. Incorporating driving style preferences into automated vehicles enhances acceptance, reduces uncertainty, and poses the opportunity to expedite their adoption. Despite the increased research focus on driving styles, there remains a need for comprehensive studies investigating how variations in the driving context impact the assessment of automated driving functions. Therefore, this work evaluates lateral driving style preferences for autonomous vehicles on rural roads, considering different weather and traffic situations. A controlled study was conducted with a variety of German participants utilizing a high-fidelity driving simulator. The subjects experienced four different driving styles, including mimicking of their own driving behavior under two weather conditions. A notable preference for a more passive driving style became evident based on statistical analyses of participants' responses during and after the drives. This study could not confirm the hypothesis that subjects prefer to be driven by mimicking their own driving behavior. Furthermore, the study illustrated that weather conditions and oncoming traffic substantially influence the perceived comfort during autonomous rides. The gathered dataset is openly accessible at https://www.kaggle.com/datasets/jhaselberger/idcld-subject-study-on-driving-style-preferences.
△ Less
Submitted 10 April, 2024; v1 submitted 22 February, 2024;
originally announced February 2024.
-
Self-Perception Versus Objective Driving Behavior: Subject Study of Lateral Vehicle Guidance
Authors:
Johann Haselberger,
Bernhard Schick,
Steffen Müller
Abstract:
Advancements in technology are steering attention toward creating comfortable and acceptable driving characteristics in autonomous vehicles. Ensuring a safe and comfortable ride experience is vital for the widespread adoption of autonomous vehicles, as mismatches in driving styles between humans and autonomous systems can impact passenger confidence. Current driving functions have fixed parameters…
▽ More
Advancements in technology are steering attention toward creating comfortable and acceptable driving characteristics in autonomous vehicles. Ensuring a safe and comfortable ride experience is vital for the widespread adoption of autonomous vehicles, as mismatches in driving styles between humans and autonomous systems can impact passenger confidence. Current driving functions have fixed parameters, and there is no universally agreed-upon driving style for autonomous vehicles. Integrating driving style preferences into automated vehicles may enhance acceptance and reduce uncertainty, expediting their adoption. A controlled vehicle study (N = 62) was conducted with a variety of German participants to identify the individual lateral driving behavior of human drivers, specifically emphasizing rural roads. We introduce novel indicators for assessing stationary and transient curve negotiation, directly applicable in developing personalized lateral driving functions. To assess the predictability of these indicators using self-reports, we introduce the MDSI-DE, the German version of the Multidimensional Driving Style Inventory. The correlation analysis between MDSI factor scores and proposed indicators showed modest but significant associations, primarily with acceleration and jerk statistics while the in-depth lateral driving behavior turned out to be highly driver-heterogeneous. The dataset including the anonymized socio-demographics and questionnaire responses, the raw vehicle measurements including labels, and the derived driving behavior indicators are publicly available at https://www.kaggle.com/datasets/jhaselberger/spodb-subject-study-of-lateral-vehicle-guidance.
△ Less
Submitted 21 February, 2024; v1 submitted 20 February, 2024;
originally announced February 2024.
-
A multi-institutional pediatric dataset of clinical radiology MRIs by the Children's Brain Tumor Network
Authors:
Ariana M. Familiar,
Anahita Fathi Kazerooni,
Hannah Anderson,
Aliaksandr Lubneuski,
Karthik Viswanathan,
Rocky Breslow,
Nastaran Khalili,
Sina Bagheri,
Debanjan Haldar,
Meen Chul Kim,
Sherjeel Arif,
Rachel Madhogarhia,
Thinh Q. Nguyen,
Elizabeth A. Frenkel,
Zeinab Helili,
Jessica Harrison,
Keyvan Farahani,
Marius George Linguraru,
Ulas Bagci,
Yury Velichko,
Jeffrey Stevens,
Sarah Leary,
Robert M. Lober,
Stephani Campion,
Amy A. Smith
, et al. (15 additional authors not shown)
Abstract:
Pediatric brain and spinal cancers remain the leading cause of cancer-related death in children. Advancements in clinical decision-support in pediatric neuro-oncology utilizing the wealth of radiology imaging data collected through standard care, however, has significantly lagged other domains. Such data is ripe for use with predictive analytics such as artificial intelligence (AI) methods, which…
▽ More
Pediatric brain and spinal cancers remain the leading cause of cancer-related death in children. Advancements in clinical decision-support in pediatric neuro-oncology utilizing the wealth of radiology imaging data collected through standard care, however, has significantly lagged other domains. Such data is ripe for use with predictive analytics such as artificial intelligence (AI) methods, which require large datasets. To address this unmet need, we provide a multi-institutional, large-scale pediatric dataset of 23,101 multi-parametric MRI exams acquired through routine care for 1,526 brain tumor patients, as part of the Children's Brain Tumor Network. This includes longitudinal MRIs across various cancer diagnoses, with associated patient-level clinical information, digital pathology slides, as well as tissue genotype and omics data. To facilitate downstream analysis, treatment-naïve images for 370 subjects were processed and released through the NCI Childhood Cancer Data Initiative via the Cancer Data Service. Through ongoing efforts to continuously build these imaging repositories, our aim is to accelerate discovery and translational AI models with real-world data, to ultimately empower precision medicine for children.
△ Less
Submitted 2 October, 2023;
originally announced October 2023.
-
Deformable registration with intensity correction for CESM monitoring response to Neoadjuvant Chemotherapy
Authors:
Clément Jailin,
Pablo Milioni De Carvalho,
Sara Mohamed,
Laurence Vancamberg,
Amr Farouk Ibrahim Moustafa,
Mohammed Gomaa,
Rasha Mohammed Kamal,
Serge Muller
Abstract:
This paper proposes a robust longitudinal registration method for Contrast Enhanced Spectral Mammography in monitoring neoadjuvant chemotherapy. Because breast texture intensity changes with the treatment, a non-rigid registration procedure with local intensity compensations is developed. The approach allows registering the low energy images of the exams acquired before and after the chemotherapy.…
▽ More
This paper proposes a robust longitudinal registration method for Contrast Enhanced Spectral Mammography in monitoring neoadjuvant chemotherapy. Because breast texture intensity changes with the treatment, a non-rigid registration procedure with local intensity compensations is developed. The approach allows registering the low energy images of the exams acquired before and after the chemotherapy. The measured motion is then applied to the corresponding recombined images. The difference of registered images, called residual, makes vanishing the breast texture that did not changed between the two exams. Consequently, this registered residual allows identifying local density and iodine changes, especially in the lesion area. The method is validated with a synthetic NAC case where ground truths are available. Then the procedure is applied to 51 patients with 208 CESM image pairs acquired before and after the chemotherapy treatment. The proposed registration converged in all 208 cases. The intensity-compensated registration approach is evaluated with different mathematical metrics and through the repositioning of clinical landmarks (RMSE: 5.9 mm) and outperforms state-of-the-art registration techniques.
△ Less
Submitted 22 February, 2023;
originally announced February 2023.
-
Vectorized Scenario Description and Motion Prediction for Scenario-Based Testing
Authors:
Max Winkelmann,
Constantin Vasconi,
Steffen Müller
Abstract:
Automated vehicles (AVs) are tested in diverse scenarios, typically specified by parameters such as velocities, distances, or curve radii. To describe scenarios uniformly independent of such parameters, this paper proposes a vectorized scenario description defined by the road geometry and vehicles' trajectories. Data of this form are generated for three scenarios, merged, and used to train the mot…
▽ More
Automated vehicles (AVs) are tested in diverse scenarios, typically specified by parameters such as velocities, distances, or curve radii. To describe scenarios uniformly independent of such parameters, this paper proposes a vectorized scenario description defined by the road geometry and vehicles' trajectories. Data of this form are generated for three scenarios, merged, and used to train the motion prediction model VectorNet, allowing to predict an AV's trajectory for unseen scenarios. Predicting scenario evaluation metrics, VectorNet partially achieves lower errors than regression models that separately process the three scenarios' data. However, for comprehensive generalization, sufficient variance in the training data must be ensured. Thus, contrary to existing methods, our proposed method can merge diverse scenarios' data and exploit spatial and temporal nuances in the vectorized scenario description. As a result, data from specified test scenarios and real-world scenarios can be compared and combined for (predictive) analyses and scenario selection.
△ Less
Submitted 25 August, 2023; v1 submitted 2 February, 2023;
originally announced February 2023.
-
Development of a 3D model of clinically relevant microcalcifications
Authors:
Ann-Katherine Carton,
Clément Jailin,
Raoul de Sousa Silva,
Ruben Sanchez de la Rosa,
Serge Muller
Abstract:
A realistic 3D anthropomorphic software model of microcalcifications may serve as a useful tool to assess the performance of breast imaging applications through simulations. We present a method allowing to simulate visually realistic microcalcifications with large morphological variability. Principal component analysis (PCA) was used to analyze the shape of 281 biopsied microcalcifications imaged…
▽ More
A realistic 3D anthropomorphic software model of microcalcifications may serve as a useful tool to assess the performance of breast imaging applications through simulations. We present a method allowing to simulate visually realistic microcalcifications with large morphological variability. Principal component analysis (PCA) was used to analyze the shape of 281 biopsied microcalcifications imaged with a micro-CT. The PCA analysis requires the same number of shape components for each input microcalcification. Therefore, the voxel-based microcalcifications were converted to a surface mesh with same number of vertices using a marching cube algorithm. The vertices were registered using an iterative closest point algorithm and a simulated annealing algorithm. To evaluate the approach, input microcalcifications were reconstructed by progressively adding principal components. Input and reconstructed microcalcifications were visually and quantitatively compared. New microcalcifications were simulated using randomly sampled principal components determined from the PCA applied to the input microcalcifications, and their realism was appreciated through visual assessment. Preliminary results have shown that input microcalcifications can be reconstructed with high visual fidelity when using 62 principal components, representing 99.5% variance. For that condition, the average L2 norm and dice coefficient were respectively 10.5 $μ$m and 0.93. Newly generated microcalcifications with 62 principal components were found to be visually similar, while not identical, to input microcalcifications. The proposed PCA model of microcalcification shapes allows to successfully reconstruct input microcalcifications and to generate new visually realistic microcalcifications with various morphologies.
△ Less
Submitted 8 November, 2022;
originally announced November 2022.
-
Breast shape estimation and correction in CESM biopsy
Authors:
Ruben Sanchez,
Clément Jailin,
Ann-Katherine Carton,
Pablo Milioni de Carvalho,
Laurence Casteignau,
Serge Muller
Abstract:
Description of purpose: Contrast-enhanced spectral mammography can be used to guide needle biopsies. However, in vertical approach the compressed breast is deformed generating a so-called bump in the paddle aperture, which may interfere with the visibility of contrast-uptakes. Local thickness estimation would provide an enhanced image quality of the recombined image, increasing the visibility of t…
▽ More
Description of purpose: Contrast-enhanced spectral mammography can be used to guide needle biopsies. However, in vertical approach the compressed breast is deformed generating a so-called bump in the paddle aperture, which may interfere with the visibility of contrast-uptakes. Local thickness estimation would provide an enhanced image quality of the recombined image, increasing the visibility of the contrast-uptakes to be targeted during the biopsy procedure. In this work we propose a method to estimate the shape of the breast bump in biopsy vertical approach. Materials and Methods: Our method consists on two steps: first, we compute a raw thickness which does not take into account the presence of contrast-uptakes; second, we use a physical model to separate the sparse iodine texture from the breast shape. This physical model is composed by a sum of Fourier components, describing the main shape of the bump, a series of low-order polynomials, describing the main compressed thickness, paddle tilt and deflection, and non-linear components describing the translation and rotation of the paddle aperture. A 3D object mimicking a bump was fabricated to test the pertinence of our shape model. Also, clinical images of 21 patients which followed CESM-guided biopsy were visually assessed. Results: Comparison between raw and final estimated thickness of our 3D test object shows an error standard deviation of 0.37 mm similar to the noise standard deviation equals to 0.32 mm. The visual assessment of clinical cases showed that the thickness correction removes the superimposed low-frequency pattern due to non-uniform thickness of the bump, improving the identification of the lesion to be targeted. Conclusion: The proposed method for thickness estimation is adapted to CESM-guided biopsies in vertical approach and it improves the identification of the contrast-uptakes that need to be targeted during the procedure.
△ Less
Submitted 28 July, 2022;
originally announced July 2022.
-
Lesion detection in contrast enhanced spectral mammography
Authors:
Clément Jailin,
Pablo Milioni,
Zhijin Li,
Răzvan Iordache,
Serge Muller
Abstract:
Background \& purpose: The recent emergence of neural networks models for the analysis of breast images has been a breakthrough in computer aided diagnostic. This approach was not yet developed in Contrast Enhanced Spectral Mammography (CESM) where access to large databases is complex. This work proposes a deep-learning-based Computer Aided Diagnostic development for CESM recombined images able to…
▽ More
Background \& purpose: The recent emergence of neural networks models for the analysis of breast images has been a breakthrough in computer aided diagnostic. This approach was not yet developed in Contrast Enhanced Spectral Mammography (CESM) where access to large databases is complex. This work proposes a deep-learning-based Computer Aided Diagnostic development for CESM recombined images able to detect lesions and classify cases. Material \& methods: A large CESM diagnostic dataset with biopsy-proven lesions was collected from various hospitals and different acquisition systems. The annotated data were split on a patient level for the training (55%), validation (15%) and test (30%) of a deep neural network with a state-of-the-art detection architecture. Free Receiver Operating Characteristic (FROC) was used to evaluate the model for the detection of 1) all lesions, 2) biopsied lesions and 3) malignant lesions. ROC curve was used to evaluate breast cancer classification. The metrics were finally compared to clinical results. Results: For the evaluation of the malignant lesion detection, at high sensitivity (Se>0.95), the false positive rate was at 0.61 per image. For the classification of malignant cases, the model reached an Area Under the Curve (AUC) in the range of clinical CESM diagnostic results. Conclusion: This CAD is the first development of a lesion detection and classification model for CESM images. Trained on a large dataset, it has the potential to be used for helping the management of biopsy decision and for helping the radiologist detecting complex lesions that could modify the clinical treatment.
△ Less
Submitted 20 July, 2022;
originally announced July 2022.
-
Transfer Importance Sampling -- How Testing Automated Vehicles in Multiple Test Setups Helps With the Bias-Variance Tradeoff
Authors:
Max Winkelmann,
Constantin Vasconi,
Steffen Müller
Abstract:
The promise of increased road safety is a key motivator for the development of automated vehicles (AV). Yet, demonstrating that an AV is as safe as, or even safer than, a human-driven vehicle has proven to be challenging. Should an AV be examined purely virtually, allowing large numbers of fully controllable tests? Or should it be tested under real environmental conditions on a proving ground? Sin…
▽ More
The promise of increased road safety is a key motivator for the development of automated vehicles (AV). Yet, demonstrating that an AV is as safe as, or even safer than, a human-driven vehicle has proven to be challenging. Should an AV be examined purely virtually, allowing large numbers of fully controllable tests? Or should it be tested under real environmental conditions on a proving ground? Since different test setups have different strengths and weaknesses, it is still an open question how virtual and real tests should be combined. On the way to answer this question, this paper proposes transfer importance sampling (TIS), a risk estimation method linking different test setups. Fusing the concepts of transfer learning and importance sampling, TIS uses a scalable, cost-effective test setup to comprehensively explore an AV's behavior. The insights gained then allow parameterizing tests in a more trustworthy test setup accurately reflecting risks. We show that when using a trustworthy test setup alone is prohibitively expensive, linking it to a scalable test setup can increase efficiency $\unicode{x2013}$ without sacrificing the result's validity. Thus, the test setups' individual deficiencies are compensated for by their systematic linkage.
△ Less
Submitted 4 November, 2022; v1 submitted 15 April, 2022;
originally announced April 2022.
-
Experimental Data-Driven Model Predictive Control of a Hospital HVAC System During Regular Use
Authors:
Emilio T. Maddalena,
Silvio A. Muller,
Rafael M. dos Santos,
Christophe Salzmann,
Colin N. Jones
Abstract:
Herein we report a multi-zone, heating, ventilation and air-conditioning (HVAC) control case study of an industrial plant responsible for cooling a hospital surgery center. The adopted approach to guaranteeing thermal comfort and reducing electrical energy consumption is based on a statistical non-parametric, non-linear regression technique named Gaussian processes. Our study aimed at assessing th…
▽ More
Herein we report a multi-zone, heating, ventilation and air-conditioning (HVAC) control case study of an industrial plant responsible for cooling a hospital surgery center. The adopted approach to guaranteeing thermal comfort and reducing electrical energy consumption is based on a statistical non-parametric, non-linear regression technique named Gaussian processes. Our study aimed at assessing the suitability of the aforementioned technique to learning the building dynamics and yielding models for our model predictive control (MPC) scheme. Experimental results gathered while the building was under regular use showcase the final controller performance while subject to a number of measured and unmeasured disturbances. Finally, we provide readers with practical details and recommendations on how to manage the computational complexity of the on-line optimization problem and obtain high-quality solutions from solvers.
△ Less
Submitted 31 January, 2022; v1 submitted 14 December, 2021;
originally announced December 2021.
-
Probabilistic Metamodels for an Efficient Characterization of Complex Driving Scenarios
Authors:
Max Winkelmann,
Mike Kohlhoff,
Hadj Hamma Tadjine,
Steffen Müller
Abstract:
To validate the safety of automated vehicles (AV), scenario-based testing aims to systematically describe driving scenarios an AV might encounter. In this process, continuous inputs such as velocities result in an infinite number of possible variations of a scenario. Thus, metamodels are used to perform analyses or to select specific variations for examination. However, despite the safety critical…
▽ More
To validate the safety of automated vehicles (AV), scenario-based testing aims to systematically describe driving scenarios an AV might encounter. In this process, continuous inputs such as velocities result in an infinite number of possible variations of a scenario. Thus, metamodels are used to perform analyses or to select specific variations for examination. However, despite the safety criticality of AV testing, metamodels are usually seen as a part of an overall approach, and their predictions are not questioned. This paper analyzes the predictive performance of Gaussian processes (GP), deep Gaussian processes, extra-trees, and Bayesian neural networks (BNN), considering four scenarios with 5 to 20 inputs. Building on this, an iterative approach is introduced and evaluated, which allows to efficiently select test cases for common analysis tasks. The results show that regarding predictive performance, the appropriate selection of test cases is more important than the choice of metamodels. However, the choice of metamodels remains crucial: Their great flexibility allows BNNs to benefit from large amounts of data and to model even the most complex scenarios. In contrast, less flexible models like GPs convince with higher reliability. Hence, relevant test cases are best explored using scalable virtual test setups and flexible models. Subsequently, more realistic test setups and more reliable models can be used for targeted testing and validation.
△ Less
Submitted 30 September, 2022; v1 submitted 6 October, 2021;
originally announced October 2021.
-
Robust Model Predictive Longitudinal Position Tracking Control for an Autonomous Vehicle Based on Multiple Models
Authors:
André Kempf,
Markus Herrmann-Wicklmayr,
Steffen Müller
Abstract:
The aim of this work is to control the longitudinal position of an autonomous vehicle with an internal combustion engine. The powertrain has an inherent dead-time characteristic and constraints on physical states apply since the vehicle is neither able to accelerate arbitrarily strong, nor to drive arbitrarily fast. A model predictive controller (MPC) is able to cope with both of the aforementione…
▽ More
The aim of this work is to control the longitudinal position of an autonomous vehicle with an internal combustion engine. The powertrain has an inherent dead-time characteristic and constraints on physical states apply since the vehicle is neither able to accelerate arbitrarily strong, nor to drive arbitrarily fast. A model predictive controller (MPC) is able to cope with both of the aforementioned system properties. MPC heavily relies on a model and therefore a strategy on how to obtain multiple linear state space prediction models of the nonlinear system via input/output data system identification from acceleration data is given. The models are identified in different regions of the vehicle dynamics in order to obtain more accurate predictions. The still remaining plant-model mismatch can be expressed as an additive disturbance which can be handled through robust control theory. Therefore modifications to the models for applying robust MPC tracking control theory are described. Then a controller which guarantees robust constraint satisfaction and recursive feasibility is designed. As a next step, modifications to apply the controller on multiple models are discussed. In this context, a model switching strategy is provided and theoretical and computational limitations are pointed out. Lastly, simulation results are presented and discussed, including computational load when switching between systems.
△ Less
Submitted 21 October, 2020; v1 submitted 28 September, 2020;
originally announced September 2020.
-
Algorithm Based on One Monocular Video Delivers Highly Valid and Reliable Gait Parameters
Authors:
Arash Azhand,
Sophie Rabe,
Swantje Müller,
Igor Sattler,
Anika Steinert
Abstract:
Despite its paramount importance for manifold use cases (e.g., in the health care industry, sports, rehabilitation and fitness assessment), sufficiently valid and reliable gait parameter measurement is still limited to high-tech gait laboratories mostly. Here, we demonstrate the excellent validity and test-retest repeatability of a novel gait assessment system which is built upon modern convolutio…
▽ More
Despite its paramount importance for manifold use cases (e.g., in the health care industry, sports, rehabilitation and fitness assessment), sufficiently valid and reliable gait parameter measurement is still limited to high-tech gait laboratories mostly. Here, we demonstrate the excellent validity and test-retest repeatability of a novel gait assessment system which is built upon modern convolutional neural networks to extract three-dimensional skeleton joints from monocular frontal-view videos of walking humans. The validity study is based on a comparison to the GAITRite pressure-sensitive walkway system. All measured gait parameters (gait speed, cadence, step length and step time) showed excellent concurrent validity for multiple walk trials at normal and fast gait speeds. The test-retest-repeatability is on the same level as the GAITRite system. In conclusion, we are convinced that our results can pave the way for cost, space and operationally effective gait analysis in broad mainstream applications. Most sensor-based systems are costly, must be operated by extensively trained personnel (e.g., motion capture systems) or - even if not quite as costly - still possess considerable complexity (e.g., wearable sensors). In contrast, a video sufficient for the assessment method presented here can be obtained by anyone, without much training, via a smartphone camera.
△ Less
Submitted 23 June, 2021; v1 submitted 5 August, 2020;
originally announced August 2020.
-
Robustness of Brain Tumor Segmentation
Authors:
Sabine Müller,
Joachim Weickert,
Norbert Graf
Abstract:
Purpose: The segmentation of brain tumors is one of the most active areas of medical image analysis. While current methods perform superhuman on benchmark data sets, their applicability in daily clinical practice has not been evaluated. In our work we investigate the generalization behavior of deep neural networks in this scenario.
Approach: We evaluate the performance of three state-of-the-art…
▽ More
Purpose: The segmentation of brain tumors is one of the most active areas of medical image analysis. While current methods perform superhuman on benchmark data sets, their applicability in daily clinical practice has not been evaluated. In our work we investigate the generalization behavior of deep neural networks in this scenario.
Approach: We evaluate the performance of three state-of-the-art methods, a basic U-net architecture and a cascadic Mumford-Shah approach. We also propose two simple modifications (which do not change the topology) to improve generalization performance.
Results: In our experiments we show that a well-trained U-network shows the best generalization behavior and is sufficient to solve this segmentation problem. We illustrate why extensions of this model in a realistic scenario can be not only pointless but even harmful.
Conclusions: We conclude from our experiments that the generalization performance of deep neural networks is severely limited in medical image analysis especially in the area of brain tumor segmentation. In our opinion, current topologies are optimized for the actual benchmark data set, but are not directly applicable in daily clinical practice.
△ Less
Submitted 15 December, 2020; v1 submitted 24 December, 2019;
originally announced December 2019.
-
Topological and Network Analysis of Lithium Ion Battery Components: The Importance of Pore Space Connectivity for Cell Operation
Authors:
Marie Francine Lagadec,
Raphael Zahn,
Simon Müller,
Vanessa Wood
Abstract:
The structure of lithium ion battery components, such as electrodes and separators, are commonly characterised in terms of their porosity and tortuosity. The ratio of these values gives the effective transport of lithium ions in the electrolyte-filled pore spaces, which can be used to determine the ionic resistivity and corresponding voltage losses. Here, we show that these microstructural charact…
▽ More
The structure of lithium ion battery components, such as electrodes and separators, are commonly characterised in terms of their porosity and tortuosity. The ratio of these values gives the effective transport of lithium ions in the electrolyte-filled pore spaces, which can be used to determine the ionic resistivity and corresponding voltage losses. Here, we show that these microstructural characteristics are not sufficient. Analysis of tomographic data of commercial separators reveals that different polyolefin separators have similar porosity and through-plane tortuosity, which, in the homogenised picture of lithium ion cell operation, would imply that these different separators exhibit similar performance. However, numerical diffusion simulations indicate that this is not the case. We demonstrate that the extent to which lithium ion concentration gradients are induced or smoothed by the separator structure is linked to pore space connectivity, a parameter that can be determined by topological or network based analysis of separators. These findings enable us to propose how to design separator microstructures that are safer and accommodate fast charge and discharge.
△ Less
Submitted 23 May, 2018;
originally announced June 2018.
