-
Persona-driven Simulation of Voting Behavior in the European Parliament with Large Language Models
Authors:
Maximilian Kreutner,
Marlene Lutz,
Markus Strohmaier
Abstract:
Large Language Models (LLMs) display remarkable capabilities to understand or even produce political discourse, but have been found to consistently display a progressive left-leaning bias. At the same time, so-called persona or identity prompts have been shown to produce LLM behavior that aligns with socioeconomic groups that the base model is not aligned with. In this work, we analyze whether zer…
▽ More
Large Language Models (LLMs) display remarkable capabilities to understand or even produce political discourse, but have been found to consistently display a progressive left-leaning bias. At the same time, so-called persona or identity prompts have been shown to produce LLM behavior that aligns with socioeconomic groups that the base model is not aligned with. In this work, we analyze whether zero-shot persona prompting with limited information can accurately predict individual voting decisions and, by aggregation, accurately predict positions of European groups on a diverse set of policies. We evaluate if predictions are stable towards counterfactual arguments, different persona prompts and generation methods. Finally, we find that we can simulate voting behavior of Members of the European Parliament reasonably well with a weighted F1 score of approximately 0.793. Our persona dataset of politicians in the 2024 European Parliament and our code are available at https://github.com/dess-mannheim/european_parliament_simulation.
△ Less
Submitted 13 June, 2025;
originally announced June 2025.
-
Towards personalised assessment of abdominal aortic aneurysm structural integrity
Authors:
Mostafa Jamshidian,
Adam Wittek,
Hozan Mufty,
Geert Maleux,
Inge Fourneau,
Elke R. Gizewski,
Eva Gassner,
Alexander Loizides,
Maximilian Lutz,
Florian K. Enzmann,
Donatien Le Liepvre,
Florian Bernard,
Ludovic Minvielle,
Antoine Fondanèche,
Karol Miller
Abstract:
Abdominal aortic aneurysm (AAA) is a life-threatening condition involving the permanent dilation of the aorta, often detected incidentally through imaging for some other condition. The standard clinical approach to managing AAA follows a one-size-fits-all model based on aneurysm size and growth rate, leading to underestimation or overestimation of rupture risk in individual patients. The widely st…
▽ More
Abdominal aortic aneurysm (AAA) is a life-threatening condition involving the permanent dilation of the aorta, often detected incidentally through imaging for some other condition. The standard clinical approach to managing AAA follows a one-size-fits-all model based on aneurysm size and growth rate, leading to underestimation or overestimation of rupture risk in individual patients. The widely studied stress-based rupture risk estimation using computational biomechanics requires wall strength information. However, non-invasive methods for local patient-specific wall strength measurement have not yet been developed. Recently, we introduced an image-based approach for patient-specific, in vivo, non-invasive AAA kinematic analysis using time-resolved 3D computed tomography angiography (4D-CTA) images to measure wall strain throughout the cardiac cycle. In the present study, we integrated wall tension computation and strain measurement to develop a novel measure of local structural integrity of AAA wall - Relative Structural Integrity Index (RSII), independent of material properties and thickness of the wall and conditions of blood pressure measurement. Our methods provide a visual map of AAA wall structural integrity for individual patients using only their medical images and blood pressure data. We applied our methods to twelve patients. Additionally, we compared our measure of structural integrity of aneurysmal and non-aneurysmal aortas. Our results show similar values of the wall structural integrity measure across the patients, indicating the reliability of our methods. In line with experimental observations reported in the literature, our analysis revealed that localized low stiffness areas are primarily found in the most dilated AAA regions. Our results clearly demonstrate that the AAA wall is stiffer than the non-aneurysmal aorta.
△ Less
Submitted 4 March, 2025; v1 submitted 13 February, 2025;
originally announced February 2025.
-
Local Contrastive Editing of Gender Stereotypes
Authors:
Marlene Lutz,
Rochelle Choenni,
Markus Strohmaier,
Anne Lauscher
Abstract:
Stereotypical bias encoded in language models (LMs) poses a threat to safe language technology, yet our understanding of how bias manifests in the parameters of LMs remains incomplete. We introduce local contrastive editing that enables the localization and editing of a subset of weights in a target model in relation to a reference model. We deploy this approach to identify and modify subsets of w…
▽ More
Stereotypical bias encoded in language models (LMs) poses a threat to safe language technology, yet our understanding of how bias manifests in the parameters of LMs remains incomplete. We introduce local contrastive editing that enables the localization and editing of a subset of weights in a target model in relation to a reference model. We deploy this approach to identify and modify subsets of weights that are associated with gender stereotypes in LMs. Through a series of experiments, we demonstrate that local contrastive editing can precisely localize and control a small subset (< 0.5%) of weights that encode gender bias. Our work (i) advances our understanding of how stereotypical biases can manifest in the parameter space of LMs and (ii) opens up new avenues for developing parameter-efficient strategies for controlling model properties in a contrastive manner.
△ Less
Submitted 23 October, 2024;
originally announced October 2024.
-
WILBUR: Adaptive In-Context Learning for Robust and Accurate Web Agents
Authors:
Michael Lutz,
Arth Bohra,
Manvel Saroyan,
Artem Harutyunyan,
Giovanni Campagna
Abstract:
In the realm of web agent research, achieving both generalization and accuracy remains a challenging problem. Due to high variance in website structure, existing approaches often fail. Moreover, existing fine-tuning and in-context learning techniques fail to generalize across multiple websites. We introduce Wilbur, an approach that uses a differentiable ranking model and a novel instruction synthe…
▽ More
In the realm of web agent research, achieving both generalization and accuracy remains a challenging problem. Due to high variance in website structure, existing approaches often fail. Moreover, existing fine-tuning and in-context learning techniques fail to generalize across multiple websites. We introduce Wilbur, an approach that uses a differentiable ranking model and a novel instruction synthesis technique to optimally populate a black-box large language model's prompt with task demonstrations from previous runs. To maximize end-to-end success rates, we also propose an intelligent backtracking mechanism that learns and recovers from its mistakes. Finally, we show that our ranking model can be trained on data from a generative auto-curriculum which samples representative goals from an LLM, runs the agent, and automatically evaluates it, with no manual annotation. Wilbur achieves state-of-the-art results on the WebVoyager benchmark, beating text-only models by 8% overall, and up to 36% on certain websites. On the same benchmark, Wilbur is within 5% of a strong multi-modal model despite only receiving textual inputs, and further analysis reveals a substantial number of failures are due to engineering challenges of operating the web.
△ Less
Submitted 8 April, 2024;
originally announced April 2024.
-
Towards Full Automation of Geometry Extraction for Biomechanical Analysis of Abdominal Aortic Aneurysm; Neural Network-Based versus Classical Methodologies
Authors:
Farah Alkhatib,
Mostafa Jamshidian,
Donatien Le Liepvre,
Florian Bernard,
Ludovic Minvielle,
Antoine Fondanèche,
Elke R. Gizewski,
Eva Gassner,
Alexander Loizides,
Maximilian Lutz,
Florian Enzmann,
Hozan Mufty,
Inge Fourneau,
Adam Wittek,
Karol Miller
Abstract:
Background: For the clinical adoption of stress-based rupture risk estimation in abdominal aortic aneurysms (AAAs), a fully automated pipeline, from clinical imaging to biomechanical stress computation, is essential. To this end, we investigated the impact of AI-based image segmentation methods on stress computation results in the walls of AAAs. We compared wall stress distributions and magnitudes…
▽ More
Background: For the clinical adoption of stress-based rupture risk estimation in abdominal aortic aneurysms (AAAs), a fully automated pipeline, from clinical imaging to biomechanical stress computation, is essential. To this end, we investigated the impact of AI-based image segmentation methods on stress computation results in the walls of AAAs. We compared wall stress distributions and magnitudes calculated from geometry models obtained from classical semi-automated segmentation versus automated neural network-based segmentation. Method: 16 different AAA contrast-enhanced computed tomography (CT) images were semi-automatically segmented by an analyst, taking between 15 and 40 minutes of human effort per patient, depending on image quality. The same images were automatically segmented using PRAEVAorta2 commercial software by NUREA (https://www.nurea-soft.com/), developed based on artificial intelligence (AI) algorithms, and automatically post-processed with an in-house MATLAB code, requiring only 1-2 minutes of computer time per patient. Aneurysm wall stress calculations were automatically performed using the BioPARR software (https://bioparr.mech.uwa.edu.au/). Results: Compared to the classical semi-automated segmentation, the automatic neural network-based segmentation leads to equivalent stress distributions, and slightly higher peak and 99th percentile maximum principal stress values. However, our statistical analysis indicated that the differences in AAA wall stress obtained using the two segmentation methods are not statistically significant and fall well within the typical range of inter-analyst and intra-analyst variability. Conclusions: Our findings are a steppingstone toward a fully automated pipeline for biomechanical analysis of AAAs, starting with CT scans and concluding with wall stress assessment.
△ Less
Submitted 3 February, 2025; v1 submitted 11 March, 2024;
originally announced March 2024.
-
ACCESS: Prompt Engineering for Automated Web Accessibility Violation Corrections
Authors:
Calista Huang,
Alyssa Ma,
Suchir Vyasamudri,
Eugenie Puype,
Sayem Kamal,
Juan Belza Garcia,
Salar Cheema,
Michael Lutz
Abstract:
With the increasing need for inclusive and user-friendly technology, web accessibility is crucial to ensuring equal access to online content for individuals with disabilities, including visual, auditory, cognitive, or motor impairments. Despite the existence of accessibility guidelines and standards such as Web Content Accessibility Guidelines (WCAG) and the Web Accessibility Initiative (W3C), ove…
▽ More
With the increasing need for inclusive and user-friendly technology, web accessibility is crucial to ensuring equal access to online content for individuals with disabilities, including visual, auditory, cognitive, or motor impairments. Despite the existence of accessibility guidelines and standards such as Web Content Accessibility Guidelines (WCAG) and the Web Accessibility Initiative (W3C), over 90% of websites still fail to meet the necessary accessibility requirements. For web users with disabilities, there exists a need for a tool to automatically fix web page accessibility errors. While research has demonstrated methods to find and target accessibility errors, no research has focused on effectively correcting such violations. This paper presents a novel approach to correcting accessibility violations on the web by modifying the document object model (DOM) in real time with foundation models. Leveraging accessibility error information, large language models (LLMs), and prompt engineering techniques, we achieved greater than a 51% reduction in accessibility violation errors after corrections on our novel benchmark: ACCESS. Our work demonstrates a valuable approach toward the direction of inclusive web content, and provides directions for future research to explore advanced methods to automate web accessibility.
△ Less
Submitted 10 February, 2024; v1 submitted 28 January, 2024;
originally announced January 2024.
-
KPI Extraction from Maintenance Work Orders -- A Comparison of Expert Labeling, Text Classification and AI-Assisted Tagging for Computing Failure Rates of Wind Turbines
Authors:
Marc-Alexander Lutz,
Bastian Schäfermeier,
Rachael Sexton,
Michael Sharp,
Alden Dima,
Stefan Faulstich,
Jagan Mohini Aluri
Abstract:
Maintenance work orders are commonly used to document information about wind turbine operation and maintenance. This includes details about proactive and reactive wind turbine downtimes, such as preventative and corrective maintenance. However, the information contained in maintenance work orders is often unstructured and difficult to analyze, presenting challenges for decision-makers wishing to u…
▽ More
Maintenance work orders are commonly used to document information about wind turbine operation and maintenance. This includes details about proactive and reactive wind turbine downtimes, such as preventative and corrective maintenance. However, the information contained in maintenance work orders is often unstructured and difficult to analyze, presenting challenges for decision-makers wishing to use it for optimizing operation and maintenance. To address this issue, this work compares three different approaches to calculate reliability by performance indicators from maintenance work orders. The first approach involves manual labeling of the maintenance work orders by domain experts, using the schema defined in an industrial guideline to assign the label accordingly. The second approach involves the development of a model that automatically labels the maintenance work orders using text classification methods. Through this method, we are able to achieve macro average and weighted average F1-Scores of 0.75 and 0.85 respectively. The third technique uses an AI-assisted tagging tool to tag and structure the raw maintenance information, together with a novel rule-based approach for extracting relevant maintenance work orders for failure rate calculation. In our experiments the AI-assisted tool leads to a 88% drop in tagging time in comparison to the other two approaches, while expert labeling and text classification are more accurate in KPI extraction. Overall, our findings make extracting maintenance information from maintenance work orders more efficient, enable the assessment of reliability key performance indicators and therefore support the optimization of wind turbine operation and maintenance.
△ Less
Submitted 6 December, 2023; v1 submitted 7 November, 2023;
originally announced November 2023.
-
SensePOLAR: Word sense aware interpretability for pre-trained contextual word embeddings
Authors:
Jan Engler,
Sandipan Sikdar,
Marlene Lutz,
Markus Strohmaier
Abstract:
Adding interpretability to word embeddings represents an area of active research in text representation. Recent work has explored thepotential of embedding words via so-called polar dimensions (e.g. good vs. bad, correct vs. wrong). Examples of such recent approaches include SemAxis, POLAR, FrameAxis, and BiImp. Although these approaches provide interpretable dimensions for words, they have not be…
▽ More
Adding interpretability to word embeddings represents an area of active research in text representation. Recent work has explored thepotential of embedding words via so-called polar dimensions (e.g. good vs. bad, correct vs. wrong). Examples of such recent approaches include SemAxis, POLAR, FrameAxis, and BiImp. Although these approaches provide interpretable dimensions for words, they have not been designed to deal with polysemy, i.e. they can not easily distinguish between different senses of words. To address this limitation, we present SensePOLAR, an extension of the original POLAR framework that enables word-sense aware interpretability for pre-trained contextual word embeddings. The resulting interpretable word embeddings achieve a level of performance that is comparable to original contextual word embeddings across a variety of natural language processing tasks including the GLUE and SQuAD benchmarks. Our work removes a fundamental limitation of existing approaches by offering users sense aware interpretations for contextual word embeddings.
△ Less
Submitted 11 January, 2023;
originally announced January 2023.
-
Properties of Group Fairness Metrics for Rankings
Authors:
Tobias Schumacher,
Marlene Lutz,
Sandipan Sikdar,
Markus Strohmaier
Abstract:
In recent years, several metrics have been developed for evaluating group fairness of rankings. Given that these metrics were developed with different application contexts and ranking algorithms in mind, it is not straightforward which metric to choose for a given scenario. In this paper, we perform a comprehensive comparative analysis of existing group fairness metrics developed in the context of…
▽ More
In recent years, several metrics have been developed for evaluating group fairness of rankings. Given that these metrics were developed with different application contexts and ranking algorithms in mind, it is not straightforward which metric to choose for a given scenario. In this paper, we perform a comprehensive comparative analysis of existing group fairness metrics developed in the context of fair ranking. By virtue of their diverse application contexts, we argue that such a comparative analysis is not straightforward. Hence, we take an axiomatic approach whereby we design a set of thirteen properties for group fairness metrics that consider different ranking settings. A metric can then be selected depending on whether it satisfies all or a subset of these properties. We apply these properties on eleven existing group fairness metrics, and through both empirical and theoretical results we demonstrate that most of these metrics only satisfy a small subset of the proposed properties. These findings highlight limitations of existing metrics, and provide insights into how to evaluate and interpret different fairness metrics in practical deployment. The proposed properties can also assist practitioners in selecting appropriate metrics for evaluating fairness in a specific application.
△ Less
Submitted 29 December, 2022;
originally announced December 2022.
-
INSPIRE: The Entry Point to Europe's Big Geospatial Data Infrastructure
Authors:
Marco Minghini,
Vlado Cetl,
Alexander Kotsev,
Robert Tomas,
Michael Lutz
Abstract:
Initiated in 2007, the INSPIRE Directive has set a legal framework to create a European-wide Spatial Data Infrastructure (SDI) to support the European Union (EU) environmental policies. This chapter analyses the INSPIRE infrastructure from a Big Geospatial Data perspective, describing how data is shared in an interoperable way by public sector organisations in the EU Member States and how it is ma…
▽ More
Initiated in 2007, the INSPIRE Directive has set a legal framework to create a European-wide Spatial Data Infrastructure (SDI) to support the European Union (EU) environmental policies. This chapter analyses the INSPIRE infrastructure from a Big Geospatial Data perspective, describing how data is shared in an interoperable way by public sector organisations in the EU Member States and how it is made available in and accessible within the infrastructure. The INSPIRE Geoportal, which is the entry point to the whole infrastructure, is presented in detail. To justify its nature of a Big Geospatial Data infrastructure, the characteristics of INSPIRE data are mapped to those of Big Data's six 'Vs'. Despite many good results achieved in terms of data sharing, some challenges still remain related to data consumption from the user side. The chapter concludes with a dedicated discussion on how INSPIRE, and traditional SDIs in general, should evolve into modern data ecosystems to address these challenges while also embracing the modern practices of data sharing through the web.
△ Less
Submitted 3 June, 2021; v1 submitted 25 May, 2021;
originally announced May 2021.
-
Efficient Formulation of Collision Avoidance Constraints in Optimization Based Trajectory Planning and Control
Authors:
Max Lutz,
Thomas Meurer
Abstract:
To be applicable to real world scenarios trajectory planning schemes for mobile autonomous systems must be able to efficiently deal with obstacles in the area of operation. In the context of optimization based trajectory planning and control a number of different approaches to formulate collision avoidance constraints can be found in the literature. Here the contribution of the present work is two…
▽ More
To be applicable to real world scenarios trajectory planning schemes for mobile autonomous systems must be able to efficiently deal with obstacles in the area of operation. In the context of optimization based trajectory planning and control a number of different approaches to formulate collision avoidance constraints can be found in the literature. Here the contribution of the present work is twofold. First, the most popular methods to represent obstacles are summarized, namely the simple ellipsoidal representation, the constructive solid geometry (CSG) method as well as a direct and an indirect implementation of a signed distance based approach. The formulations are characterized with respect to the impact on the complexity of the optimization problem, as well as the ability to meet different problem requirements. Second, this work presents a novel variant of the CSG method to describe collision avoidance constraints. It is highly efficient due to a very low number of nonlinear inequality constraints required for a given number of obstacles and sample points and in contrast to the original CSG formulation allows to consider the controlled system's shape. The good performance of the proposed formulation is demonstrated by a comparison to the previously mentioned alternatives. To this end optimal trajectory planning for marine surface vessels formulated as a nonlinear programming problem is used as a benchmark example where the scenario is designed based on the maritime test field in Kiel, Germany.
△ Less
Submitted 26 April, 2021;
originally announced April 2021.
-
ImagePairs: Realistic Super Resolution Dataset via Beam Splitter Camera Rig
Authors:
Hamid Reza Vaezi Joze,
Ilya Zharkov,
Karlton Powell,
Carl Ringler,
Luming Liang,
Andy Roulston,
Moshe Lutz,
Vivek Pradeep
Abstract:
Super Resolution is the problem of recovering a high-resolution image from a single or multiple low-resolution images of the same scene. It is an ill-posed problem since high frequency visual details of the scene are completely lost in low-resolution images. To overcome this, many machine learning approaches have been proposed aiming at training a model to recover the lost details in the new scene…
▽ More
Super Resolution is the problem of recovering a high-resolution image from a single or multiple low-resolution images of the same scene. It is an ill-posed problem since high frequency visual details of the scene are completely lost in low-resolution images. To overcome this, many machine learning approaches have been proposed aiming at training a model to recover the lost details in the new scenes. Such approaches include the recent successful effort in utilizing deep learning techniques to solve super resolution problem. As proven, data itself plays a significant role in the machine learning process especially deep learning approaches which are data hungry. Therefore, to solve the problem, the process of gathering data and its formation could be equally as vital as the machine learning technique used. Herein, we are proposing a new data acquisition technique for gathering real image data set which could be used as an input for super resolution, noise cancellation and quality enhancement techniques. We use a beam-splitter to capture the same scene by a low resolution camera and a high resolution camera. Since we also release the raw images, this large-scale dataset could be used for other tasks such as ISP generation. Unlike current small-scale dataset used for these tasks, our proposed dataset includes 11,421 pairs of low-resolution high-resolution images of diverse scenes. To our knowledge this is the most complete dataset for super resolution, ISP and image quality enhancement. The benchmarking result shows how the new dataset can be successfully used to significantly improve the quality of real-world image super resolution.
△ Less
Submitted 17 April, 2020;
originally announced April 2020.
-
Bioresorbable Scaffold Visualization in IVOCT Images Using CNNs and Weakly Supervised Localization
Authors:
Nils Gessert,
Sarah Latus,
Youssef S. Abdelwahed,
David M. Leistner,
Matthias Lutz,
Alexander Schlaefer
Abstract:
Bioresorbable scaffolds have become a popular choice for treatment of coronary heart disease, replacing traditional metal stents. Often, intravascular optical coherence tomography is used to assess potential malapposition after implantation and for follow-up examinations later on. Typically, the scaffold is manually reviewed by an expert, analyzing each of the hundreds of image slices. As this is…
▽ More
Bioresorbable scaffolds have become a popular choice for treatment of coronary heart disease, replacing traditional metal stents. Often, intravascular optical coherence tomography is used to assess potential malapposition after implantation and for follow-up examinations later on. Typically, the scaffold is manually reviewed by an expert, analyzing each of the hundreds of image slices. As this is time consuming, automatic stent detection and visualization approaches have been proposed, mostly for metal stent detection based on classic image processing. As bioresorbable scaffolds are harder to detect, recent approaches have used feature extraction and machine learning methods for automatic detection. However, these methods require detailed, pixel-level labels in each image slice and extensive feature engineering for the particular stent type which might limit the approaches' generalization capabilities. Therefore, we propose a deep learning-based method for bioresorbable scaffold visualization using only image-level labels. A convolutional neural network is trained to predict whether an image slice contains a metal stent, a bioresorbable scaffold, or no device. Then, we derive local stent strut information by employing weakly supervised localization using saliency maps with guided backpropagation. As saliency maps are generally diffuse and noisy, we propose a novel patch-based method with image shifting which allows for high resolution stent visualization. Our convolutional neural network model achieves a classification accuracy of 99.0 % for image-level stent classification which can be used for both high quality in-slice stent visualization and 3D rendering of the stent structure.
△ Less
Submitted 22 October, 2018;
originally announced October 2018.
-
Automatic Plaque Detection in IVOCT Pullbacks Using Convolutional Neural Networks
Authors:
Nils Gessert,
Matthias Lutz,
Markus Heyder,
Sarah Latus,
David M. Leistner,
Youssef S. Abdelwahed,
Alexander Schlaefer
Abstract:
Coronary heart disease is a common cause of death despite being preventable. To treat the underlying plaque deposits in the arterial walls, intravascular optical coherence tomography can be used by experts to detect and characterize the lesions. In clinical routine, hundreds of images are acquired for each patient which requires automatic plaque detection for fast and accurate decision support. So…
▽ More
Coronary heart disease is a common cause of death despite being preventable. To treat the underlying plaque deposits in the arterial walls, intravascular optical coherence tomography can be used by experts to detect and characterize the lesions. In clinical routine, hundreds of images are acquired for each patient which requires automatic plaque detection for fast and accurate decision support. So far, automatic approaches rely on classic machine learning methods and deep learning solutions have rarely been studied. Given the success of deep learning methods with other imaging modalities, a thorough understanding of deep learning-based plaque detection for future clinical decision support systems is required. We address this issue with a new dataset consisting of in-vivo patient images labeled by three trained experts. Using this dataset, we employ state-of-the-art deep learning models that directly learn plaque classification from the images. For improved performance, we study different transfer learning approaches. Furthermore, we investigate the use of cartesian and polar image representations and employ data augmentation techniques tailored to each representation. We fuse both representations in a multi-path architecture for more effective feature exploitation. Last, we address the challenge of plaque differentiation in addition to detection. Overall, we find that our combined model performs best with an accuracy of 91.7%, a sensitivity of 90.9% and a specificity of 92.4%. Our results indicate that building a deep learning-based clinical decision support system for plaque detection is feasible.
△ Less
Submitted 24 August, 2018; v1 submitted 13 August, 2018;
originally announced August 2018.
-
Adversarial Training for Patient-Independent Feature Learning with IVOCT Data for Plaque Classification
Authors:
Nils Gessert,
Markus Heyder,
Sarah Latus,
David M. Leistner,
Youssef S. Abdelwahed,
Matthias Lutz,
Alexander Schlaefer
Abstract:
Deep learning methods have shown impressive results for a variety of medical problems over the last few years. However, datasets tend to be small due to time-consuming annotation. As datasets with different patients are often very heterogeneous generalization to new patients can be difficult. This is complicated further if large differences in image acquisition can occur, which is common during in…
▽ More
Deep learning methods have shown impressive results for a variety of medical problems over the last few years. However, datasets tend to be small due to time-consuming annotation. As datasets with different patients are often very heterogeneous generalization to new patients can be difficult. This is complicated further if large differences in image acquisition can occur, which is common during intravascular optical coherence tomography for coronary plaque imaging. We address this problem with an adversarial training strategy where we force a part of a deep neural network to learn features that are independent of patient- or acquisitionspecific characteristics. We compare our regularization method to typical data augmentation strategies and show that our approach improves performance for a small medical dataset.
△ Less
Submitted 16 May, 2018;
originally announced May 2018.
-
Plaque Classification in Coronary Arteries from IVOCT Images Using Convolutional Neural Networks and Transfer Learning
Authors:
Nils Gessert,
Markus Heyder,
Sarah Latus,
Matthias Lutz,
Alexander Schlaefer
Abstract:
Advanced atherosclerosis in the coronary arteries is one of the leading causes of deaths worldwide while being preventable and treatable. In order to image atherosclerotic lesions (plaque), intravascular optical coherence tomography (IVOCT) can be used. The technique provides high-resolution images of arterial walls which allows for early plaque detection by experts. Due to the vast amount of IVOC…
▽ More
Advanced atherosclerosis in the coronary arteries is one of the leading causes of deaths worldwide while being preventable and treatable. In order to image atherosclerotic lesions (plaque), intravascular optical coherence tomography (IVOCT) can be used. The technique provides high-resolution images of arterial walls which allows for early plaque detection by experts. Due to the vast amount of IVOCT images acquired in clinical routines, automatic plaque detection has been addressed. For example, attenuation profiles in single A-Scans of IVOCT images are examined to detect plaque. We address automatic plaque classification from entire IVOCT images, the cross-sectional view of the artery, using deep feature learning. In this way, we take context between A-Scans into account and we directly learn relevant features from the image source without the need for handcrafting features.
△ Less
Submitted 11 April, 2018;
originally announced April 2018.
-
Modeling Non-Functional Application Domain Constraints for Component-Based Robotics Software Systems
Authors:
Alex Lotz,
Arne Hamann,
Ingo Lütkebohle,
Dennis Stampfer,
Matthias Lutz,
Christian Schlegel
Abstract:
Service robots are complex, heterogeneous, software intensive systems built from components. Recent robotics research trends mainly address isolated capabilities on functional level. Non-functional properties, such as responsiveness or deterministic behavior, are addressed only in isolation (if at all). We argue that handling such non-functional properties on system level is a crucial next step. W…
▽ More
Service robots are complex, heterogeneous, software intensive systems built from components. Recent robotics research trends mainly address isolated capabilities on functional level. Non-functional properties, such as responsiveness or deterministic behavior, are addressed only in isolation (if at all). We argue that handling such non-functional properties on system level is a crucial next step. We claim that precise control over application-specific, dynamic execution and interaction behavior of functional components -- i.e. clear computation and communication semantics on model level without hidden code-defined parts -- is a key ingredient thereto.
In this paper, we propose modeling concepts for these semantics, and present a meta-model which (i) enables component developers to implement component functionalities without presuming application-specific, system-level attributes, and (ii) enables system integrators to reason about causal dependencies between components as well as system-level data-flow characteristics. This allows to control data-propagation semantics and system properties such as end-to-end latencies during system integration without breaking component encapsulation.
△ Less
Submitted 11 January, 2016;
originally announced January 2016.