-
Deep learning-based segmentation of T1 and T2 cardiac MRI maps for automated disease detection
Authors:
Andreea Bianca Popescu,
Andreas Seitz,
Heiko Mahrholdt,
Jens Wetzl,
Athira Jacob,
Lucian Mihai Itu,
Constantin Suciu,
Teodora Chitiboi
Abstract:
Objectives Parametric tissue mapping enables quantitative cardiac tissue characterization but is limited by inter-observer variability during manual delineation. Traditional approaches relying on average relaxation values and single cutoffs may oversimplify myocardial complexity. This study evaluates whether deep learning (DL) can achieve segmentation accuracy comparable to inter-observer variabil…
▽ More
Objectives Parametric tissue mapping enables quantitative cardiac tissue characterization but is limited by inter-observer variability during manual delineation. Traditional approaches relying on average relaxation values and single cutoffs may oversimplify myocardial complexity. This study evaluates whether deep learning (DL) can achieve segmentation accuracy comparable to inter-observer variability, explores the utility of statistical features beyond mean T1/T2 values, and assesses whether machine learning (ML) combining multiple features enhances disease detection. Materials & Methods T1 and T2 maps were manually segmented. The test subset was independently annotated by two observers, and inter-observer variability was assessed. A DL model was trained to segment left ventricle blood pool and myocardium. Average (A), lower quartile (LQ), median (M), and upper quartile (UQ) were computed for the myocardial pixels and employed in classification by applying cutoffs or in ML. Dice similarity coefficient (DICE) and mean absolute percentage error evaluated segmentation performance. Bland-Altman plots assessed inter-user and model-observer agreement. Receiver operating characteristic analysis determined optimal cutoffs. Pearson correlation compared features from model and manual segmentations. F1-score, precision, and recall evaluated classification performance. Wilcoxon test assessed differences between classification methods, with p < 0.05 considered statistically significant. Results 144 subjects were split into training (100), validation (15) and evaluation (29) subsets. Segmentation model achieved a DICE of 85.4%, surpassing inter-observer agreement. Random forest applied to all features increased F1-score (92.7%, p < 0.001). Conclusion DL facilitates segmentation of T1/ T2 maps. Combining multiple features with ML improves disease detection.
△ Less
Submitted 1 July, 2025;
originally announced July 2025.
-
Disassembly as Weighted Interval Scheduling with Learned Weights
Authors:
Antonio Flores-Montoya,
Junghee Lim,
Adam Seitz,
Akshay Sood,
Edward Raff,
James Holt
Abstract:
Disassembly is the first step of a variety of binary analysis and transformation techniques, such as reverse engineering, or binary rewriting. Recent disassembly approaches consist of three phases: an exploration phase, that overapproximates the binary's code; an analysis phase, that assigns weights to candidate instructions or basic blocks; and a conflict resolution phase, that downselects the fi…
▽ More
Disassembly is the first step of a variety of binary analysis and transformation techniques, such as reverse engineering, or binary rewriting. Recent disassembly approaches consist of three phases: an exploration phase, that overapproximates the binary's code; an analysis phase, that assigns weights to candidate instructions or basic blocks; and a conflict resolution phase, that downselects the final set of instructions. We present a disassembly algorithm that generalizes this pattern for a wide range of architectures, namely x86, x64, arm32, and aarch64. Our algorithm presents a novel conflict resolution method that reduces disassembly to weighted interval scheduling.
△ Less
Submitted 2 May, 2025;
originally announced May 2025.
-
Don't Look at the Camera: Achieving Perceived Eye Contact
Authors:
Alice Gao,
Samyukta Jayakumar,
Marcello Maniglia,
Brian Curless,
Ira Kemelmacher-Shlizerman,
Aaron R. Seitz,
Steven M. Seitz
Abstract:
We consider the question of how to best achieve the perception of eye contact when a person is captured by camera and then rendered on a 2D display. For single subjects photographed by a camera, conventional wisdom tells us that looking directly into the camera achieves eye contact. Through empirical user studies, we show that it is instead preferable to {\em look just below the camera lens}. We q…
▽ More
We consider the question of how to best achieve the perception of eye contact when a person is captured by camera and then rendered on a 2D display. For single subjects photographed by a camera, conventional wisdom tells us that looking directly into the camera achieves eye contact. Through empirical user studies, we show that it is instead preferable to {\em look just below the camera lens}. We quantitatively assess where subjects should direct their gaze relative to a camera lens to optimize the perception that they are making eye contact.
△ Less
Submitted 25 April, 2024;
originally announced April 2024.
-
Distributional Latent Variable Models with an Application in Active Cognitive Testing
Authors:
Robert Kasumba,
Dom CP Marticorena,
Anja Pahor,
Geetha Ramani,
Imani Goffney,
Susanne M Jaeggi,
Aaron Seitz,
Jacob R Gardner,
Dennis L Barbour
Abstract:
Cognitive modeling commonly relies on asking participants to complete a battery of varied tests in order to estimate attention, working memory, and other latent variables. In many cases, these tests result in highly variable observation models. A near-ubiquitous approach is to repeat many observations for each test independently, resulting in a distribution over the outcomes from each test given t…
▽ More
Cognitive modeling commonly relies on asking participants to complete a battery of varied tests in order to estimate attention, working memory, and other latent variables. In many cases, these tests result in highly variable observation models. A near-ubiquitous approach is to repeat many observations for each test independently, resulting in a distribution over the outcomes from each test given to each subject. Latent variable models (LVMs), if employed, are only added after data collection. In this paper, we explore the usage of LVMs to enable learning across many correlated variables simultaneously. We extend LVMs to the setting where observed data for each subject are a series of observations from many different distributions, rather than simple vectors to be reconstructed. By embedding test battery results for individuals in a latent space that is trained jointly across a population, we can leverage correlations both between disparate test data for a single participant and between multiple participants. We then propose an active learning framework that leverages this model to conduct more efficient cognitive test batteries. We validate our approach by demonstrating with real-time data acquisition that it performs comparably to conventional methods in making item-level predictions with fewer test items.
△ Less
Submitted 25 September, 2024; v1 submitted 14 December, 2023;
originally announced December 2023.
-
A Mortar Finite Element Formulation for Large Deformation Lubricated Contact Problems with Smooth Transition Between Mixed, Elasto-Hydrodynamic and Full Hydrodynamic Lubrication
Authors:
Mostafa Faraji,
Alexander Seitz,
Christoph Meier,
Wolfgang A. Wall
Abstract:
This work proposes a novel model and numerical formulation for lubricated contact problems describing the mutual interaction between two deformable 3D solid bodies and an interposed fluid film. The solid bodies are consistently described based on nonlinear continuum mechanics allowing for finite deformations and arbitrary constitutive laws. The fluid film is modelled as a quasi-2D flow problem on…
▽ More
This work proposes a novel model and numerical formulation for lubricated contact problems describing the mutual interaction between two deformable 3D solid bodies and an interposed fluid film. The solid bodies are consistently described based on nonlinear continuum mechanics allowing for finite deformations and arbitrary constitutive laws. The fluid film is modelled as a quasi-2D flow problem on the interface between the solids governed by the averaged Reynolds equation. The averaged Reynolds equation accounts for surface roughness utilizing spatially homogenized, effective fluid parameters and for cavitation through a positivity constraint imposed on the pressure field. In contrast to existing approaches, the proposed model accounts for the co-existence of frictional contact tractions and hydrodynamic fluid tractions at every local point on the contact surface of the interacting bodies and covers the entire range from boundary lubrication to mixed, elastohydrodynamic, and eventually to full film hydrodynamic lubrication in one unified modelling framework with smooth transition between these different regimes. Critically, the model relies on a recently proposed regularization scheme for the mechanical contact constraint combining the advantages of classical penalty and Lagrange multiplier approaches by expressing the mechanical contact pressure as a function of the effective gap between the solid bodies while at the same time limiting the minimal gap value occurring at the (theoretical) limit of infinitely high contact pressures. From a physical point of view, this approach can be considered as a model for the elastic deformation of surface asperities, with a bounded magnitude depending on the interacting solids' surface roughness. A consistent and accurate model behavior is demonstrated and validated by employing several challenging and practically relevant benchmark test cases.
△ Less
Submitted 4 January, 2022;
originally announced January 2022.
-
Supporting Unified Shader Specialization by Co-opting C++ Features
Authors:
Kerry A. Seitz Jr.,
Theresa Foley,
Serban D. Porumbescu,
John D. Owens
Abstract:
Modern unified programming models (such as CUDA and SYCL) that combine host (CPU) code and GPU code into the same programming language, same file, and same lexical scope lack adequate support for GPU code specialization, which is a key optimization in real-time graphics. Furthermore, current methods used to implement specialization do not translate to a unified environment. In this paper, we creat…
▽ More
Modern unified programming models (such as CUDA and SYCL) that combine host (CPU) code and GPU code into the same programming language, same file, and same lexical scope lack adequate support for GPU code specialization, which is a key optimization in real-time graphics. Furthermore, current methods used to implement specialization do not translate to a unified environment. In this paper, we create a unified shader programming environment in C++ that provides first-class support for specialization by co-opting C++'s attribute and virtual function features and reimplementing them with alternate semantics to express the services required. By co-opting existing features, we enable programmers to use familiar C++ programming techniques to write host and GPU code together, while still achieving efficient generated C++ and HLSL code via our source-to-source translator.
△ Less
Submitted 16 July, 2022; v1 submitted 29 September, 2021;
originally announced September 2021.
-
Frontiers in Mortar Methods for Isogeometric Analysis
Authors:
Christian Hesch,
Ustim Khristenko,
Rolf Krause,
Alexander Popp,
Alexander Seitz,
Wolfgang Wall,
Barbara Wohlmuth
Abstract:
Complex geometries as common in industrial applications consist of multiple patches, if spline based parametrizations are used. The requirements for the generation of analysis-suitable models are increasing dramatically since isogeometric analysis is directly based on the spline parametrization and nowadays used for the calculation of higher-order partial differential equations. The computational,…
▽ More
Complex geometries as common in industrial applications consist of multiple patches, if spline based parametrizations are used. The requirements for the generation of analysis-suitable models are increasing dramatically since isogeometric analysis is directly based on the spline parametrization and nowadays used for the calculation of higher-order partial differential equations. The computational, or more general, the engineering analysis necessitates suitable coupling techniques between the different patches. Mortar methods have been successfully applied for coupling of patches and for contact mechanics in recent years to resolve the arising issues within the interface. We present here current achievements in the design of mortar technologies in isogeometric analysis within the Priority Program SPP 1748, Reliable Simulation Techniques in Solid Mechanics. Development of Non-standard Discretisation Methods, Mechanical and Mathematical Analysis.
△ Less
Submitted 29 October, 2020; v1 submitted 11 June, 2020;
originally announced June 2020.
-
W2S: Microscopy Data with Joint Denoising and Super-Resolution for Widefield to SIM Mapping
Authors:
Ruofan Zhou,
Majed El Helou,
Daniel Sage,
Thierry Laroche,
Arne Seitz,
Sabine Süsstrunk
Abstract:
In fluorescence microscopy live-cell imaging, there is a critical trade-off between the signal-to-noise ratio and spatial resolution on one side, and the integrity of the biological sample on the other side. To obtain clean high-resolution (HR) images, one can either use microscopy techniques, such as structured-illumination microscopy (SIM), or apply denoising and super-resolution (SR) algorithms…
▽ More
In fluorescence microscopy live-cell imaging, there is a critical trade-off between the signal-to-noise ratio and spatial resolution on one side, and the integrity of the biological sample on the other side. To obtain clean high-resolution (HR) images, one can either use microscopy techniques, such as structured-illumination microscopy (SIM), or apply denoising and super-resolution (SR) algorithms. However, the former option requires multiple shots that can damage the samples, and although efficient deep learning based algorithms exist for the latter option, no benchmark exists to evaluate these algorithms on the joint denoising and SR (JDSR) tasks. To study JDSR on microscopy data, we propose such a novel JDSR dataset, Widefield2SIM (W2S), acquired using a conventional fluorescence widefield and SIM imaging. W2S includes 144,000 real fluorescence microscopy images, resulting in a total of 360 sets of images. A set is comprised of noisy low-resolution (LR) widefield images with different noise levels, a noise-free LR image, and a corresponding high-quality HR SIM image. W2S allows us to benchmark the combinations of 6 denoising methods and 6 SR methods. We show that state-of-the-art SR networks perform very poorly on noisy inputs. Our evaluation also reveals that applying the best denoiser in terms of reconstruction error followed by the best SR method does not necessarily yield the best final result. Both quantitative and qualitative results show that SR networks are sensitive to noise and the sequential application of denoising and SR algorithms is sub-optimal. Lastly, we demonstrate that SR networks retrained end-to-end for JDSR outperform any combination of state-of-the-art deep denoising and SR networks
△ Less
Submitted 24 August, 2020; v1 submitted 12 March, 2020;
originally announced March 2020.
-
A consistent and comprehensive computational approach for general Fluid-Structure-Contact Interaction problems
Authors:
Christoph Ager,
Alexander Seitz,
Wolfgang A. Wall
Abstract:
We present a consistent approach that allows to solve challenging general nonlinear fluid-structure-contact interaction (FSCI) problems. The underlying continuous formulation includes both "no-slip" fluid-structure interaction as well as frictionless contact between multiple elastic bodies. The respective interface conditions in normal and tangential orientation and especially the role of the flui…
▽ More
We present a consistent approach that allows to solve challenging general nonlinear fluid-structure-contact interaction (FSCI) problems. The underlying continuous formulation includes both "no-slip" fluid-structure interaction as well as frictionless contact between multiple elastic bodies. The respective interface conditions in normal and tangential orientation and especially the role of the fluid stress within the region of closed contact are discussed for the general problem of FSCI. To ensure continuity of the tangential constraints from no-slip to frictionless contact, a transition is enabled by using the general Navier condition with varying slip length. Moreover, the fluid stress in the contact zone is obtained by an extension approach as it plays a crucial role for the lift-off behavior of contacting bodies. With the given continuity of the spatially continuous formulation, continuity of the discrete problem (which is essential for the convergence of Newton's method) is reached naturally. As topological changes of the fluid domain are an inherent challenge in FSCI configurations, a non-interface fitted Cut Finite Element Method (CutFEM) is applied to discretize the fluid domain. All interface conditions, that is the `no-slip' FSI, the general Navier condition, and frictionless contact are incorporated using Nitsche based methods, thus retaining the continuity and consistency of the model. To account for the strong interaction between the fluid and solid discretization, the overall coupled discrete system is solved monolithically. Numerical examples of varying complexity are presented to corroborate the developments.
△ Less
Submitted 23 May, 2019;
originally announced May 2019.
-
Piko: A Design Framework for Programmable Graphics Pipelines
Authors:
Anjul Patney,
Stanley Tzeng,
Kerry A. Seitz Jr.,
John D. Owens
Abstract:
We present Piko, a framework for designing, optimizing, and retargeting implementations of graphics pipelines on multiple architectures. Piko programmers express a graphics pipeline by organizing the computation within each stage into spatial bins and specifying a scheduling preference for these bins. Our compiler, Pikoc, compiles this input into an optimized implementation targeted to a massively…
▽ More
We present Piko, a framework for designing, optimizing, and retargeting implementations of graphics pipelines on multiple architectures. Piko programmers express a graphics pipeline by organizing the computation within each stage into spatial bins and specifying a scheduling preference for these bins. Our compiler, Pikoc, compiles this input into an optimized implementation targeted to a massively-parallel GPU or a multicore CPU.
Piko manages work granularity in a programmable and flexible manner, allowing programmers to build load-balanced parallel pipeline implementations, to exploit spatial and producer-consumer locality in a pipeline implementation, and to explore tradeoffs between these considerations. We demonstrate that Piko can implement a wide range of pipelines, including rasterization, Reyes, ray tracing, rasterization/ray tracing hybrid, and deferred rendering. Piko allows us to implement efficient graphics pipelines with relative ease and to quickly explore design alternatives by modifying the spatial binning configurations and scheduling preferences for individual stages, all while delivering real-time performance that is within a factor six of state-of-the-art rendering systems.
△ Less
Submitted 29 January, 2015; v1 submitted 24 April, 2014;
originally announced April 2014.
-
A GPU Implementation for Two-Dimensional Shallow Water Modeling
Authors:
Kerry A. Seitz Jr.,
Alex Kennedy,
Owen Ransom,
Bassam A. Younis,
John D. Owens
Abstract:
In this paper, we present a GPU implementation of a two-dimensional shallow water model. Water simulations are useful for modeling floods, river/reservoir behavior, and dam break scenarios. Our GPU implementation shows vast performance improvements over the original Fortran implementation. By taking advantage of the GPU, researchers and engineers will be able to study water systems more efficientl…
▽ More
In this paper, we present a GPU implementation of a two-dimensional shallow water model. Water simulations are useful for modeling floods, river/reservoir behavior, and dam break scenarios. Our GPU implementation shows vast performance improvements over the original Fortran implementation. By taking advantage of the GPU, researchers and engineers will be able to study water systems more efficiently and in greater detail.
△ Less
Submitted 5 September, 2013;
originally announced September 2013.
