Showing 1–24 of 24 results for author: Becker, J

Real-Time Graph-based Point Cloud Networks on FPGAs via Stall-Free Deep Pipelining

Authors: Marc Neu, Isabel Haide, Timo Justinger, Till Rädler, Valdrin Dajaku, Torben Ferber, Jürgen Becker

Abstract: Graph-based Point Cloud Networks (PCNs) are powerful tools for processing sparse sensor data with irregular geometries, as found in high-energy physics detectors. However, deploying models in such environments remains challenging due to stringent real-time requirements for both latency, and throughput. In this work, we present a deeply pipelined dataflow architecture for executing graph-based PCNs… ▽ More Graph-based Point Cloud Networks (PCNs) are powerful tools for processing sparse sensor data with irregular geometries, as found in high-energy physics detectors. However, deploying models in such environments remains challenging due to stringent real-time requirements for both latency, and throughput. In this work, we present a deeply pipelined dataflow architecture for executing graph-based PCNs on FPGAs. Our method supports efficient processing of dynamic, sparse point clouds while meeting hard real-time constraints. We introduce specialized processing elements for core graph operations, such as GraVNet convolution and condensation point clustering, and demonstrate our design on the AMD Versal VCK190. Compared to a GPU baseline, our FPGA implementation achieves up to 5.25x speedup in throughput while maintaining latencies below 10 μs, satisfying the demands of real-time trigger systems in particle physics experiments. An open-source reference implementation is provided. △ Less

Submitted 7 July, 2025; originally announced July 2025.

Comments: Accepted to IEEE SBCCI 2025

CAtCh: Cognitive Assessment through Cookie Thief

Authors: Joseph T Colonel, Carolyn Hagler, Guiselle Wismer, Laura Curtis, Jacqueline Becker, Juan Wisnivesky, Alex Federman, Gaurav Pandey

Abstract: Several machine learning algorithms have been developed for the prediction of Alzheimer's disease and related dementia (ADRD) from spontaneous speech. However, none of these algorithms have been translated for the prediction of broader cognitive impairment (CI), which in some cases is a precursor and risk factor of ADRD. In this paper, we evaluated several speech-based open-source methods original… ▽ More Several machine learning algorithms have been developed for the prediction of Alzheimer's disease and related dementia (ADRD) from spontaneous speech. However, none of these algorithms have been translated for the prediction of broader cognitive impairment (CI), which in some cases is a precursor and risk factor of ADRD. In this paper, we evaluated several speech-based open-source methods originally proposed for the prediction of ADRD, as well as methods from multimodal sentiment analysis for the task of predicting CI from patient audio recordings. Results demonstrated that multimodal methods outperformed unimodal ones for CI prediction, and that acoustics-based approaches performed better than linguistics-based ones. Specifically, interpretable acoustic features relating to affect and prosody were found to significantly outperform BERT-based linguistic features and interpretable linguistic features, respectively. All the code developed for this study is available at https://github.com/JTColonel/catch. △ Less

Submitted 6 June, 2025; originally announced June 2025.

Controlling Latent Diffusion Using Latent CLIP

Authors: Jason Becker, Chris Wendler, Peter Baylies, Robert West, Christian Wressnegger

Abstract: Instead of performing text-conditioned denoising in the image domain, latent diffusion models (LDMs) operate in latent space of a variational autoencoder (VAE), enabling more efficient processing at reduced computational costs. However, while the diffusion process has moved to the latent space, the contrastive language-image pre-training (CLIP) models, as used in many image processing tasks, still… ▽ More Instead of performing text-conditioned denoising in the image domain, latent diffusion models (LDMs) operate in latent space of a variational autoencoder (VAE), enabling more efficient processing at reduced computational costs. However, while the diffusion process has moved to the latent space, the contrastive language-image pre-training (CLIP) models, as used in many image processing tasks, still operate in pixel space. Doing so requires costly VAE-decoding of latent images before they can be processed. In this paper, we introduce Latent-CLIP, a CLIP model that operates directly in the latent space. We train Latent-CLIP on 2.7B pairs of latent images and descriptive texts, and show that it matches zero-shot classification performance of similarly sized CLIP models on both the ImageNet benchmark and a LDM-generated version of it, demonstrating its effectiveness in assessing both real and generated content. Furthermore, we construct Latent-CLIP rewards for reward-based noise optimization (ReNO) and show that they match the performance of their CLIP counterparts on GenEval and T2I-CompBench while cutting the cost of the total pipeline by 21%. Finally, we use Latent-CLIP to guide generation away from harmful content, achieving strong performance on the inappropriate image prompts (I2P) benchmark and a custom evaluation, without ever requiring the costly step of decoding intermediate images. △ Less

Submitted 11 March, 2025; originally announced March 2025.

A framework for river connectivity classification using temporal image processing and attention based neural networks

Authors: Timothy James Becker, Derin Gezgin, Jun Yi He Wu, Mary Becker

Abstract: Measuring the connectivity of water in rivers and streams is essential for effective water resource management. Increased extreme weather events associated with climate change can result in alterations to river and stream connectivity. While traditional stream flow gauges are costly to deploy and limited to large river bodies, trail camera methods are a low-cost and easily deployed alternative to… ▽ More Measuring the connectivity of water in rivers and streams is essential for effective water resource management. Increased extreme weather events associated with climate change can result in alterations to river and stream connectivity. While traditional stream flow gauges are costly to deploy and limited to large river bodies, trail camera methods are a low-cost and easily deployed alternative to collect hourly data. Image capturing, however requires stream ecologists to manually curate (select and label) tens of thousands of images per year. To improve this workflow, we developed an automated instream trail camera image classification system consisting of three parts: (1) image processing, (2) image augmentation and (3) machine learning. The image preprocessing consists of seven image quality filters, foliage-based luma variance reduction, resizing and bottom-center cropping. Images are balanced using variable amount of generative augmentation using diffusion models and then passed to a machine learning classification model in labeled form. By using the vision transformer architecture and temporal image enhancement in our framework, we are able to increase the 75% base accuracy to 90% for a new unseen site image. We make use of a dataset captured and labeled by staff from the Connecticut Department of Energy and Environmental Protection between 2018-2020. Our results indicate that a combination of temporal image processing and attention-based models are effective at classifying unseen river connectivity images. △ Less

Submitted 1 February, 2025; originally announced February 2025.

Comments: 15 pages, 8 figures

ACM Class: I.4.3; I.4.1; I.5.1

A Consistency Analysis Method for Traffic Sequence Charts

Authors: Jan Steffen Becker

Abstract: The trend in the development of highly automated vehicles goes towards scenario-based methods. Traffic Sequence Charts are a visual but yet formal language for describing scenario-based requirements on highly automated vehicles. This work presents an approach for finding inconsistencies (conflicts) in a set of scenario-based requirements formalized with Traffic Sequence Charts. The proposed method… ▽ More The trend in the development of highly automated vehicles goes towards scenario-based methods. Traffic Sequence Charts are a visual but yet formal language for describing scenario-based requirements on highly automated vehicles. This work presents an approach for finding inconsistencies (conflicts) in a set of scenario-based requirements formalized with Traffic Sequence Charts. The proposed method utilizes satisfiability modulo theories solving on two-sided approximations of possible vehicle behavior. This ensures that found inconsistencies are not caused by approximations, but also occur when applying exact methods. Applicability and scalability of the analysis technique is evaluated in a case study. △ Less

Submitted 21 August, 2024; originally announced September 2024.

Comments: Accepted at VEHITS 2024 Doctoral Consortium. 14 pages, 9 figures

Harmonic Stability Analysis of Microgrids with Converter-Interfaced Distributed Energy Resources, Part II: Case Studies

Authors: Johanna Kristin Maria Becker, Andreas Martin Kettner, Mario Paolone

Abstract: In Part I of this paper a method for the Harmonic Stability Assessment (HSA) of power systems with a high share of Converter-Interfaced Distributed Energy Resources (CIDERs) was proposed. Specifically, the Harmonic State-Space (HSS) model of a generic power system is derived through combination of the components HSS models. The HSS models of CIDERs and grid are based on Linear Time-Periodic (LTP)… ▽ More In Part I of this paper a method for the Harmonic Stability Assessment (HSA) of power systems with a high share of Converter-Interfaced Distributed Energy Resources (CIDERs) was proposed. Specifically, the Harmonic State-Space (HSS) model of a generic power system is derived through combination of the components HSS models. The HSS models of CIDERs and grid are based on Linear Time-Periodic (LTP) models, capable of representing the coupling between different harmonics. In Part II, the HSA of a grid-forming, and two grid-following CIDERs (i.e., ex- and including the DC-side modelling) is performed. More precisely, the classification of the eigenvalues, the impact of the maximum harmonic order on the locations of the eigenvalues, and the sensitivity curves of the eigenvalues w.r.t. to control parameters are provided. These analyses allow to study the physical meaning and origin of the CIDERs eigenvalues. Additionally, the HSA is performed for a representative example system derived from the CIGRE low-voltage benchmark system. A case of harmonic instability is identified through the system eigenvalues, and validated with Time-Domain Simulations (TDS) in Simulink. It is demonstrated that, as opposed to stability analyses based on Linear Time-Invariant (LTI) models, the HSA is suitable for the detection of harmonic instability. △ Less

Submitted 12 August, 2024; originally announced August 2024.

Harmonic Stability Analysis of Microgrids with Converter-Interfaced Distributed Energy Resources, Part I: Modelling and Theoretical Foundations

Authors: Johanna Kristin Maria Becker, Andreas Martin Kettner, Mario Paolone

Abstract: This paper proposes a method for the Harmonic Stability Assessment (HSA) of power systems with a high share of Converter-Interfaced Distributed Energy Resources (CIDERs). To this end, the Harmonic State-Space (HSS) model of a generic power system is formulated by combining the HSS models of the resources and the grid in closed-loop configuration. The HSS model of the resources is obtained from the… ▽ More This paper proposes a method for the Harmonic Stability Assessment (HSA) of power systems with a high share of Converter-Interfaced Distributed Energy Resources (CIDERs). To this end, the Harmonic State-Space (HSS) model of a generic power system is formulated by combining the HSS models of the resources and the grid in closed-loop configuration. The HSS model of the resources is obtained from the Linear Time Periodic (LTP) models of the CIDER components transformed to frequency domain using Fourier theory and Toeplitz matrices. Notably, the HSS of a CIDER is capable of representing the coupling between harmonic frequencies in detail. The HSS model of the grid is derived from the dynamic equations of the individual branch and shunt elements. The system matrix of the HSS models on power-system or resource level is employed for eigenvalue analysis in the context of HSA. A sensitivity analysis of the eigenvalue loci w.r.t. changes in model parameters, and a classification of eigenvalues into control-design variant, control-design invariant, and design invariant eigenvalues is proposed. A case of harmonic instability is identified by the HSA and validated via Time-Domain Simulations (TDS) in Simulink. △ Less

Submitted 12 August, 2024; originally announced August 2024.

Ensuring Solution Uniqueness in Fixed-Point-Based Harmonic Power Flow Analysis with Converter-Interfaced Resources: Ex-post Conditions

Authors: Antonio Di Pasquale, Johanna Kristin Maria Becker, Andreas Martin Kettner, Mario Paolone

Abstract: Recently, the authors of this paper proposed a method for the Harmonic Power-Flow (HPF) calculus in polyphase grids with widespread deployment of Converter-Interfaced Distributed Energy Resources (CIDERs). The HPF problem was formulated by integrating the hybrid nodal equations of the grid with a detailed representation of the CIDERs hardware, sensing, and controls as Linear Time-Periodic (LTP) sy… ▽ More Recently, the authors of this paper proposed a method for the Harmonic Power-Flow (HPF) calculus in polyphase grids with widespread deployment of Converter-Interfaced Distributed Energy Resources (CIDERs). The HPF problem was formulated by integrating the hybrid nodal equations of the grid with a detailed representation of the CIDERs hardware, sensing, and controls as Linear Time-Periodic (LTP) systems, and solving the resulting mismatch equations using the Newton-Raphson (NR) method. This work introduces a novel problem formulation based on the fixed-point algorithm that, combined with the contraction property of the HPF problem, provides insights into the uniqueness of its solution. Notably, the effectiveness of the fixed-point formulation and the uniqueness of the solution are evaluated through numerical analyses conducted on a modified version of the CIGRE low-voltage benchmark microgrid. △ Less

Submitted 19 March, 2024; originally announced March 2024.

ForzaETH Race Stack -- Scaled Autonomous Head-to-Head Racing on Fully Commercial off-the-Shelf Hardware

Authors: Nicolas Baumann, Edoardo Ghignone, Jonas Kühne, Niklas Bastuck, Jonathan Becker, Nadine Imholz, Tobias Kränzlin, Tian Yi Lim, Michael Lötscher, Luca Schwarzenbach, Luca Tognoni, Christian Vogt, Andrea Carron, Michele Magno

Abstract: Autonomous racing in robotics combines high-speed dynamics with the necessity for reliability and real-time decision-making. While such racing pushes software and hardware to their limits, many existing full-system solutions necessitate complex, custom hardware and software, and usually focus on Time-Trials rather than full unrestricted Head-to-Head racing, due to financial and safety constraints.… ▽ More Autonomous racing in robotics combines high-speed dynamics with the necessity for reliability and real-time decision-making. While such racing pushes software and hardware to their limits, many existing full-system solutions necessitate complex, custom hardware and software, and usually focus on Time-Trials rather than full unrestricted Head-to-Head racing, due to financial and safety constraints. This limits their reproducibility, making advancements and replication feasible mostly for well-resourced laboratories with comprehensive expertise in mechanical, electrical, and robotics fields. Researchers interested in the autonomy domain but with only partial experience in one of these fields, need to spend significant time with familiarization and integration. The ForzaETH Race Stack addresses this gap by providing an autonomous racing software platform designed for F1TENTH, a 1:10 scaled Head-to-Head autonomous racing competition, which simplifies replication by using commercial off-the-shelf hardware. This approach enhances the competitive aspect of autonomous racing and provides an accessible platform for research and development in the field. The ForzaETH Race Stack is designed with modularity and operational ease of use in mind, allowing customization and adaptability to various environmental conditions, such as track friction and layout. Capable of handling both Time-Trials and Head-to-Head racing, the stack has demonstrated its effectiveness, robustness, and adaptability in the field by winning the official F1TENTH international competition multiple times. △ Less

Submitted 19 August, 2024; v1 submitted 18 March, 2024; originally announced March 2024.

Comments: This paper has been accepted at the Journal of Field Robotics

Report number: ROB22429

Journal ref: Journal of Field Robotics (Early View, 2024)

Design Space Exploration on Efficient and Accurate Human Pose Estimation from Sparse IMU-Sensing

Authors: Iris Fürst-Walter, Antonio Nappi, Tanja Harbaum, Jürgen Becker

Abstract: Human Pose Estimation (HPE) to assess human motion in sports, rehabilitation or work safety requires accurate sensing without compromising the sensitive underlying personal data. Therefore, local processing is necessary and the limited energy budget in such systems can be addressed by Inertial Measurement Units (IMU) instead of common camera sensing. The central trade-off between accuracy and effi… ▽ More Human Pose Estimation (HPE) to assess human motion in sports, rehabilitation or work safety requires accurate sensing without compromising the sensitive underlying personal data. Therefore, local processing is necessary and the limited energy budget in such systems can be addressed by Inertial Measurement Units (IMU) instead of common camera sensing. The central trade-off between accuracy and efficient use of hardware resources is rarely discussed in research. We address this trade-off by a simulative Design Space Exploration (DSE) of a varying quantity and positioning of IMU-sensors. First, we generate IMU-data from a publicly available body model dataset for different sensor configurations and train a deep learning model with this data. Additionally, we propose a combined metric to assess the accuracy-resource trade-off. We used the DSE as a tool to evaluate sensor configurations and identify beneficial ones for a specific use case. Exemplary, for a system with equal importance of accuracy and resources, we identify an optimal sensor configuration of 4 sensors with a mesh error of 6.03 cm, increasing the accuracy by 32.7% and reducing the hardware effort by two sensors compared to state of the art. Our work can be used to design health applications with well-suited sensor positioning and attention to data privacy and resource-awareness. △ Less

Submitted 12 February, 2024; v1 submitted 21 July, 2023; originally announced August 2023.

Comments: 7 pages, 6 figures, 3 tables

Real-time Graph Building on FPGAs for Machine Learning Trigger Applications in Particle Physics

Authors: Marc Neu, Juergen Becker, Philipp Dorwarth, Torben Ferber, Lea Reuter, Slavomira Stefkova, Kai Unger

Abstract: We present a design methodology that enables the semi-automatic generation of a hardware-accelerated graph building architectures for locally constrained graphs based on formally described detector definitions. In addition, we define a similarity measure in order to compare our locally constrained graph building approaches with commonly used k-nearest neighbour building approaches. To demonstrate… ▽ More We present a design methodology that enables the semi-automatic generation of a hardware-accelerated graph building architectures for locally constrained graphs based on formally described detector definitions. In addition, we define a similarity measure in order to compare our locally constrained graph building approaches with commonly used k-nearest neighbour building approaches. To demonstrate the feasibility of our solution for particle physics applications, we implemented a real-time graph building approach in a case study for the Belle~II central drift chamber using Field-Programmable Gate Arrays~(FPGAs). Our presented solution adheres to all throughput and latency constraints currently present in the hardware-based trigger of the Belle~II experiment. We achieve constant time complexity at the expense of linear space complexity and thus prove that our automated methodology generates online graph building designs suitable for a wide range of particle physics applications. By enabling an hardware-accelerated pre-processing of graphs, we enable the deployment of novel Graph Neural Networks~(GNNs) in first level triggers of particle physics experiments. △ Less

Submitted 21 March, 2024; v1 submitted 14 July, 2023; originally announced July 2023.

Comments: 20 pages

TauPETGen: Text-Conditional Tau PET Image Synthesis Based on Latent Diffusion Models

Authors: Se-In Jang, Cristina Lois, Emma Thibault, J. Alex Becker, Yafei Dong, Marc D. Normandin, Julie C. Price, Keith A. Johnson, Georges El Fakhri, Kuang Gong

Abstract: In this work, we developed a novel text-guided image synthesis technique which could generate realistic tau PET images from textual descriptions and the subject's MR image. The generated tau PET images have the potential to be used in examining relations between different measures and also increasing the public availability of tau PET datasets. The method was based on latent diffusion models. Both… ▽ More In this work, we developed a novel text-guided image synthesis technique which could generate realistic tau PET images from textual descriptions and the subject's MR image. The generated tau PET images have the potential to be used in examining relations between different measures and also increasing the public availability of tau PET datasets. The method was based on latent diffusion models. Both textual descriptions and the subject's MR prior image were utilized as conditions during image generation. The subject's MR image can provide anatomical details, while the text descriptions, such as gender, scan time, cognitive test scores, and amyloid status, can provide further guidance regarding where the tau neurofibrillary tangles might be deposited. Preliminary experimental results based on clinical [18F]MK-6240 datasets demonstrate the feasibility of the proposed method in generating realistic tau PET images at different clinical stages. △ Less

Submitted 20 June, 2023; originally announced June 2023.

Harmonic Power-Flow Study of Hybrid AC/DC Grids with Converter-Interfaced Distributed Energy Resources

Authors: Johanna Kristin Maria Becker, Andreas Martin Kettner, Yihui Zuo, Mario Paolone

Abstract: As the share of Converter-Interfaced Distributed Energy Resources (CIDERs) in power distribution systems increases, hybrid AC/DC distribution systems are drawing more interest. Indeed, CIDERs usually rely on DC power and hybrid AC/DC grids with few Network-Interfacing Converters (NICs) are a promising solution to decrease installation costs and conversion losses compared to a pure AC grid. However… ▽ More As the share of Converter-Interfaced Distributed Energy Resources (CIDERs) in power distribution systems increases, hybrid AC/DC distribution systems are drawing more interest. Indeed, CIDERs usually rely on DC power and hybrid AC/DC grids with few Network-Interfacing Converters (NICs) are a promising solution to decrease installation costs and conversion losses compared to a pure AC grid. However, interactions between the AC and DC subsystem of a hybrid AC/DC grid can lead to undesirable amplification and propagation of harmonics. The authors of this paper have recently proposed a Harmonic Power-Flow (HPF) method that accurately represents the AC power flows including the coupling between different harmonics. The HPF framework is formulated through the mismatch equations of the nodal equations between the grid and the resource models and solved by a Newton Raphson algorithm. This paper updates the HPF method to model hybrid AC/DC grids interconnected through NICs. To this end, the model of the NICs and the resulting coupling between the AC and DC subsystems is included in the mismatch equations and the Jacobian matrix of the algorithm. The updated HPF method is applied to a typical hybrid AC/DC grid, and its accuracy is validated through detailed time-domain simulations with Simulink. △ Less

Submitted 6 February, 2023; originally announced February 2023.

Optimality Guarantees for Particle Belief Approximation of POMDPs

Authors: Michael H. Lim, Tyler J. Becker, Mykel J. Kochenderfer, Claire J. Tomlin, Zachary N. Sunberg

Abstract: Partially observable Markov decision processes (POMDPs) provide a flexible representation for real-world decision and control problems. However, POMDPs are notoriously difficult to solve, especially when the state and observation spaces are continuous or hybrid, which is often the case for physical systems. While recent online sampling-based POMDP algorithms that plan with observation likelihood w… ▽ More Partially observable Markov decision processes (POMDPs) provide a flexible representation for real-world decision and control problems. However, POMDPs are notoriously difficult to solve, especially when the state and observation spaces are continuous or hybrid, which is often the case for physical systems. While recent online sampling-based POMDP algorithms that plan with observation likelihood weighting have shown practical effectiveness, a general theory characterizing the approximation error of the particle filtering techniques that these algorithms use has not previously been proposed. Our main contribution is bounding the error between any POMDP and its corresponding finite sample particle belief MDP (PB-MDP) approximation. This fundamental bridge between PB-MDPs and POMDPs allows us to adapt any sampling-based MDP algorithm to a POMDP by solving the corresponding particle belief MDP, thereby extending the convergence guarantees of the MDP algorithm to the POMDP. Practically, this is implemented by using the particle filter belief transition model as the generative model for the MDP solver. While this requires access to the observation density model from the POMDP, it only increases the transition sampling complexity of the MDP solver by a factor of $\mathcal{O}(C)$, where $C$ is the number of particles. Thus, when combined with sparse sampling MDP algorithms, this approach can yield algorithms for POMDPs that have no direct theoretical dependence on the size of the state and observation spaces. In addition to our theoretical contribution, we perform five numerical experiments on benchmark POMDPs to demonstrate that a simple MDP algorithm adapted using PB-MDP approximation, Sparse-PFT, achieves performance competitive with other leading continuous observation POMDP solvers. △ Less

Submitted 19 October, 2023; v1 submitted 10 October, 2022; originally announced October 2022.

Journal ref: Journal of Artificial Intelligence Research, 77, 1591-1636 (2023)

Model- and Acceleration-based Pursuit Controller for High-Performance Autonomous Racing

Authors: Jonathan Becker, Nadine Imholz, Luca Schwarzenbach, Edoardo Ghignone, Nicolas Baumann, Michele Magno

Abstract: Autonomous racing is a research field gaining large popularity, as it pushes autonomous driving algorithms to their limits and serves as a catalyst for general autonomous driving. For scaled autonomous racing platforms, the computational constraint and complexity often limit the use of Model Predictive Control (MPC). As a consequence, geometric controllers are the most frequently deployed controll… ▽ More Autonomous racing is a research field gaining large popularity, as it pushes autonomous driving algorithms to their limits and serves as a catalyst for general autonomous driving. For scaled autonomous racing platforms, the computational constraint and complexity often limit the use of Model Predictive Control (MPC). As a consequence, geometric controllers are the most frequently deployed controllers. They prove to be performant while yielding implementation and operational simplicity. Yet, they inherently lack the incorporation of model dynamics, thus limiting the race car to a velocity domain where tire slip can be neglected. This paper presents Model- and Acceleration-based Pursuit (MAP) a high-performance model-based trajectory tracking algorithm that preserves the simplicity of geometric approaches while leveraging tire dynamics. The proposed algorithm allows accurate tracking of a trajectory at unprecedented velocities compared to State-of-the-Art (SotA) geometric controllers. The MAP controller is experimentally validated and outperforms the reference geometric controller four-fold in terms of lateral tracking error, yielding a tracking error of 0.055m at tested speeds up to 11m/s. △ Less

Submitted 7 July, 2023; v1 submitted 9 September, 2022; originally announced September 2022.

Comments: 6 pages, 6 figures, 1 table

Journal ref: 2023 IEEE International Conference on Robotics and Automation (ICRA)

Histopathology DatasetGAN: Synthesizing Large-Resolution Histopathology Datasets

Authors: S. A. Rizvi, P. Cicalese, S. V. Seshan, S. Sciascia, J. U. Becker, H. V. Nguyen

Abstract: Self-supervised learning (SSL) methods are enabling an increasing number of deep learning models to be trained on image datasets in domains where labels are difficult to obtain. These methods, however, struggle to scale to the high resolution of medical imaging datasets, where they are critical for achieving good generalization on label-scarce medical image datasets. In this work, we propose the H… ▽ More Self-supervised learning (SSL) methods are enabling an increasing number of deep learning models to be trained on image datasets in domains where labels are difficult to obtain. These methods, however, struggle to scale to the high resolution of medical imaging datasets, where they are critical for achieving good generalization on label-scarce medical image datasets. In this work, we propose the Histopathology DatasetGAN (HDGAN) framework, an extension of the DatasetGAN semi-supervised framework for image generation and segmentation that scales well to large-resolution histopathology images. We make several adaptations from the original framework, including updating the generative backbone, selectively extracting latent features from the generator, and switching to memory-mapped arrays. These changes reduce the memory consumption of the framework, improving its applicability to medical imaging domains. We evaluate HDGAN on a thrombotic microangiopathy high-resolution tile dataset, demonstrating strong performance on the high-resolution image-annotation generation task. We hope that this work enables more application of deep learning models to medical datasets, in addition to encouraging more exploration of self-supervised frameworks within the medical imaging domain. △ Less

Submitted 6 July, 2022; originally announced July 2022.

Comments: 5 pages, 2 figures, 1 table. Submitted to IEEE SPMB conference

Modelling of AC/DC Interactions of Converter-Interfaced Resources for Harmonic Power-Flow Studies in Microgrids

Authors: Johanna Kristin Maria Becker, Andreas Martin Kettner, Yihui Zuo, Federico Cecati, Sante Pugliese, Marco Liserre, Mario Paolone

Abstract: Power distribution systems experience a large-scale integration of Converter-Interfaced Distributed Energy Resources (CIDERs). As acknowledged by recent literature, the interaction of individual CIDER components and different CIDERs through the grid can lead to undesirable amplification of harmonic frequencies and, ultimately, compromise the distribution system stability. In this context, the inte… ▽ More Power distribution systems experience a large-scale integration of Converter-Interfaced Distributed Energy Resources (CIDERs). As acknowledged by recent literature, the interaction of individual CIDER components and different CIDERs through the grid can lead to undesirable amplification of harmonic frequencies and, ultimately, compromise the distribution system stability. In this context, the interaction of the DC and AC sides of CIDERs has been shown to have a significant impact. In order to analyze and support the mitigation of such phenomena, the authors of this paper recently proposed a Harmonic Power-Flow (HPF) framework for polyphase grids with a high share of CIDERs. The framework considers the coupling between harmonics, but ignores the DC-side response of the CIDERs. Modelling the DC side and AC/DC converter introduces a nonlinearity into the CIDER model that needs to be approximated for the numerical solution of the HPF. This paper extends the CIDER model and HPF framework to address this aspect, whose inclusion is non-trivial. The extended HPF method is applied to a modified version of the CIGRE low-voltage benchmark microgrid. The results are compared to (i) time-domain simulations with Simulink, (ii) the predecessor of the extended HPF which neglects the DC side, and (iii) a classical decoupled HPF. △ Less

Submitted 21 October, 2022; v1 submitted 15 June, 2022; originally announced June 2022.

IoT-Scan: Network Reconnaissance for the Internet of Things

Authors: Stefan Gvozdenovic, Johannes K Becker, John Mikulskis, David Starobinski

Abstract: Network reconnaissance is a core networking and security procedure aimed at discovering devices and their properties. For IP-based networks, several network reconnaissance tools are available, such as Nmap. For the Internet of Things (IoT), there is currently no similar tool capable of discovering devices across multiple protocols. In this paper, we present IoT-Scan, a universal IoT network reconn… ▽ More Network reconnaissance is a core networking and security procedure aimed at discovering devices and their properties. For IP-based networks, several network reconnaissance tools are available, such as Nmap. For the Internet of Things (IoT), there is currently no similar tool capable of discovering devices across multiple protocols. In this paper, we present IoT-Scan, a universal IoT network reconnaissance tool. IoT-Scan is based on software defined radio (SDR) technology, which allows for a flexible software-based implementation of radio protocols. We present a series of passive, active, multi-channel, and multi-protocol scanning algorithms to speed up the discovery of devices with IoT-Scan. We benchmark the passive scanning algorithms against a theoretical traffic model based on the non-uniform coupon collector problem. We implement the scanning algorithms and compare their performance for four popular IoT protocols: Zigbee, Bluetooth LE, Z-Wave, and LoRa. Through extensive experiments with dozens of IoT devices, we demonstrate that our implementation experiences minimal packet losses and achieves performance near the theoretical benchmark. Using multi-protocol scanning, we further demonstrate a reduction of 70\% in the discovery times of Bluetooth and Zigbee devices in the 2.4\,GHz band and of LoRa and Z-Wave devices in the 900\,MHz band, compared to sequential passive scanning. We make our implementation and data available to the research community to allow independent replication of our results and facilitate further development of the tool. △ Less

Submitted 5 April, 2022; originally announced April 2022.

Predicting Trust Using Automated Assessment of Multivariate Interactional Synchrony

Authors: Adrien Meynard, Gayan Seneviratna, Elliot Doyle, Joyanne Becker, Hau-Tieng Wu, Jana Schaich Borg

Abstract: Diverse disciplines are interested in how the coordination of interacting agents' movements, emotions, and physiology over time impacts social behavior. Here, we describe a new multivariate procedure for automating the investigation of this kind of behaviorally-relevant "interactional synchrony", and introduce a novel interactional synchrony measure based on features of dynamic time warping (DTW)… ▽ More Diverse disciplines are interested in how the coordination of interacting agents' movements, emotions, and physiology over time impacts social behavior. Here, we describe a new multivariate procedure for automating the investigation of this kind of behaviorally-relevant "interactional synchrony", and introduce a novel interactional synchrony measure based on features of dynamic time warping (DTW) paths. We demonstrate that our DTW path-based measure of interactional synchrony between facial action units of two people interacting freely in a natural social interaction can be used to predict how much trust they will display in a subsequent Trust Game. We also show that our approach outperforms univariate head movement models, models that consider participants' facial action units independently, and models that use previously proposed synchrony or similarity measures. The insights of this work can be applied to any research question that aims to quantify the temporal coordination of multiple signals over time, but has immediate applications in psychology, medicine, and robotics. △ Less

Submitted 6 January, 2022; originally announced January 2022.

Harmonic Power-Flow Study of Polyphase Grids with Converter-Interfaced Distributed Energy Resources, Part II: Model Library and Validation

Authors: Johanna Kristin Maria Becker, Andreas Martin Kettner, Lorenzo Reyes-Chamorro, Zhixiang Zou, Marco Liserre, Mario Paolone

Abstract: In Part I, a method for the Harmonic Power-Flow (HPF) study of three-phase power grids with Converter-Interfaced Distributed Energy Resources (CIDERs) is proposed. The method is based on generic and modular representations of the grid and the CIDERs, and explicitly accounts for coupling between harmonics. In Part II, the HPF method is validated. First, the applicability of the modeling framework i… ▽ More In Part I, a method for the Harmonic Power-Flow (HPF) study of three-phase power grids with Converter-Interfaced Distributed Energy Resources (CIDERs) is proposed. The method is based on generic and modular representations of the grid and the CIDERs, and explicitly accounts for coupling between harmonics. In Part II, the HPF method is validated. First, the applicability of the modeling framework is demonstrated on typical grid-forming and grid-following CIDERs. Then, the HPF method is implemented in Matlab and compared against time-domain simulations with Simulink. The accuracy of the models and the performance of the solution algorithm are assessed for individual resources and a modified version of the CIGRÉ low-voltage benchmark microgrid (i.e., with additional unbalanced components). The observed maximum errors are 6.3E-5 p.u. w.r.t. voltage magnitude, 1.3E-3 p.u. w.r.t. current magnitude, and 0.9 deg w.r.t. phase. Moreover, the scalability of the method is assessed w.r.t. the number of CIDERs and the maximum harmonic order ($\leqslant$25). For the maximum problem size, the execution time of the HPF method is 6.52 sec, which is 5 times faster than the time-domain simulation. The convergence of the method is robust w.r.t. the choice of the initial point, and multiplicity of solutions has not been observed. △ Less

Submitted 1 November, 2021; v1 submitted 23 June, 2021; originally announced June 2021.

Harmonic Power-Flow Study of Polyphase Grids with Converter-Interfaced Distributed Energy Resources, Part I: Modelling Framework and Algorithm

Authors: Andreas Martin Kettner, Lorenzo Reyes-Chamorro, Johanna Kristin Maria Becker, Zhixiang Zou, Marco Liserre, Mario Paolone

Abstract: Power distribution systems are experiencing a large-scale integration of Converter-Interfaced Distributed Energy Resources (CIDERs). This complicates the analysis and mitigation of harmonics, whose creation and propagation are facilitated by the interactions of converters and their controllers through the grid. In this paper, a method for the calculation of the so-called Harmonic Power-Flow (HPF)… ▽ More Power distribution systems are experiencing a large-scale integration of Converter-Interfaced Distributed Energy Resources (CIDERs). This complicates the analysis and mitigation of harmonics, whose creation and propagation are facilitated by the interactions of converters and their controllers through the grid. In this paper, a method for the calculation of the so-called Harmonic Power-Flow (HPF) in three-phase grids with CIDERs is proposed. The distinguishing feature of this HPF method is the generic and modular representation of the system components. Notably, as opposed to most of the existing approaches, the coupling between harmonics is explicitly considered. The HPF problem is formulated by combining the hybrid nodal equations of the grid with the closed-loop transfer functions of the CIDERs, and solved using the Newton-Raphson method. The grid components are characterized by compound electrical parameters, which allow to represent both transposed or non-transposed lines. The CIDERs are represented by modular linear time-periodic systems, which allows to treat both grid-forming and grid-following control laws. The method's accuracy and computational efficiency are confirmed via time-domain simulations of the CIGRÉ low-voltage benchmark microgrid. This paper is divided in two parts, which focus on the development (Part I) and the validation (Part II) of the proposed method. △ Less

Submitted 1 November, 2021; v1 submitted 23 June, 2021; originally announced June 2021.

StyPath: Style-Transfer Data Augmentation For Robust Histology Image Classification

Authors: Pietro Antonio Cicalese, Aryan Mobiny, Pengyu Yuan, Jan Becker, Chandra Mohan, Hien Van Nguyen

Abstract: The classification of Antibody Mediated Rejection (AMR) in kidney transplant remains challenging even for experienced nephropathologists; this is partly because histological tissue stain analysis is often characterized by low inter-observer agreement and poor reproducibility. One of the implicated causes for inter-observer disagreement is the variability of tissue stain quality between (and within… ▽ More The classification of Antibody Mediated Rejection (AMR) in kidney transplant remains challenging even for experienced nephropathologists; this is partly because histological tissue stain analysis is often characterized by low inter-observer agreement and poor reproducibility. One of the implicated causes for inter-observer disagreement is the variability of tissue stain quality between (and within) pathology labs, coupled with the gradual fading of archival sections. Variations in stain colors and intensities can make tissue evaluation difficult for pathologists, ultimately affecting their ability to describe relevant morphological features. Being able to accurately predict the AMR status based on kidney histology images is crucial for improving patient treatment and care. We propose a novel pipeline to build robust deep neural networks for AMR classification based on StyPath, a histological data augmentation technique that leverages a light weight style-transfer algorithm as a means to reduce sample-specific bias. Each image was generated in 1.84 +- 0.03 seconds using a single GTX TITAN V gpu and pytorch, making it faster than other popular histological data augmentation techniques. We evaluated our model using a Monte Carlo (MC) estimate of Bayesian performance and generate an epistemic measure of uncertainty to compare both the baseline and StyPath augmented models. We also generated Grad-CAM representations of the results which were assessed by an experienced nephropathologist; we used this qualitative analysis to elucidate on the assumptions being made by each model. Our results imply that our style-transfer augmentation technique improves histological classification performance (reducing error from 14.8% to 11.5%) and generalization ability. △ Less

Submitted 9 July, 2020; originally announced July 2020.

T2-weighted Spine Imaging using a Single-Shot Turbo Spin Echo Pulse Sequence

Authors: Mahesh Bharath Keerthivasan, Blair Winegar, Jennifer L Becker, Manojkumar Saranathan

Abstract: T2 weighted imaging of the spine is commonly performed using fast spin echo (FSE/TSE) based sequences, resulting in long scan times and vulnerability to motion artifacts. While single shot fast spin echo sequences have been attempted, their adoption has been limited by poor spatial resolution and specific absorption rate (SAR) limitations. We investigate the use of a half-Fourier acquisition singl… ▽ More T2 weighted imaging of the spine is commonly performed using fast spin echo (FSE/TSE) based sequences, resulting in long scan times and vulnerability to motion artifacts. While single shot fast spin echo sequences have been attempted, their adoption has been limited by poor spatial resolution and specific absorption rate (SAR) limitations. We investigate the use of a half-Fourier acquisition single-shot turbo spin-echo variable flip angle (HASTE-VFA) sequence for T2 weighted spine imaging. A variable refocusing flip angle echo train was first optimized for the spine to improve the point spread function (PSF) and minimize SAR, yielding images with improved spatial resolution and signal-to-noise ratio compared to the constant flip angle sequence. Data was acquired from 29 patients (20 lumbar and thoracolumbar, 9 whole-spine) using conventional fast spin echo and the proposed variable flip angle single-shot sequences. All images were graded by two experienced neuroradiologists in a blinded fashion and scores were assigned based on blurring, motion, artifacts, and noise as well as appearance of disks, facet joints, end plates, nerve roots and the spinal cord. △ Less

Submitted 8 November, 2019; originally announced November 2019.

Comments: 13 pages, 7 figures, 4 tables, Previously submitted to "Investigative Radiology"

Spatially Adaptive Colocalization Analysis in Dual-Color Fluorescence Microscopy

Authors: Shulei Wang, Ellen T. Arena, Jordan T. Becker, William M. Bement, Nathan M. Sherer, Kevin W. Eliceiri, Ming Yuan

Abstract: Colocalization analysis aims to study complex spatial associations between bio-molecules via optical imaging techniques. However, existing colocalization analysis workflows only assess an average degree of colocalization within a certain region of interest and ignore the unique and valuable spatial information offered by microscopy. In the current work, we introduce a new framework for colocalizat… ▽ More Colocalization analysis aims to study complex spatial associations between bio-molecules via optical imaging techniques. However, existing colocalization analysis workflows only assess an average degree of colocalization within a certain region of interest and ignore the unique and valuable spatial information offered by microscopy. In the current work, we introduce a new framework for colocalization analysis that allows us to quantify colocalization levels at each individual location and automatically identify pixels or regions where colocalization occurs. The framework, referred to as spatially adaptive colocalization analysis (SACA), integrates a pixel-wise local kernel model for colocalization quantification and a multi-scale adaptive propagation-separation strategy for utilizing spatial information to detect colocalization in a spatially adaptive fashion. Applications to simulated and real biological datasets demonstrate the practical merits of SACA in what we hope to be an easily applicable and robust colocalization analysis method. In addition, theoretical properties of SACA are investigated to provide rigorous statistical justification. △ Less

Submitted 20 March, 2019; v1 submitted 31 October, 2017; originally announced November 2017.