-
A Signal Matrix-Based Local Flaw Detection Framework for Steel Wire Ropes Using Convolutional Neural Networks
Authors:
Siyu You,
Leilei Yang,
Zixu Kuang,
Huayi Gou,
Longlong Zhang,
Zhiliang Liu
Abstract:
Steel wire ropes (SWRs) are critical load-bearing components in industrial applications, yet their structural integrity is often compromised by local flaws (LFs). Magnetic Flux Leakage (MFL) is a widely used non-destructive testing method that detects defects by measuring perturbations in magnetic fields. Traditional MFL detection methods suffer from critical limitations: one-dimensional approache…
▽ More
Steel wire ropes (SWRs) are critical load-bearing components in industrial applications, yet their structural integrity is often compromised by local flaws (LFs). Magnetic Flux Leakage (MFL) is a widely used non-destructive testing method that detects defects by measuring perturbations in magnetic fields. Traditional MFL detection methods suffer from critical limitations: one-dimensional approaches fail to capture spatial relationships across sensor channels, while multi-dimensional image-based techniques introduce interpolation artifacts and computational inefficiencies. This paper proposes a novel detection framework based on signal matrices, directly processing raw multi-channel MFL signals using a specialized Convolutional Neural Network for signal matrix as input (SM-CNN). The architecture incorporates stripe pooling to preserve channel-wise features and symmetric padding to improve boundary defect detection. Our model achieves state-of-the-art performance with 98.74% accuracy and 97.85% recall. Additionally, it demonstrates exceptional computational efficiency, processing at 87.72 frames per second (FPS) with a low inference latency of 2.6ms and preprocessing time of 8.8ms. With only 1.48 million parameters, this lightweight design supports real-time processing, establishing a new benchmark for SWR inspection in industrial settings.
△ Less
Submitted 15 April, 2025;
originally announced April 2025.
-
Local Flaw Detection with Adaptive Pyramid Image Fusion Across Spatial Sampling Resolution for SWRs
Authors:
Siyu You,
Huayi Gou,
Leilei Yang,
Zhiliang Liu,
Mingjian Zuo
Abstract:
The inspection of local flaws (LFs) in Steel Wire Ropes (SWRs) is crucial for ensuring safety and reliability in various industries. Magnetic Flux Leakage (MFL) imaging is commonly used for non-destructive testing, but its effectiveness is often hindered by the combined effects of inspection speed and sampling rate. To address this issue, the impacts of inspection speed and sampling rate on image…
▽ More
The inspection of local flaws (LFs) in Steel Wire Ropes (SWRs) is crucial for ensuring safety and reliability in various industries. Magnetic Flux Leakage (MFL) imaging is commonly used for non-destructive testing, but its effectiveness is often hindered by the combined effects of inspection speed and sampling rate. To address this issue, the impacts of inspection speed and sampling rate on image quality are studied, as variations in these factors can cause stripe noise, axial compression of defect features, and increased interference, complicating accurate detection. We define the relationship between inspection speed and sampling rate as spatial sampling resolution (SSR) and propose an adaptive SSR target-feature-oriented (AS-TFO) method. This method incorporates adaptive adjustment and pyramid image fusion techniques to enhance defect detection under different SSR scenarios. Experimental results show that under high SSR scenarios, the method achieves a precision of 94.73% and a recall of 96.77%. It remains robust under low SSR scenarios with a precision of 94.30% and recall of 97.32%. The overall results show that the proposed method outperforms conventional approaches, achieving state-of-the-art performance. This improvement in detection accuracy and robustness is particularly valuable for handling complex inspection conditions, where inspection speed and sampling rate can vary significantly, making detection more robust and reliable in industrial settings.
△ Less
Submitted 14 March, 2025; v1 submitted 17 February, 2025;
originally announced February 2025.
-
Improved VMD Based Remote Heartbeat Estimation Utilizing 60GHz mmWave Radar
Authors:
Boyuan Gu,
Yanhui Yang,
Siyu You,
Haiyang Sun,
Jiahui Sun,
Shisheng Guo
Abstract:
This study introduces an improved VMD based signal decomposition methodology for non-contact heartbeat estimation using millimeterwave (mmWave) radar. Specifically, we first analyze the signal model of the mmWave radar system. The Variational Mode Decomposition (VMD) integrated with the Newton-Raphson-based optimizer (NRBO) algorithm are sequentially utilized for cardiac mechanic signal (CMS) reco…
▽ More
This study introduces an improved VMD based signal decomposition methodology for non-contact heartbeat estimation using millimeterwave (mmWave) radar. Specifically, we first analyze the signal model of the mmWave radar system. The Variational Mode Decomposition (VMD) integrated with the Newton-Raphson-based optimizer (NRBO) algorithm are sequentially utilized for cardiac mechanic signal (CMS) reconstruction. The estimation accuracy is enhanced by adaptively optimizing the VMD parameters including intrinsic mode functions (IMFs) and penalty factor. Eventually, the experimental results of 18 subjects validate the effectiveness of the proposed method by comparing with three commonly used baselines.
△ Less
Submitted 16 February, 2025;
originally announced February 2025.
-
DT4ECG: A Dual-Task Learning Framework for ECG-Based Human Identity Recognition and Human Activity Detection
Authors:
Siyu You,
Boyuan Gu,
Yanhui Yang,
Shiyu Yu,
Shisheng Guo
Abstract:
This article introduces DT4ECG, an innovative dual-task learning framework for Electrocardiogram (ECG)-based human identity recognition and activity detection. The framework employs a robust one-dimensional convolutional neural network (1D-CNN) backbone integrated with residual blocks to extract discriminative ECG features. To enhance feature representation, we propose a novel Sequence Channel Att…
▽ More
This article introduces DT4ECG, an innovative dual-task learning framework for Electrocardiogram (ECG)-based human identity recognition and activity detection. The framework employs a robust one-dimensional convolutional neural network (1D-CNN) backbone integrated with residual blocks to extract discriminative ECG features. To enhance feature representation, we propose a novel Sequence Channel Attention (SCA) mechanism, which combines channel-wise and sequential context attention to prioritize informative features across both temporal and channel dimensions. Furthermore, to address gradient imbalance in multi-task learning, we integrate GradNorm, a technique that dynamically adjusts loss weights based on gradient magnitudes, ensuring balanced training across tasks. Experimental results demonstrate the superior performance of our model, achieving accuracy rates of 99.12% in ID classification and 90.11% in activity classification. These findings underscore the potential of the DT4ECG framework in enhancing security and user experience across various applications such as fitness monitoring and personalized healthcare, thereby presenting a transformative approach to integrating ECG-based biometrics in everyday technologies.
△ Less
Submitted 16 February, 2025;
originally announced February 2025.
-
Automatic Spectral Calibration of Hyperspectral Images:Method, Dataset and Benchmark
Authors:
Zhuoran Du,
Shaodi You,
Cheng Cheng,
Shikui Wei
Abstract:
Hyperspectral image (HSI) densely samples the world in both the space and frequency domain and therefore is more distinctive than RGB images. Usually, HSI needs to be calibrated to minimize the impact of various illumination conditions. The traditional way to calibrate HSI utilizes a physical reference, which involves manual operations, occlusions, and/or limits camera mobility. These limitations…
▽ More
Hyperspectral image (HSI) densely samples the world in both the space and frequency domain and therefore is more distinctive than RGB images. Usually, HSI needs to be calibrated to minimize the impact of various illumination conditions. The traditional way to calibrate HSI utilizes a physical reference, which involves manual operations, occlusions, and/or limits camera mobility. These limitations inspire this paper to automatically calibrate HSIs using a learning-based method. Towards this goal, a large-scale HSI calibration dataset is created, which has 765 high-quality HSI pairs covering diversified natural scenes and illuminations. The dataset is further expanded to 7650 pairs by combining with 10 different physically measured illuminations. A spectral illumination transformer (SIT) together with an illumination attention module is proposed. Extensive benchmarks demonstrate the SoTA performance of the proposed SIT. The benchmarks also indicate that low-light conditions are more challenging than normal conditions. The dataset and codes are available online:https://github.com/duranze/Automatic-spectral-calibration-of-HSI
△ Less
Submitted 20 December, 2024; v1 submitted 19 December, 2024;
originally announced December 2024.
-
Enhancing digital core image resolution using optimal upscaling algorithm: with application to paired SEM images
Authors:
Shaohua You,
Shuqi Sun,
Zhengting Yan,
Qinzhuo Liao,
Huiying Tang,
Lianhe Sun,
Gensheng Li
Abstract:
The porous media community extensively utilizes digital rock images for core analysis. High-resolution digital rock images that possess sufficient quality are essential but often challenging to acquire. Super-resolution (SR) approaches enhance the resolution of digital rock images and provide improved visualization of fine features and structures, aiding in the analysis and interpretation of rock…
▽ More
The porous media community extensively utilizes digital rock images for core analysis. High-resolution digital rock images that possess sufficient quality are essential but often challenging to acquire. Super-resolution (SR) approaches enhance the resolution of digital rock images and provide improved visualization of fine features and structures, aiding in the analysis and interpretation of rock properties, such as pore connectivity and mineral distribution. However, there is a current shortage of real paired microscopic images for super-resolution training. In this study, we used two types of Scanning Electron Microscopes (SEM) to obtain the images of shale samples in five regions, with 1X, 2X, 4X, 8X and 16X magnifications. We used these real scanned paired images as a reference to select the optimal method of image generation and validated it using Enhanced Deep Super Resolution (EDSR) and Very Deep Super Resolution (VDSR) methods. Our experiments show that the bilinear algorithm is more suitable than the commonly used bicubic method, for establishing low-resolution datasets in the SR approaches, which is partially attributed to the mechanism of Scanning Electron Microscopes (SEM).
△ Less
Submitted 5 September, 2024;
originally announced September 2024.
-
Practical Power System Inertia Monitoring Based on Pumped Storage Hydropower Operation Signature
Authors:
Hongyu Li,
Chang Chen,
Mark Baldwin,
Shutang You,
Wenpeng Yu,
Lin Zhu,
Yilu Liu
Abstract:
This paper proposes a practical method to monitor power system inertia using Pumped Storage Hydropower (PSH) switching-off events. This approach offers real-time system-level inertia estimation with minimal expenses, no disruption, and the inclusion of behind-the-meter inertia. First, accurate inertia estimation is achieved through improved RoCoF calculation that accounts for pre-event RoCoF, redu…
▽ More
This paper proposes a practical method to monitor power system inertia using Pumped Storage Hydropower (PSH) switching-off events. This approach offers real-time system-level inertia estimation with minimal expenses, no disruption, and the inclusion of behind-the-meter inertia. First, accurate inertia estimation is achieved through improved RoCoF calculation that accounts for pre-event RoCoF, reducing common random frequency fluctuations in practice. Second, PSH field data is analyzed, highlighting the benefits of using switching-off events for grid inertia estimation. Third, an event detection trigger is designed to capture pump switching-off events based on local and system features. Fourth, the method is validated on the U.S. Eastern Interconnection model with over 60,000 buses, demonstrating very high accuracy (3%-5% error rate). Finally, it is applied to the U.S. Western Interconnection, with field validation showing a 9.9% average absolute error rate. Despite challenges in practical power system inertia estimation, this method enhances decision-making for power grid reliability and efficiency, addressing challenges posed by renewable energy integration.
△ Less
Submitted 1 July, 2024; v1 submitted 27 June, 2024;
originally announced June 2024.
-
System- and Sample-agnostic Isotropic 3D Microscopy by Weakly Physics-informed, Domain-shift-resistant Axial Deblurring
Authors:
Jiashu Han,
Kunzan Liu,
Keith B. Isaacson,
Kristina Monakhova,
Linda G. Griffith,
Sixian You
Abstract:
Three-dimensional (3D) subcellular imaging is essential for biomedical research, but the diffraction limit of optical microscopy compromises axial resolution, hindering accurate 3D structural analysis. This challenge is particularly pronounced in label-free imaging of thick, heterogeneous tissues, where assumptions about data distribution (e.g. sparsity, label-specific distribution, and lateral-ax…
▽ More
Three-dimensional (3D) subcellular imaging is essential for biomedical research, but the diffraction limit of optical microscopy compromises axial resolution, hindering accurate 3D structural analysis. This challenge is particularly pronounced in label-free imaging of thick, heterogeneous tissues, where assumptions about data distribution (e.g. sparsity, label-specific distribution, and lateral-axial similarity) and system priors (e.g. independent and identically distributed (i.i.d.) noise and linear shift-invariant (LSI) point-spread functions (PSFs)) are often invalid. Here, we introduce SSAI-3D, a weakly physics-informed, domain-shift-resistant framework for robust isotropic 3D imaging. SSAI-3D enables robust axial deblurring by generating a PSF-flexible, noise-resilient, sample-informed training dataset and sparsely fine-tuning a large pre-trained blind deblurring network. SSAI-3D was applied to label-free nonlinear imaging of living organoids, freshly excised human endometrium tissue, and mouse whisker pads, and further validated in publicly available ground-truth-paired experimental datasets of 3D heterogeneous biological tissues with unknown blurring and noise across different microscopy systems.
△ Less
Submitted 10 June, 2024;
originally announced June 2024.
-
Learned, uncertainty-driven adaptive acquisition for photon-efficient scanning microscopy
Authors:
Cassandra Tong Ye,
Jiashu Han,
Kunzan Liu,
Anastasios Angelopoulos,
Linda Griffith,
Kristina Monakhova,
Sixian You
Abstract:
Scanning microscopy systems, such as confocal and multiphoton microscopy, are powerful imaging tools for probing deep into biological tissue. However, scanning systems have an inherent trade-off between acquisition time, field of view, phototoxicity, and image quality, often resulting in noisy measurements when fast, large field of view, and/or gentle imaging is needed. Deep learning could be used…
▽ More
Scanning microscopy systems, such as confocal and multiphoton microscopy, are powerful imaging tools for probing deep into biological tissue. However, scanning systems have an inherent trade-off between acquisition time, field of view, phototoxicity, and image quality, often resulting in noisy measurements when fast, large field of view, and/or gentle imaging is needed. Deep learning could be used to denoise noisy microscopy measurements, but these algorithms can be prone to hallucination, which can be disastrous for medical and scientific applications. We propose a method to simultaneously denoise and predict pixel-wise uncertainty for scanning microscopy systems, improving algorithm trustworthiness and providing statistical guarantees for deep learning predictions. Furthermore, we propose to leverage this learned, pixel-wise uncertainty to drive an adaptive acquisition technique that rescans only the most uncertain regions of a sample, saving time and reducing the total light dose to the sample. We demonstrate our method on experimental confocal and multiphoton microscopy systems, showing that our uncertainty maps can pinpoint hallucinations in the deep learned predictions. Finally, with our adaptive acquisition technique, we demonstrate up to 16X reduction in acquisition time and total light dose while successfully recovering fine features in the sample and reducing hallucinations. We are the first to demonstrate distribution-free uncertainty quantification for a denoising task with real experimental data and the first to propose adaptive acquisition based on reconstruction uncertainty.
△ Less
Submitted 24 March, 2025; v1 submitted 24 October, 2023;
originally announced October 2023.
-
EventLFM: Event Camera integrated Fourier Light Field Microscopy for Ultrafast 3D imaging
Authors:
Ruipeng Guo,
Qianwan Yang,
Andrew S. Chang,
Guorong Hu,
Joseph Greene,
Christopher V. Gabel,
Sixian You,
Lei Tian
Abstract:
Ultrafast 3D imaging is indispensable for visualizing complex and dynamic biological processes. Conventional scanning-based techniques necessitate an inherent trade-off between acquisition speed and space-bandwidth product (SBP). Emerging single-shot 3D wide-field techniques offer a promising alternative but are bottlenecked by the synchronous readout constraints of conventional CMOS systems, thus…
▽ More
Ultrafast 3D imaging is indispensable for visualizing complex and dynamic biological processes. Conventional scanning-based techniques necessitate an inherent trade-off between acquisition speed and space-bandwidth product (SBP). Emerging single-shot 3D wide-field techniques offer a promising alternative but are bottlenecked by the synchronous readout constraints of conventional CMOS systems, thus restricting data throughput to maintain high SBP at limited frame rates. To address this, we introduce EventLFM, a straightforward and cost-effective system that overcomes these challenges by integrating an event camera with Fourier light field microscopy (LFM), a state-of-the-art single-shot 3D wide-field imaging technique. The event camera operates on a novel asynchronous readout architecture, thereby bypassing the frame rate limitations inherent to conventional CMOS systems. We further develop a simple and robust event-driven LFM reconstruction algorithm that can reliably reconstruct 3D dynamics from the unique spatiotemporal measurements captured by EventLFM. Experimental results demonstrate that EventLFM can robustly reconstruct fast-moving and rapidly blinking 3D fluorescent samples at kHz frame rates. Furthermore, we highlight EventLFM's capability for imaging of blinking neuronal signals in scattering mouse brain tissues and 3D tracking of GFP-labeled neurons in freely moving C. elegans. We believe that the combined ultrafast speed and large 3D SBP offered by EventLFM may open up new possibilities across many biomedical applications.
△ Less
Submitted 3 April, 2024; v1 submitted 1 October, 2023;
originally announced October 2023.
-
Unsupervised Synthetic Image Refinement via Contrastive Learning and Consistent Semantic-Structural Constraints
Authors:
Ganning Zhao,
Tingwei Shen,
Suya You,
C. -C. Jay Kuo
Abstract:
Ensuring the realism of computer-generated synthetic images is crucial to deep neural network (DNN) training. Due to different semantic distributions between synthetic and real-world captured datasets, there exists semantic mismatch between synthetic and refined images, which in turn results in the semantic distortion. Recently, contrastive learning (CL) has been successfully used to pull correlat…
▽ More
Ensuring the realism of computer-generated synthetic images is crucial to deep neural network (DNN) training. Due to different semantic distributions between synthetic and real-world captured datasets, there exists semantic mismatch between synthetic and refined images, which in turn results in the semantic distortion. Recently, contrastive learning (CL) has been successfully used to pull correlated patches together and push uncorrelated ones apart. In this work, we exploit semantic and structural consistency between synthetic and refined images and adopt CL to reduce the semantic distortion. Besides, we incorporate hard negative mining to improve the performance furthermore. We compare the performance of our method with several other benchmarking methods using qualitative and quantitative measures and show that our method offers the state-of-the-art performance.
△ Less
Submitted 26 April, 2023; v1 submitted 25 April, 2023;
originally announced April 2023.
-
A Study on Improving Realism of Synthetic Data for Machine Learning
Authors:
Tingwei Shen,
Ganning Zhao,
Suya You
Abstract:
Synthetic-to-real data translation using generative adversarial learning has achieved significant success in improving synthetic data. Yet, limited studies focus on deep evaluation and comparison of adversarial training on general-purpose synthetic data for machine learning. This work aims to train and evaluate a synthetic-to-real generative model that transforms the synthetic renderings into more…
▽ More
Synthetic-to-real data translation using generative adversarial learning has achieved significant success in improving synthetic data. Yet, limited studies focus on deep evaluation and comparison of adversarial training on general-purpose synthetic data for machine learning. This work aims to train and evaluate a synthetic-to-real generative model that transforms the synthetic renderings into more realistic styles on general-purpose datasets conditioned with unlabeled real-world data. Extensive performance evaluation and comparison have been conducted through qualitative and quantitative metrics and a defined downstream perception task.
△ Less
Submitted 28 April, 2023; v1 submitted 24 April, 2023;
originally announced April 2023.
-
Roadmap on Deep Learning for Microscopy
Authors:
Giovanni Volpe,
Carolina Wählby,
Lei Tian,
Michael Hecht,
Artur Yakimovich,
Kristina Monakhova,
Laura Waller,
Ivo F. Sbalzarini,
Christopher A. Metzler,
Mingyang Xie,
Kevin Zhang,
Isaac C. D. Lenton,
Halina Rubinsztein-Dunlop,
Daniel Brunner,
Bijie Bai,
Aydogan Ozcan,
Daniel Midtvedt,
Hao Wang,
Nataša Sladoje,
Joakim Lindblad,
Jason T. Smith,
Marien Ochoa,
Margarida Barroso,
Xavier Intes,
Tong Qiu
, et al. (50 additional authors not shown)
Abstract:
Through digital imaging, microscopy has evolved from primarily being a means for visual observation of life at the micro- and nano-scale, to a quantitative tool with ever-increasing resolution and throughput. Artificial intelligence, deep neural networks, and machine learning are all niche terms describing computational methods that have gained a pivotal role in microscopy-based research over the…
▽ More
Through digital imaging, microscopy has evolved from primarily being a means for visual observation of life at the micro- and nano-scale, to a quantitative tool with ever-increasing resolution and throughput. Artificial intelligence, deep neural networks, and machine learning are all niche terms describing computational methods that have gained a pivotal role in microscopy-based research over the past decade. This Roadmap is written collectively by prominent researchers and encompasses selected aspects of how machine learning is applied to microscopy image data, with the aim of gaining scientific knowledge by improved image quality, automated detection, segmentation, classification and tracking of objects, and efficient merging of information from multiple imaging modalities. We aim to give the reader an overview of the key developments and an understanding of possibilities and limitations of machine learning for microscopy. It will be of interest to a wide cross-disciplinary audience in the physical sciences and life sciences.
△ Less
Submitted 7 March, 2023;
originally announced March 2023.
-
Frequency-domain Learning for Volumetric-based 3D Data Perception
Authors:
Zifan Yu,
Suya You,
Fengbo Ren
Abstract:
Frequency-domain learning draws attention due to its superior tradeoff between inference accuracy and input data size. Frequency-domain learning in 2D computer vision tasks has shown that 2D convolutional neural networks (CNN) have a stationary spectral bias towards low-frequency channels so that high-frequency channels can be pruned with no or little accuracy degradation. However, frequency-domai…
▽ More
Frequency-domain learning draws attention due to its superior tradeoff between inference accuracy and input data size. Frequency-domain learning in 2D computer vision tasks has shown that 2D convolutional neural networks (CNN) have a stationary spectral bias towards low-frequency channels so that high-frequency channels can be pruned with no or little accuracy degradation. However, frequency-domain learning has not been studied in the context of 3D CNNs with 3D volumetric data. In this paper, we study frequency-domain learning for volumetric-based 3D data perception to reveal the spectral bias and the accuracy-input-data-size tradeoff of 3D CNNs. Our study finds that 3D CNNs are sensitive to a limited number of critical frequency channels, especially low-frequency channels. Experiment results show that frequency-domain learning can significantly reduce the size of volumetric-based 3D inputs (based on spectral bias) while achieving comparable accuracy with conventional spatial-domain learning approaches. Specifically, frequency-domain learning is able to reduce the input data size by 98% in 3D shape classification while limiting the average accuracy drop within 2%, and by 98% in the 3D point cloud semantic segmentation with a 1.48% mean-class accuracy improvement while limiting the mean-class IoU loss within 1.55%. Moreover, by learning from higher-resolution 3D data (i.e., 2x of the original image in the spatial domain), frequency-domain learning improves the mean-class accuracy and mean-class IoU by 3.04% and 0.63%, respectively, while achieving an 87.5% input data size reduction in 3D point cloud semantic segmentation.
△ Less
Submitted 20 February, 2023; v1 submitted 16 February, 2023;
originally announced February 2023.
-
LGSQE: Lightweight Generated Sample Quality Evaluatoin
Authors:
Ganning Zhao,
Vasileios Magoulianitis,
Suya You,
C. -C. Jay Kuo
Abstract:
Despite prolific work on evaluating generative models, little research has been done on the quality evaluation of an individual generated sample. To address this problem, a lightweight generated sample quality evaluation (LGSQE) method is proposed in this work. In the training stage of LGSQE, a binary classifier is trained on real and synthetic samples, where real and synthetic data are labeled by…
▽ More
Despite prolific work on evaluating generative models, little research has been done on the quality evaluation of an individual generated sample. To address this problem, a lightweight generated sample quality evaluation (LGSQE) method is proposed in this work. In the training stage of LGSQE, a binary classifier is trained on real and synthetic samples, where real and synthetic data are labeled by 0 and 1, respectively. In the inference stage, the classifier assigns soft labels (ranging from 0 to 1) to each generated sample. The value of soft label indicates the quality level; namely, the quality is better if its soft label is closer to 0. LGSQE can serve as a post-processing module for quality control. Furthermore, LGSQE can be used to evaluate the performance of generative models, such as accuracy, AUC, precision and recall, by aggregating sample-level quality. Experiments are conducted on CIFAR-10 and MNIST to demonstrate that LGSQE can preserve the same performance rank order as that predicted by the Frechet Inception Distance (FID) but with significantly lower complexity.
△ Less
Submitted 8 November, 2022;
originally announced November 2022.
-
Patch-wise Deep Metric Learning for Unsupervised Low-Dose CT Denoising
Authors:
Chanyong Jung,
Joonhyung Lee,
Sunkyoung You,
Jong Chul Ye
Abstract:
The acquisition conditions for low-dose and high-dose CT images are usually different, so that the shifts in the CT numbers often occur. Accordingly, unsupervised deep learning-based approaches, which learn the target image distribution, often introduce CT number distortions and result in detrimental effects in diagnostic performance. To address this, here we propose a novel unsupervised learning…
▽ More
The acquisition conditions for low-dose and high-dose CT images are usually different, so that the shifts in the CT numbers often occur. Accordingly, unsupervised deep learning-based approaches, which learn the target image distribution, often introduce CT number distortions and result in detrimental effects in diagnostic performance. To address this, here we propose a novel unsupervised learning approach for lowdose CT reconstruction using patch-wise deep metric learning. The key idea is to learn embedding space by pulling the positive pairs of image patches which shares the same anatomical structure, and pushing the negative pairs which have same noise level each other. Thereby, the network is trained to suppress the noise level, while retaining the original global CT number distributions even after the image translation. Experimental results confirm that our deep metric learning plays a critical role in producing high quality denoised images without CT number shift.
△ Less
Submitted 13 July, 2022; v1 submitted 5 July, 2022;
originally announced July 2022.
-
Ring deconvolution microscopy: exploiting symmetry for efficient spatially varying aberration correction
Authors:
Amit Kohli,
Anastasios N. Angelopoulos,
David McAllister,
Esther Whang,
Sixian You,
Kyrollos Yanny,
Federico M. Gasparoli,
Bo-Jui Chang,
Reto Fiolka,
Laura Waller
Abstract:
The most ubiquitous form of computational aberration correction for microscopy is deconvolution. However, deconvolution relies on the assumption that the point spread function is the same across the entire field-of-view. This assumption is often inadequate, but space-variant deblurring techniques generally require impractical amounts of calibration and computation. We present a new imaging pipelin…
▽ More
The most ubiquitous form of computational aberration correction for microscopy is deconvolution. However, deconvolution relies on the assumption that the point spread function is the same across the entire field-of-view. This assumption is often inadequate, but space-variant deblurring techniques generally require impractical amounts of calibration and computation. We present a new imaging pipeline that leverages symmetry to provide simple and fast spatially-varying aberration correction. Our ring deconvolution microscopy (RDM) method leverages the rotational symmetry of most microscopes and cameras, and naturally extends to sheet deconvolution in the case of lateral symmetry. We formally derive theory and algorithms for image recovery and additionally propose a neural network based on Seidel coefficients as a fast alternative, as well as extension of RDM to blind deconvolution. We demonstrate significant improvements in speed and image quality as compared to standard deconvolution and existing spatially-varying deconvolution across a diverse range of microscope modalities, including miniature microscopy, multicolor fluorescence microscopy, point-scanning multimode fiber micro-endoscopy, and light-sheet fluorescence microscopy. Our approach enables near-isotropic, subcellular resolution in each of these applications.
△ Less
Submitted 29 April, 2025; v1 submitted 17 June, 2022;
originally announced June 2022.
-
Taylor, Can You Hear Me Now? A Taylor-Unfolding Framework for Monaural Speech Enhancement
Authors:
Andong Li,
Shan You,
Guochen Yu,
Chengshi Zheng,
Xiaodong Li
Abstract:
While the deep learning techniques promote the rapid development of the speech enhancement (SE) community, most schemes only pursue the performance in a black-box manner and lack adequate model interpretability. Inspired by Taylor's approximation theory, we propose an interpretable decoupling-style SE framework, which disentangles the complex spectrum recovery into two separate optimization proble…
▽ More
While the deep learning techniques promote the rapid development of the speech enhancement (SE) community, most schemes only pursue the performance in a black-box manner and lack adequate model interpretability. Inspired by Taylor's approximation theory, we propose an interpretable decoupling-style SE framework, which disentangles the complex spectrum recovery into two separate optimization problems \emph{i.e.}, magnitude and complex residual estimation. Specifically, serving as the 0th-order term in Taylor's series, a filter network is delicately devised to suppress the noise component only in the magnitude domain and obtain a coarse spectrum. To refine the phase distribution, we estimate the sparse complex residual, which is defined as the difference between target and coarse spectra, and measures the phase gap. In this study, we formulate the residual component as the combination of various high-order Taylor terms and propose a lightweight trainable module to replace the complicated derivative operator between adjacent terms. Finally, following Taylor's formula, we can reconstruct the target spectrum by the superimposition between 0th-order and high-order terms. Experimental results on two benchmark datasets show that our framework achieves state-of-the-art performance over previous competing baselines in various evaluation metrics. The source code is available at github.com/Andong-Lispeech/TaylorSENet.
△ Less
Submitted 30 April, 2022;
originally announced May 2022.
-
Aggregated Feasible Region of Heterogeneous Demand-Side Flexible Resources -- Part I: Theoretical Derivation of the Exact Model
Authors:
Yilin Wen,
Zechun Hu,
Shi You,
Xiaoyu Duan
Abstract:
In the first part of the two-part series, the model to describe the exact aggregated feasible region (AFR) of multiple types of demand-side resources is derived. Based on a discrete-time unified individual model of heterogeneous resources, the calculation of AFR is, in fact, a feasible region projection problem. Therefore, the Fourier-Motzkin Elimination (FME) method is used for derivation. By ana…
▽ More
In the first part of the two-part series, the model to describe the exact aggregated feasible region (AFR) of multiple types of demand-side resources is derived. Based on a discrete-time unified individual model of heterogeneous resources, the calculation of AFR is, in fact, a feasible region projection problem. Therefore, the Fourier-Motzkin Elimination (FME) method is used for derivation. By analyzing the redundancy of all possible constraints in the FME process, the mathematical expression and calculation method for the exact AFR is proposed. The number of constraints is linear with the number of resources and is exponential with the number of time intervals, respectively. The computational complexity has been dramatically simplified compared with the original FME. However, the number of constraints in the model is still exponential and cannot be simplified anymore. Hence, In Part II of this paper, several approximation methods are proposed and analyzed in detail.
△ Less
Submitted 9 November, 2021;
originally announced November 2021.
-
Geo-DefakeHop: High-Performance Geographic Fake Image Detection
Authors:
Hong-Shuo Chen,
Kaitai Zhang,
Shuowen Hu,
Suya You,
C. -C. Jay Kuo
Abstract:
A robust fake satellite image detection method, called Geo-DefakeHop, is proposed in this work. Geo-DefakeHop is developed based on the parallel subspace learning (PSL) methodology. PSL maps the input image space into several feature subspaces using multiple filter banks. By exploring response differences of different channels between real and fake images for a filter bank, Geo-DefakeHop learns th…
▽ More
A robust fake satellite image detection method, called Geo-DefakeHop, is proposed in this work. Geo-DefakeHop is developed based on the parallel subspace learning (PSL) methodology. PSL maps the input image space into several feature subspaces using multiple filter banks. By exploring response differences of different channels between real and fake images for a filter bank, Geo-DefakeHop learns the most discriminant channels and uses their soft decision scores as features. Then, Geo-DefakeHop selects a few discriminant features from each filter bank and ensemble them to make a final binary decision. Geo-DefakeHop offers a light-weight high-performance solution to fake satellite images detection. Its model size is analyzed, which ranges from 0.8 to 62K parameters. Furthermore, it is shown by experimental results that it achieves an F1-score higher than 95\% under various common image manipulations such as resizing, compression and noise corruption.
△ Less
Submitted 19 October, 2021;
originally announced October 2021.
-
Use Non-Energy-Curtailment Resources for Primary Frequency Response in Future Low-Inertia Power Grids
Authors:
Shutang You
Abstract:
Power grid primary frequency response will be significantly impaired by Photovoltaic (PV) penetration increase because of the decrease in inertia and governor response. PV inertia and governor emulation requires reserving PV output and leads to solar energy waste. This paper exploits current grid resources and explores energy storage for primary frequency response under high PV penetration at the…
▽ More
Power grid primary frequency response will be significantly impaired by Photovoltaic (PV) penetration increase because of the decrease in inertia and governor response. PV inertia and governor emulation requires reserving PV output and leads to solar energy waste. This paper exploits current grid resources and explores energy storage for primary frequency response under high PV penetration at the interconnection level. Based on the actual models of the U.S. Eastern Interconnection grid and the Texas grid, effects of multiple factors associated with primary frequency response, including the governor ratio, governor deadband, droop rate, and fast load response, are assessed under high PV penetration scenarios. In addition, performance of batteries and supercapacitors using different control strategies is studied in the two interconnections. The paper quantifies the potential of various resources to improve interconnection-level primary frequency response under high PV penetration without curtailing solar output.
△ Less
Submitted 15 March, 2021; v1 submitted 28 January, 2021;
originally announced January 2021.
-
Impact of High Penetration of Inverter-based Generation on Electromechanical Wave Propagation in Power Grids
Authors:
Shutang You
Abstract:
A power system electromechanical wave propagates from the disturbance location to the rest of system, influencing various types of protections. In addition, since more power-electronics-interfaced generation and energy storage devices are being integrated into power systems, electromechanical wave propagation speeds in the future power systems are likely to change accordingly. In this paper, GPS-s…
▽ More
A power system electromechanical wave propagates from the disturbance location to the rest of system, influencing various types of protections. In addition, since more power-electronics-interfaced generation and energy storage devices are being integrated into power systems, electromechanical wave propagation speeds in the future power systems are likely to change accordingly. In this paper, GPS-synchronized measurement data from a wide-area synchrophasor measurement system FNET/GridEye are used to analyze the characteristics of electromechanical wave propagation in the U.S. Eastern Interconnection (EI) system. Afterwards, high levels of photovoltaic (PV) penetration are modeled in the EI to investigate the influences of a typical power-electronics--interfaced resource on the electromechanical wave propagation speed. The result shows a direct correlation between the local penetration level of inverter-based generation and the electromechanical wave propagation speed.
△ Less
Submitted 15 March, 2021; v1 submitted 27 January, 2021;
originally announced January 2021.
-
Determine Disturbance Locations in Power Grids using Bicubic 2D Interpolation on Electromechanical Wave-front Propagation Delay
Authors:
Shutang You
Abstract:
This study presents a method to locate power system disturbance using wide-area synchrophasor measurements. The merits of the proposed method include robustness and easy for visualization. In addition, the proposed method facilitates the calculation of electromechanical wave propagation speed distribution. An example of locating the disturbance and generating the propagation speed distribution is…
▽ More
This study presents a method to locate power system disturbance using wide-area synchrophasor measurements. The merits of the proposed method include robustness and easy for visualization. In addition, the proposed method facilitates the calculation of electromechanical wave propagation speed distribution. An example of locating the disturbance and generating the propagation speed distribution is demonstrated based on FNET/GridEye, a distribution-level wide-area measurement system. Without losing generality, the proposed method can be implemented in any other wide-area measurement systems.
△ Less
Submitted 16 March, 2021; v1 submitted 14 January, 2021;
originally announced January 2021.
-
Adaptive Frequency Response Reserve based on Real-time System Inertia
Authors:
Shutang You
Abstract:
To ensure adequate and economic reserve for primary frequency response in the current and future power system, this paper proposes real-time frequency response reserve (FRR) requirement based on system inertia. This minimum FRR will help power system operators adjust the current frequency response requirement and accommodate more renewable generations while achieving a saving of both energy and fa…
▽ More
To ensure adequate and economic reserve for primary frequency response in the current and future power system, this paper proposes real-time frequency response reserve (FRR) requirement based on system inertia. This minimum FRR will help power system operators adjust the current frequency response requirement and accommodate more renewable generations while achieving a saving of both energy and facility costs. Most importantly, the ability to adaptively vary the FRR will provide the additional agility, resiliency, and reliability to the grid.
△ Less
Submitted 14 January, 2021;
originally announced January 2021.
-
Ambient PMU Data Based System Oscillation Analysis Using Multivariate Empirical Mode Decomposition
Authors:
Shutang You
Abstract:
Wide-area synchrophasor ambient measurements provide a valuable data source for real-time oscillation mode monitoring and analysis. This paper introduces a novel method for identifying inter-area oscillation modes using wide-area ambient measurements. Based on multivariate empirical mode decomposition (MEMD), which can analyze multi-channel non-stationary and nonlinear signals, the proposed method…
▽ More
Wide-area synchrophasor ambient measurements provide a valuable data source for real-time oscillation mode monitoring and analysis. This paper introduces a novel method for identifying inter-area oscillation modes using wide-area ambient measurements. Based on multivariate empirical mode decomposition (MEMD), which can analyze multi-channel non-stationary and nonlinear signals, the proposed method is capable of detecting the common oscillation mode that exists in multiple synchrophasor measurements at low amplitudes. Test results based on two real-world datasets validate the effectiveness of the proposed method.
△ Less
Submitted 1 March, 2021; v1 submitted 12 January, 2021;
originally announced January 2021.
-
Use Energy Storage for Primary Frequency Control in Power Grids
Authors:
Shutang You
Abstract:
Frequency stability of power systems becomes more vulnerable with the increase of solar photovoltaic (PV). Energy storage provides an option to mitigate the impact of high PV penetration. Using the U.S. Eastern Interconnection (EI) and Texas Interconnection (ERCOT) power grid models, this paper investigates the capabilities of using energy storage to improve frequency response under high PV penetr…
▽ More
Frequency stability of power systems becomes more vulnerable with the increase of solar photovoltaic (PV). Energy storage provides an option to mitigate the impact of high PV penetration. Using the U.S. Eastern Interconnection (EI) and Texas Interconnection (ERCOT) power grid models, this paper investigates the capabilities of using energy storage to improve frequency response under high PV penetration. The study result helps to identify the potential and impact factors in utilizing energy storage to improve frequency response in high renewable penetration power grids.
△ Less
Submitted 12 March, 2021; v1 submitted 13 January, 2021;
originally announced January 2021.
-
Quantify Change of Inertia and Its Distribution in High Renewable Power Grids Using PMU
Authors:
Shutang You
Abstract:
This paper proposed an approach to identify the change of inertia distribution in high renewable power systems. Using the footprints of electromechanical wave propagation at the distribution level, this approach provides a new and non-invasive way to aware the system inertia distribution for primary frequency response. Actual measurements and high renewable dynamic models validated effectiveness o…
▽ More
This paper proposed an approach to identify the change of inertia distribution in high renewable power systems. Using the footprints of electromechanical wave propagation at the distribution level, this approach provides a new and non-invasive way to aware the system inertia distribution for primary frequency response. Actual measurements and high renewable dynamic models validated effectiveness of the approach.
△ Less
Submitted 12 March, 2021; v1 submitted 12 January, 2021;
originally announced January 2021.
-
Frequency Response Assessment of U.S. Power Grids in High PV Penetration
Authors:
Shutang You
Abstract:
Nonsynchronous generations such as photovoltaics (PVs) are expected to undermine bulk power systems (BPSs) frequency response at high penetration levels. Though the underlying mechanism has been relatively well understood, the accurate assessment and effective enhancement of the U.S. interconnections frequency response under extra-high PV penetration conditions remains an issue. In this paper, the…
▽ More
Nonsynchronous generations such as photovoltaics (PVs) are expected to undermine bulk power systems (BPSs) frequency response at high penetration levels. Though the underlying mechanism has been relatively well understood, the accurate assessment and effective enhancement of the U.S. interconnections frequency response under extra-high PV penetration conditions remains an issue. In this paper, the industry-provided full-detail interconnection models were further validated by synchrophasor frequency measurements and realistically-projected PV geographic distribution information were used to develop extra-high PV penetration scenarios and dynamic models for the three main U.S. interconnections, including Eastern Interconnection (EI), Western Electricity Coordinating Council (WECC), and Electric Reliability Council of Texas (ERCOT). Up to 65% instantaneous PV and 15% wind penetration were simulated and the frequency response change trend of each U.S. interconnection due to the increasing PV penetration level were examined. Most importantly, the practical solutions to address the declining frequency response were discussed. This paper will provide valuable guidance for policy makers, utility operators and academic researchers not only in the U.S. but also other countries in the world.
△ Less
Submitted 1 March, 2021; v1 submitted 11 January, 2021;
originally announced January 2021.
-
Optimize the Co-expansion of Generation and Transmission Considering Wind Power in the US Eastern Interconnection
Authors:
Shutang You
Abstract:
This paper studies the generation and transmission expansion co-optimization problem with a high wind power penetration rate in large-scale power grids. In this paper, generation and transmission expansion co-optimization is modeled as a mixed-integer programming (MIP) problem. A scenario creation method is proposed to capture the variation and correlation of both load and wind power across region…
▽ More
This paper studies the generation and transmission expansion co-optimization problem with a high wind power penetration rate in large-scale power grids. In this paper, generation and transmission expansion co-optimization is modeled as a mixed-integer programming (MIP) problem. A scenario creation method is proposed to capture the variation and correlation of both load and wind power across regions for large-scale power grids. Obtained scenarios that represent load and wind uncertainties can be easily introduced into the MIP problem and then solved to obtain the co-optimized generation and transmission expansion plan. Simulation results show that the proposed planning model and the scenario creation method can improve the expansion result significantly through modeling more detailed information of wind and load variation among regions in the US EI system. The improved expansion plan that combines generation and transmission will aid system planners and policy makers to maximize the social welfare in large-scale power grids.
△ Less
Submitted 1 March, 2021; v1 submitted 11 January, 2021;
originally announced January 2021.
-
Impact of High PV Penetration on the Inter-area Oscillations in the U.S. Eastern Interconnection
Authors:
Shutang You
Abstract:
This study explores the impact of high PV penetration on the inter-area oscillation modes of large-scale power grids. A series of dynamic models with various PV penetration levels are developed based on a detailed model representing the U.S. Eastern Interconnection (EI). Transient simulations are performed to investigate the change of inter-area oscillation modes with PV penetration. The impact of…
▽ More
This study explores the impact of high PV penetration on the inter-area oscillation modes of large-scale power grids. A series of dynamic models with various PV penetration levels are developed based on a detailed model representing the U.S. Eastern Interconnection (EI). Transient simulations are performed to investigate the change of inter-area oscillation modes with PV penetration. The impact of PV control strategies and parameter settings on inter-area oscillations is studied. This study finds that as PV increases, the damping of the dominant oscillation mode decreases monotonically. It is also observed that the mode shape varies with the PV control strategy and new oscillation modes may emerge under inappropriate parameter settings in PV plant controls.
△ Less
Submitted 1 March, 2021; v1 submitted 8 January, 2021;
originally announced January 2021.
-
A Quantum Computing Framework for Complex System Reliability Assessment
Authors:
Shutang You
Abstract:
This paper proposed a framework based on quantum computing for reliability assessment of complex systems. The 'Quantum Twin' concept was also proposed. The framework can be used to accelerate the reliability assessment of large-scale complex systems, which could take much computation time for classical computers to achieve accurate results. Power system is used as an example of complex systems to…
▽ More
This paper proposed a framework based on quantum computing for reliability assessment of complex systems. The 'Quantum Twin' concept was also proposed. The framework can be used to accelerate the reliability assessment of large-scale complex systems, which could take much computation time for classical computers to achieve accurate results. Power system is used as an example of complex systems to illustrate the framework.
△ Less
Submitted 6 April, 2021; v1 submitted 7 December, 2020;
originally announced December 2020.
-
Locate the Source of Resonance-Involved Forced Oscillation in Power Systems Based on Mode Shape Analysis
Authors:
Shutang You
Abstract:
This paper proposed a new method to locate the source of forced oscillation that involves resonance with natural oscillation modes. The new method is based on comparing the oscillation mode shape of the forced oscillation with that of the natural oscillation that the forced oscillation resonating with. The location that has the largest angle difference between the forced oscillation mode and the n…
▽ More
This paper proposed a new method to locate the source of forced oscillation that involves resonance with natural oscillation modes. The new method is based on comparing the oscillation mode shape of the forced oscillation with that of the natural oscillation that the forced oscillation resonating with. The location that has the largest angle difference between the forced oscillation mode and the natural oscillation mode usually indicates the location of the driving force in forced oscillations. Some examples in actual U.S. EI system verified this approach.
△ Less
Submitted 6 April, 2021; v1 submitted 24 November, 2020;
originally announced November 2020.
-
Fine Perceptive GANs for Brain MR Image Super-Resolution in Wavelet Domain
Authors:
Senrong You,
Yong Liu,
Baiying Lei,
Shuqiang Wang
Abstract:
Magnetic resonance imaging plays an important role in computer-aided diagnosis and brain exploration. However, limited by hardware, scanning time and cost, it's challenging to acquire high-resolution (HR) magnetic resonance (MR) image clinically. In this paper, fine perceptive generative adversarial networks (FP-GANs) is proposed to produce HR MR images from low-resolution counterparts. It can cop…
▽ More
Magnetic resonance imaging plays an important role in computer-aided diagnosis and brain exploration. However, limited by hardware, scanning time and cost, it's challenging to acquire high-resolution (HR) magnetic resonance (MR) image clinically. In this paper, fine perceptive generative adversarial networks (FP-GANs) is proposed to produce HR MR images from low-resolution counterparts. It can cope with the detail insensitive problem of the existing super-resolution model in a divide-and-conquer manner. Specifically, FP-GANs firstly divides an MR image into low-frequency global approximation and high-frequency anatomical texture in wavelet domain. Then each sub-band generative adversarial network (sub-band GAN) conquers the super-resolution procedure of each single sub-band image. Meanwhile, sub-band attention is deployed to tune focus between global and texture information. It can focus on sub-band images instead of feature maps to further enhance the anatomical reconstruction ability of FP-GANs. In addition, inverse discrete wavelet transformation (IDWT) is integrated into model for taking the reconstruction of whole image into account. Experiments on MultiRes_7T dataset demonstrate that FP-GANs outperforms the competing methods quantitatively and qualitatively.
△ Less
Submitted 8 November, 2020;
originally announced November 2020.
-
Large-scale Interconnection Power System Model Sanity Check, Tuning, and Validation for Frequency Response Study
Authors:
Shutang You,
Yilu Liu
Abstract:
The quality and accuracy of power system models is critical for simulation-based studies, especially for studying actual stability issues in large-scale systems. With the deployment of wide-area monitoring systems (WAMSs), the high-reporting-rate frequency measurement provides a trustworthy ground truth for validating models in frequency response studies. This paper documented an effort to check,…
▽ More
The quality and accuracy of power system models is critical for simulation-based studies, especially for studying actual stability issues in large-scale systems. With the deployment of wide-area monitoring systems (WAMSs), the high-reporting-rate frequency measurement provides a trustworthy ground truth for validating models in frequency response studies. This paper documented an effort to check, tune, and validate the U.S. power system model based on a WAMS called FNET/GridEye. Four metrics are used to quantitatively compare the simulation results and the actual measurement, including frequency nadir, RoCoF, settling frequency and settling time. After tuning governor deadband and the governor ratio, the model frequency response shows significant improvement and matches well with the event measurement data. This work serves as an example for tuning and validating large-scale power system models.
△ Less
Submitted 10 April, 2021; v1 submitted 26 October, 2020;
originally announced October 2020.
-
Wind Power Transmission System Integration -- a Case Study of China Wind Power Base
Authors:
Jianxue Wang,
Shutang You,
Xingzhong Bai,
Mingqiao Peng
Abstract:
Due to a series of supporting policies in recent years, China wind power has developed rapidly through a large-scale and centralized mode. This paper analyzes the two major concerns faced by wind power development in China: wind generation reliability and wind energy balancing. More specifically, wind farm tripping-off-grid incidents and wind power curtailment issues, which caused huge economical…
▽ More
Due to a series of supporting policies in recent years, China wind power has developed rapidly through a large-scale and centralized mode. This paper analyzes the two major concerns faced by wind power development in China: wind generation reliability and wind energy balancing. More specifically, wind farm tripping-off-grid incidents and wind power curtailment issues, which caused huge economical loss, are investigated in details. Based on operation experience of large wind power bases, technical recommendations and economic incentives are proposed to improve wind power integration and power grid reliability. As a summary and outlook of wind power development in China, this paper provides a reference on future wind power development for other countries.
△ Less
Submitted 10 April, 2021; v1 submitted 22 October, 2020;
originally announced October 2020.
-
Frequency Response Characteristic (FRC) Curve and Fast Frequency Response Assessment in High Renewable Power Systems
Authors:
Shutang You
Abstract:
This paper introduces a frequency response characteristic (FRC) curve and its application in high renewable power systems. In addition, the paper presents a method for fast frequency response assessment and frequency nadir prediction without performing dynamic simulations using detailed models. The proposed FRC curve and fast frequency response assessment method are useful for operators to underst…
▽ More
This paper introduces a frequency response characteristic (FRC) curve and its application in high renewable power systems. In addition, the paper presents a method for fast frequency response assessment and frequency nadir prediction without performing dynamic simulations using detailed models. The proposed FRC curve and fast frequency response assessment method are useful for operators to understand frequency response performance of high renewable systems in real time.
△ Less
Submitted 10 April, 2021; v1 submitted 21 October, 2020;
originally announced October 2020.
-
Solar PV Frequency Control in the U.S. EI and ERCOT Interconnections -- Case Studies and Recommendations
Authors:
Shutang You
Abstract:
This paper studied the solar PV frequency control in the U.S. Eastern Interconnection (EI) and Texas Interconnection (ERCOT) systems. The studied frequency control approaches include droop frequency control, inertia control, and droop-inertia-combined frequency control. The control effects of different frequency controls of PV in the EI and ERCOT are studied using actual high PV penetration interc…
▽ More
This paper studied the solar PV frequency control in the U.S. Eastern Interconnection (EI) and Texas Interconnection (ERCOT) systems. The studied frequency control approaches include droop frequency control, inertia control, and droop-inertia-combined frequency control. The control effects of different frequency controls of PV in the EI and ERCOT are studied using actual high PV penetration interconnection grid models to provide suggestions to the future revision of future PV frequency control standards.
△ Less
Submitted 21 April, 2021; v1 submitted 21 October, 2020;
originally announced October 2020.
-
Calculate Center-of-Inertia Frequency and System RoCoF Using PMU Data
Authors:
Shutang You,
Hongyu Li,
Shengyuan Liu,
Kaiqi Sun,
Weikang Wang,
Wei Qiu,
Yilu Liu
Abstract:
The power system frequency is important for the system overall stability. However, there does not exist a single measurement point of the system frequency due to the distributed nature of the system inertia and the small inconsistency of different generator rotor electrical speeds in one synchronized system. This paper proposed a new approach to calculate the system center-of-inertia (COI) frequen…
▽ More
The power system frequency is important for the system overall stability. However, there does not exist a single measurement point of the system frequency due to the distributed nature of the system inertia and the small inconsistency of different generator rotor electrical speeds in one synchronized system. This paper proposed a new approach to calculate the system center-of-inertia (COI) frequency and the rate-of-change-of-frequency (RoCoF) more accurately using PMU data at multiple locations. The COI frequency and the RoCoF value were further used to assist fast estimation of the imbalance MW amount of a frequency event. Test results using actual measurements in the U.S. Eastern Interconnection system validated the effectiveness of the proposed method.
△ Less
Submitted 21 April, 2021; v1 submitted 21 October, 2020;
originally announced October 2020.
-
A Simulation-based Education Approach for the Electromagnetic and Electromechanical Transient Waves in Power Systems
Authors:
Abdulelah Alharbi,
Shutang You
Abstract:
Power systems usually go through electromagnetic and electromechanical transient processes after different disturbances. Learning the characteristics and the differences between them are important but not easy for students majoring in power systems. This paper presents a simulation-based approach to comprehensively study the two types of transient waves, constituting the experimental part of the p…
▽ More
Power systems usually go through electromagnetic and electromechanical transient processes after different disturbances. Learning the characteristics and the differences between them are important but not easy for students majoring in power systems. This paper presents a simulation-based approach to comprehensively study the two types of transient waves, constituting the experimental part of the power system transient and stability course. In this approach, three models with different levels of complexity are developed to simultaneously show the two types of transient waves in the time domain. The developed models are then demonstrated as testbeds for investigating various aspects related to the two types of transient, such as waveforms induced by different disturbances, influencing factors on the propagation speed, and the interaction between incident waves and the reflective waves. In addition, a theory-to-practice engineering research process is demonstrated through developing a power system event-location application, which is inspired by electromechanical wave propagation study. The proposed education process and models at various complexity levels provide a creative and interactive way for power system transients and dynamics study.
△ Less
Submitted 29 January, 2022; v1 submitted 21 October, 2020;
originally announced October 2020.
-
Photovoltaic (PV) Virtual Inertia and Fast Frequency Regulation in High PV Power Grids
Authors:
Shutang You
Abstract:
This paper studies the frequency response using PV. Multiple control strategies are considered and simulated in the high PV ERCOT model, including inertia control, synthetic governor control, and AGC control. The impact of different parameters in PV inertia control and their correlation and impact on frequency response are analyzed. The simulation results show that PV farm has potential to provide…
▽ More
This paper studies the frequency response using PV. Multiple control strategies are considered and simulated in the high PV ERCOT model, including inertia control, synthetic governor control, and AGC control. The impact of different parameters in PV inertia control and their correlation and impact on frequency response are analyzed. The simulation results show that PV farm has potential to provide multiple types of grid service to support system frequency. This paper also proposed a distributed fast frequency control approach that can better leverage the PV headroom reserve to improve the system frequency nadir after contingencies.
△ Less
Submitted 29 January, 2022; v1 submitted 21 October, 2020;
originally announced October 2020.
-
Frequency Response Study on the ERCOT under High Photovoltaic (PV) Penetration Conditions
Authors:
Xuemeng Zhang,
Shutang You,
Yong Liu,
Yilu Liu
Abstract:
Solar photovoltaic (PV) generation is growing rapidly around the world. However, PV generation, based on inverter, is fundamentally different from conventional synchronous generators. It is of vital importance to understand the impacts of increased penetration of PV generation on power system dynamic performance. This paper investigates frequency response of the Electric Reliability Council of Tex…
▽ More
Solar photovoltaic (PV) generation is growing rapidly around the world. However, PV generation, based on inverter, is fundamentally different from conventional synchronous generators. It is of vital importance to understand the impacts of increased penetration of PV generation on power system dynamic performance. This paper investigates frequency response of the Electric Reliability Council of Texas (ERCOT) with high PV penetration in the future year. In this work, a realistic baseline dynamic model is validated using synchrophasor measurements. Then, dynamic simulation is performed to evaluate the impacts of high PV generation on frequency response.
△ Less
Submitted 21 April, 2021; v1 submitted 21 October, 2020;
originally announced October 2020.
-
Compressive Sensing Based Situational Awareness and Sensor Placement for DC Microgrids with Relatively Fixed Operation Patterns
Authors:
Shutang You,
Yilu Liu
Abstract:
This paper proposes a DC microgrid state estimation and sensor placement method based on compressive sensing. Formulations of various types of measurements and components are developed under the proposed framework. A measurement placing strategy to minimize the coherence of the measurement matrix and thus increase estimation accuracy is presented. Simulation results show that the proposed state es…
▽ More
This paper proposes a DC microgrid state estimation and sensor placement method based on compressive sensing. Formulations of various types of measurements and components are developed under the proposed framework. A measurement placing strategy to minimize the coherence of the measurement matrix and thus increase estimation accuracy is presented. Simulation results show that the proposed state estimation and sensor placing approach can effectively reduce the number of sensors to achieve a certain level of estimation accuracy.
△ Less
Submitted 29 January, 2022; v1 submitted 21 October, 2020;
originally announced October 2020.
-
Build Smart Grids on Artificial Intelligence -- A Real-world Example
Authors:
Shutang You,
Yilu Liu,
Hongyu Li,
Shengyuan Liu,
Kaiqi Sun,
Yinfeng Zhao,
Huangqing Xiao,
Jiaojiao Dong,
Yu Su,
Weikang Wang,
Yi Cui
Abstract:
Power grid data are going big with the deployment of various sensors. The big data in power grids creates huge opportunities for applying artificial intelligence technologies to improve resilience and reliability. This paper introduces multiple real-world applications based on artificial intelligence to improve power grid situational awareness and resilience. These applications include event ident…
▽ More
Power grid data are going big with the deployment of various sensors. The big data in power grids creates huge opportunities for applying artificial intelligence technologies to improve resilience and reliability. This paper introduces multiple real-world applications based on artificial intelligence to improve power grid situational awareness and resilience. These applications include event identification, inertia estimation, event location and magnitude estimation, data authentication, control, and stability assessment. These applications are operating on a real-world system called FNET-GridEye, which is a wide-area measurement network and arguably the world-largest cyber-physical system that collects power grid big data. These applications showed much better performance compared with conventional approaches and accomplished new tasks that are impossible to realized using conventional technologies. These encouraging results demonstrate that combining power grid big data and artificial intelligence can uncover and capture the non-linear correlation between power grid data and its stabilities indices and will potentially enable many advanced applications that can significantly improve power grid resilience.
△ Less
Submitted 3 February, 2022; v1 submitted 21 October, 2020;
originally announced October 2020.
-
Large-Scale High PV Power Grid Dynamic Model Development -- A Case Study on the U.S. Eastern Interconnection
Authors:
Shutang You
Abstract:
Power systems are undergoing a transformation toward a low-carbon non-synchronous generation portfolio. A major concern for system planners and operators is the system dynamics in the high renewable penetration future. Because of the scale of the system and numerous components involved, it is extremely difficult to develop high PV dynamic models based upon actual power system models. The main cont…
▽ More
Power systems are undergoing a transformation toward a low-carbon non-synchronous generation portfolio. A major concern for system planners and operators is the system dynamics in the high renewable penetration future. Because of the scale of the system and numerous components involved, it is extremely difficult to develop high PV dynamic models based upon actual power system models. The main contribution of this paper is providing an example of developing high PV penetration models based on the validated dynamic model of an actual large-scale power grid - the U.S. Eastern Interconnection system. The displacement of conventional generators by PV is realized by optimization. Combining the PV distribution optimization and the validated dynamic model information, this approach avoids the uncertainties brought about by transmission planning. As the existing dynamic models can be validated by measurements, this approach improves the credibility of the high PV models in representing future power grids. This generic approach can be applied to develop high PV dynamic models for other actual large-scale systems.
△ Less
Submitted 29 January, 2022; v1 submitted 21 October, 2020;
originally announced October 2020.
-
Adaptive Frequency-Regulation Demand Response Using Substation Solar Irradiance Measurement in High-PV Power Systems
Authors:
Shutang You
Abstract:
This letter proposes a distributed and adaptive demand response approach for primary frequency regulation in high-PV power systems. Using solar irradiance measurement at substations, the proposed approach allows accurate estimation of real-time system inertia of high-PV systems, thus facilitating the estimation of power imbalance after a contingency. The test results from the U.S. Electric Reliabi…
▽ More
This letter proposes a distributed and adaptive demand response approach for primary frequency regulation in high-PV power systems. Using solar irradiance measurement at substations, the proposed approach allows accurate estimation of real-time system inertia of high-PV systems, thus facilitating the estimation of power imbalance after a contingency. The test results from the U.S. Electric Reliability Council of Texas (ERCOT) high-PV penetration models validated its effectiveness.
△ Less
Submitted 29 January, 2022; v1 submitted 21 October, 2020;
originally announced October 2020.
-
Multi-Objective Predictive Taxi Dispatch via Network Flow Optimization
Authors:
Beomjun Kim,
Jeongho Kim,
Subin Huh,
Seungil You,
Insoon Yang
Abstract:
In this paper, we discuss a large-scale fleet management problem in a multi-objective setting. We aim to seek a receding horizon taxi dispatch solution that serves as many ride requests as possible while minimizing the cost of relocating vehicles. To obtain the desired solution, we first convert the multi-objective taxi dispatch problem into a network flow problem, which can be solved using the cl…
▽ More
In this paper, we discuss a large-scale fleet management problem in a multi-objective setting. We aim to seek a receding horizon taxi dispatch solution that serves as many ride requests as possible while minimizing the cost of relocating vehicles. To obtain the desired solution, we first convert the multi-objective taxi dispatch problem into a network flow problem, which can be solved using the classical minimum cost maximum flow (MCMF) algorithm. We show that a solution obtained using the MCMF algorithm is integer-valued; thus, it does not require any additional rounding procedure that may introduce undesirable numerical errors. Furthermore, we prove the time-greedy property of the proposed solution, which justifies the use of receding horizon optimization. For computational efficiency, we propose a linear programming method to obtain an optimal solution in near real time. The results of our simulation studies using real-world data for the metropolitan area of Seoul, South Korea indicate that the performance of the proposed predictive method is almost as good as that of the oracle that foresees the future.
△ Less
Submitted 6 May, 2020;
originally announced May 2020.
-
Unsupervised Lesion Detection via Image Restoration with a Normative Prior
Authors:
Xiaoran Chen,
Suhang You,
Kerem Can Tezcan,
Ender Konukoglu
Abstract:
Unsupervised lesion detection is a challenging problem that requires accurately estimating normative distributions of healthy anatomy and detecting lesions as outliers without training examples. Recently, this problem has received increased attention from the research community following the advances in unsupervised learning with deep learning. Such advances allow the estimation of high-dimensiona…
▽ More
Unsupervised lesion detection is a challenging problem that requires accurately estimating normative distributions of healthy anatomy and detecting lesions as outliers without training examples. Recently, this problem has received increased attention from the research community following the advances in unsupervised learning with deep learning. Such advances allow the estimation of high-dimensional distributions, such as normative distributions, with higher accuracy than previous methods.The main approach of the recently proposed methods is to learn a latent-variable model parameterized with networks to approximate the normative distribution using example images showing healthy anatomy, perform prior-projection, i.e. reconstruct the image with lesions using the latent-variable model, and determine lesions based on the differences between the reconstructed and original images. While being promising, the prior-projection step often leads to a large number of false positives. In this work, we approach unsupervised lesion detection as an image restoration problem and propose a probabilistic model that uses a network-based prior as the normative distribution and detect lesions pixel-wise using MAP estimation. The probabilistic model punishes large deviations between restored and original images, reducing false positives in pixel-wise detections. Experiments with gliomas and stroke lesions in brain MRI using publicly available datasets show that the proposed approach outperforms the state-of-the-art unsupervised methods by a substantial margin, +0.13 (AUC), for both glioma and stroke detection. Extensive model analysis confirms the effectiveness of MAP-based image restoration.
△ Less
Submitted 30 April, 2020;
originally announced May 2020.
-
PixelHop++: A Small Successive-Subspace-Learning-Based (SSL-based) Model for Image Classification
Authors:
Yueru Chen,
Mozhdeh Rouhsedaghat,
Suya You,
Raghuveer Rao,
C. -C. Jay Kuo
Abstract:
The successive subspace learning (SSL) principle was developed and used to design an interpretable learning model, known as the PixelHop method,for image classification in our prior work. Here, we propose an improved PixelHop method and call it PixelHop++. First, to make the PixelHop model size smaller, we decouple a joint spatial-spectral input tensor to multiple spatial tensors (one for each spe…
▽ More
The successive subspace learning (SSL) principle was developed and used to design an interpretable learning model, known as the PixelHop method,for image classification in our prior work. Here, we propose an improved PixelHop method and call it PixelHop++. First, to make the PixelHop model size smaller, we decouple a joint spatial-spectral input tensor to multiple spatial tensors (one for each spectral component) under the spatial-spectral separability assumption and perform the Saab transform in a channel-wise manner, called the channel-wise (c/w) Saab transform.Second, by performing this operation from one hop to another successively, we construct a channel-decomposed feature tree whose leaf nodes contain features of one dimension (1D). Third, these 1D features are ranked according to their cross-entropy values, which allows us to select a subset of discriminant features for image classification. In PixelHop++, one can control the learning model size of fine-granularity,offering a flexible tradeoff between the model size and the classification performance. We demonstrate the flexibility of PixelHop++ on MNIST, Fashion MNIST, and CIFAR-10 three datasets.
△ Less
Submitted 8 February, 2020;
originally announced February 2020.
-
A Convex Approach to Sparse H infinity Analysis & Synthesis
Authors:
Seungil You,
Nikolai Matni
Abstract:
In this paper, we propose a new robust analysis tool motivated by large-scale systems. The H infinity norm of a system measures its robustness by quantifying the worst-case behavior of a system perturbed by a unit-energy disturbance. However, the disturbance that induces such worst-case behavior requires perfect coordination among all disturbance channels. Given that many systems of interest, such…
▽ More
In this paper, we propose a new robust analysis tool motivated by large-scale systems. The H infinity norm of a system measures its robustness by quantifying the worst-case behavior of a system perturbed by a unit-energy disturbance. However, the disturbance that induces such worst-case behavior requires perfect coordination among all disturbance channels. Given that many systems of interest, such as the power grid, the internet and automated vehicle platoons, are large-scale and spatially distributed, such coordination may not be possible, and hence the H infinity norm, used as a measure of robustness, may be too conservative. We therefore propose a cardinality constrained variant of the H infinity norm in which an adversarial disturbance can use only a limited number of channels. As this problem is inherently combinatorial, we present a semidefinite programming (SDP) relaxation based on the l1 norm that yields an upper bound on the cardinality constrained robustness problem. We further propose a simple rounding heuristic based on the optimal solution of SDP relaxation which provides a lower bound. Motivated by privacy in large-scale systems, we also extend these relaxations to computing the minimum gain of a system subject to a limited number of inputs. Finally, we also present a SDP based optimal controller synthesis method for minimizing the SDP relaxation of our novel robustness measure. The effectiveness of our semidefinite relaxation is demonstrated through numerical examples.
△ Less
Submitted 8 July, 2015;
originally announced July 2015.
-
Primal robustness and semidefinite cones
Authors:
Seungil You,
Ather Gattami,
John C. Doyle
Abstract:
This paper reformulates and streamlines the core tools of robust stability and performance for LTI systems using now-standard methods in convex optimization. In particular, robustness analysis can be formulated directly as a primal convex (semidefinite program or SDP) optimization problem using sets of gramians whose closure is a semidefinite cone. This allows various constraints such as structure…
▽ More
This paper reformulates and streamlines the core tools of robust stability and performance for LTI systems using now-standard methods in convex optimization. In particular, robustness analysis can be formulated directly as a primal convex (semidefinite program or SDP) optimization problem using sets of gramians whose closure is a semidefinite cone. This allows various constraints such as structured uncertainty to be included directly, and worst-case disturbances and perturbations constructed directly from the primal variables. Well known results such as the KYP lemma and various scaled small gain tests can also be obtained directly through standard SDP duality. To readers familiar with robustness and SDPs, the framework should appear obvious, if only in retrospect. But this is also part of its appeal and should enhance pedagogy, and we hope suggest new research. There is a key lemma proving closure of a grammian that is also obvious but our current proof appears unnecessarily cumbersome, and a final aim of this paper is to enlist the help of experts in robust control and convex optimization in finding simpler alternatives.
△ Less
Submitted 25 March, 2015;
originally announced March 2015.