Showing 1–45 of 45 results for author: Kundu, S

KneeXNeT: An Ensemble-Based Approach for Knee Radiographic Evaluation

Authors: Nicharee Srikijkasemwat, Soumya Snigdha Kundu, Fuping Wu, Bartlomiej W. Papiez

Abstract: Knee osteoarthritis (OA) is the most common joint disorder and a leading cause of disability. Diagnosing OA severity typically requires expert assessment of X-ray images and is commonly based on the Kellgren-Lawrence grading system, a time-intensive process. This study aimed to develop an automated deep learning model to classify knee OA severity, reducing the need for expert evaluation. First, we… ▽ More Knee osteoarthritis (OA) is the most common joint disorder and a leading cause of disability. Diagnosing OA severity typically requires expert assessment of X-ray images and is commonly based on the Kellgren-Lawrence grading system, a time-intensive process. This study aimed to develop an automated deep learning model to classify knee OA severity, reducing the need for expert evaluation. First, we evaluated ten state-of-the-art deep learning models, achieving a top accuracy of 0.69 with individual models. To address class imbalance, we employed weighted sampling, improving accuracy to 0.70. We further applied Smooth-GradCAM++ to visualize decision-influencing regions, enhancing the explainability of the best-performing model. Finally, we developed ensemble models using majority voting and a shallow neural network. Our ensemble model, KneeXNet, achieved the highest accuracy of 0.72, demonstrating its potential as an automated tool for knee OA assessment. △ Less

Submitted 10 December, 2024; originally announced December 2024.

Comments: 10 pages, 5 figures, accepted by MICAD 2024

Advancing Cyber-Attack Detection in Power Systems: A Comparative Study of Machine Learning and Graph Neural Network Approaches

Authors: Tianzhixi Yin, Syed Ahsan Raza Naqvi, Sai Pushpak Nandanoori, Soumya Kundu

Abstract: This paper explores the detection and localization of cyber-attacks on time-series measurements data in power systems, focusing on comparing conventional machine learning (ML) like k-means, deep learning method like autoencoder, and graph neural network (GNN)-based techniques. We assess the detection accuracy of these approaches and their potential to pinpoint the locations of specific sensor meas… ▽ More This paper explores the detection and localization of cyber-attacks on time-series measurements data in power systems, focusing on comparing conventional machine learning (ML) like k-means, deep learning method like autoencoder, and graph neural network (GNN)-based techniques. We assess the detection accuracy of these approaches and their potential to pinpoint the locations of specific sensor measurements under attack. Given the demonstrated success of GNNs in other time-series anomaly detection applications, we aim to evaluate their performance within the context of power systems cyber-attacks on sensor measurements. Utilizing the IEEE 68-bus system, we simulated four types of false data attacks, including scaling attacks, additive attacks, and their combinations, to test the selected approaches. Our results indicate that GNN-based methods outperform k-means and autoencoder in detection. Additionally, GNNs show promise in accurately localizing attacks for simple scenarios, although they still face challenges in more complex cases, especially ones that involve combinations of scaling and additive attacks. △ Less

Submitted 4 November, 2024; originally announced November 2024.

Emotion-Guided Image to Music Generation

Authors: Souraja Kundu, Saket Singh, Yuji Iwahori

Abstract: Generating music from images can enhance various applications, including background music for photo slideshows, social media experiences, and video creation. This paper presents an emotion-guided image-to-music generation framework that leverages the Valence-Arousal (VA) emotional space to produce music that aligns with the emotional tone of a given image. Unlike previous models that rely on contr… ▽ More Generating music from images can enhance various applications, including background music for photo slideshows, social media experiences, and video creation. This paper presents an emotion-guided image-to-music generation framework that leverages the Valence-Arousal (VA) emotional space to produce music that aligns with the emotional tone of a given image. Unlike previous models that rely on contrastive learning for emotional consistency, the proposed approach directly integrates a VA loss function to enable accurate emotional alignment. The model employs a CNN-Transformer architecture, featuring pre-trained CNN image feature extractors and three Transformer encoders to capture complex, high-level emotional features from MIDI music. Three Transformer decoders refine these features to generate musically and emotionally consistent MIDI sequences. Experimental results on a newly curated emotionally paired image-MIDI dataset demonstrate the proposed model's superior performance across metrics such as Polyphony Rate, Pitch Entropy, Groove Consistency, and loss convergence. △ Less

Submitted 29 October, 2024; originally announced October 2024.

Comments: 2024 6th Asian Digital Image Processing Conference

Empowering the Grid: Decentralized Autonomous Control for Effective Utilization and Resilience

Authors: Sai Pushpak Nandanoori, Alok Kumar Bharati, Subhrajit Sinha, Soumya Kundu, Veronica Adetola, Kevin Schneider

Abstract: With the emergence of low-inertia microgrids powered by inverter-based generation, there remains a concern about the operational resilience of these systems. Grid-forming inverters (GFMs), enabled by various device-level (primary) and system-level (secondary) control methods, are poised to play a significant role in achieving certain operational objectives, such as the effective utilization of cle… ▽ More With the emergence of low-inertia microgrids powered by inverter-based generation, there remains a concern about the operational resilience of these systems. Grid-forming inverters (GFMs), enabled by various device-level (primary) and system-level (secondary) control methods, are poised to play a significant role in achieving certain operational objectives, such as the effective utilization of clean energy resources while maintaining stability. However, despite the recent advances in GFMs, there is a lack of suitable controls that can ascertain resilience-constrained operations, like maintaining critical operational safety limits during transients under various cyber-physical disruptions. In this work, we develop decentralized autonomous controllers (DACs) that enforce resilience-constrained operation via local, minimally invasive adjustments (e.g., changes in set-points) while co-existing within the hierarchy of existing (primary and secondary) controls. The DACs work autonomously by sensing only local GFM measurements and act only when operational resilience constraints are violated. The proposed DAC scheme is computationally efficient (only algebraic computations), which enables fast, real-time execution and demonstrates the efficacy of the proposed control framework on GridLAB-D-HELICS-based control-grid co-simulations on the IEEE 123-node networked microgrid. Finally, we show how the developed DACs empower the grid by utilizing the available resources entirely to ensure resilience (maintain frequency safe limits). △ Less

Submitted 22 October, 2024; originally announced October 2024.

Comments: This paper is currently under review in a journal

Frequency Control and Disturbance Containment Using Grid-Forming Embedded Storage Networks

Authors: Kaustav Chatterjee, Ramij Raja Hossain, Sai Pushpak Nandanoori, Soumya Kundu, Diane Baldwin, Ronald Melton

Abstract: The paper discusses fast frequency control in bulk power systems using embedded networks of grid-forming energy storage resources. Differing from their traditional roles of regulating reserves, the storage resources in this work operate as fast-acting grid assets shaping transient dynamics. The storage resources in the network are autonomously controlled using local measurements for distributed fr… ▽ More The paper discusses fast frequency control in bulk power systems using embedded networks of grid-forming energy storage resources. Differing from their traditional roles of regulating reserves, the storage resources in this work operate as fast-acting grid assets shaping transient dynamics. The storage resources in the network are autonomously controlled using local measurements for distributed frequency support during disturbance events. Further, the grid-forming inverter systems interfacing with the storage resources, are augmented with fast-acting safety controls designed to contain frequency transients within a prescribed tolerance band. The control action, derived from the storage network, improves the frequency nadirs in the system and prevents the severity of a disturbance from propagating far from the source. The paper also presents sensitivity studies to evaluate the impacts of storage capacity and inverter controller parameters on the dynamic performance of frequency control and disturbance localization. The performance of the safety-constrained grid-forming control is also compared with the more common grid-following control. The results are illustrated through case studies on an IEEE test system. △ Less

Submitted 18 October, 2024; originally announced October 2024.

Comments: accepted at the IEEE PES Electrical Energy Storage Applications and Technologies Conference (EESAT)

Report number: PNNL-SA-203361

Coordinated Frequency Regulation in Grid-Forming Storage Network via Safety-Consensus

Authors: Ramij Raja Hossain, Kaustav Chatterjee, Sai Pushpak Nandanoori, Soumya Kundu, Laurentiu Marinovici, Karan Kalsi, Diane Baldwin

Abstract: Inverter-based storages are poised to play a prominent role in future power grids with massive renewable generation. Grid-forming inverters (GFMs) are emerging as a dominant technology with synchronous generators (SG)-like characteristics through primary control loops. Advanced secondary control schemes, e.g., consensus algorithms, allow GFM-interfaced storage units to participate in frequency reg… ▽ More Inverter-based storages are poised to play a prominent role in future power grids with massive renewable generation. Grid-forming inverters (GFMs) are emerging as a dominant technology with synchronous generators (SG)-like characteristics through primary control loops. Advanced secondary control schemes, e.g., consensus algorithms, allow GFM-interfaced storage units to participate in frequency regulations and restore nominal frequency following grid disturbances. However, it is imperative to ensure transient frequency excursions do not violate critical safety limits while the grid transitions from pre- to post-disturbance operating point. This paper presents a hierarchical safety-enforced consensus method -- combining a device-layer (decentralized) transient safety filter with a secondary-layer (distributed) consensus coordination -- to achieve three distinct objectives: limiting transient frequency excursions to safe limits, minimizing frequency deviations from nominal, and ensuring coordinated power sharing among GFM-storage units. The proposed hierarchical (two-layered) safety-consensus technique is illustrated using a GFM-interfaced storage network on an IEEE 68-bus system under multiple grid transient scenarios. △ Less

Submitted 18 October, 2024; originally announced October 2024.

Comments: accepted for presentation at the IEEE Electrical Energy Storage Applications and Technologies Conference (EESAT)

Report number: PNNL-SA-203463

Grid-Forming Storage Networks: Analytical Characterization of Damping and Design Insights

Authors: Kaustav Chatterjee, Ramij Raja Hossain, Sai Pushpak Nandanoori, Soumya Kundu, Subhrajit Sinha, Diane Baldwin, Ronald Melton

Abstract: The paper presents a theoretical study on small-signal stability and damping in bulk power systems with multiple grid-forming inverter-based storage resources. A detailed analysis is presented, characterizing the impacts of inverter droop gains and storage size on the slower eigenvalues, particularly those concerning inter-area oscillation modes. From these parametric sensitivity studies, a set of… ▽ More The paper presents a theoretical study on small-signal stability and damping in bulk power systems with multiple grid-forming inverter-based storage resources. A detailed analysis is presented, characterizing the impacts of inverter droop gains and storage size on the slower eigenvalues, particularly those concerning inter-area oscillation modes. From these parametric sensitivity studies, a set of necessary conditions are derived that the design of droop gain must satisfy to enhance damping performance. The analytical findings are structured into propositions highlighting potential design considerations for improving system stability. The findings are illustrated via numerical studies on an IEEE 68-bus grid-forming storage network. △ Less

Submitted 5 September, 2024; originally announced September 2024.

Comments: accepted for presentation at The 63rd IEEE Conference on Decision and Control

Report number: PNNL-SA-196450

SINET: Sparsity-driven Interpretable Neural Network for Underwater Image Enhancement

Authors: Gargi Panda, Soumitra Kundu, Saumik Bhattacharya, Aurobinda Routray

Abstract: Improving the quality of underwater images is essential for advancing marine research and technology. This work introduces a sparsity-driven interpretable neural network (SINET) for the underwater image enhancement (UIE) task. Unlike pure deep learning methods, our network architecture is based on a novel channel-specific convolutional sparse coding (CCSC) model, ensuring good interpretability of… ▽ More Improving the quality of underwater images is essential for advancing marine research and technology. This work introduces a sparsity-driven interpretable neural network (SINET) for the underwater image enhancement (UIE) task. Unlike pure deep learning methods, our network architecture is based on a novel channel-specific convolutional sparse coding (CCSC) model, ensuring good interpretability of the underlying image enhancement process. The key feature of SINET is that it estimates the salient features from the three color channels using three sparse feature estimation blocks (SFEBs). The architecture of SFEB is designed by unrolling an iterative algorithm for solving the $\ell_1$ regularized convolutional sparse coding (CSC) problem. Our experiments show that SINET surpasses state-of-the-art PSNR value by $1.05$ dB with $3873$ times lower computational complexity. Code can be found at: https://github.com/gargi884/SINET-UIE/tree/main. △ Less

Submitted 16 March, 2025; v1 submitted 2 September, 2024; originally announced September 2024.

Comments: ICASSP 2025

Isolating Signatures of Cyberattacks under Stressed Grid Conditions

Authors: Sanchita Ghosh, Syed Ahsan Raza Naqvi, Sai Pushpak Nandanoori, Soumya Kundu

Abstract: In a controlled cyber-physical network, such as a power grid, any malicious data injection in the sensor measurements can lead to widespread impact due to the actions of the closed-loop controllers. While fast identification of the attack signatures is imperative for reliable operations, it is challenging to do so in a large dynamical network with tightly coupled nodes. A particularly challenging… ▽ More In a controlled cyber-physical network, such as a power grid, any malicious data injection in the sensor measurements can lead to widespread impact due to the actions of the closed-loop controllers. While fast identification of the attack signatures is imperative for reliable operations, it is challenging to do so in a large dynamical network with tightly coupled nodes. A particularly challenging scenario arises when the cyberattacks are strategically launched during a grid stress condition, caused by non-malicious physical disturbances. In this work, we propose an algorithmic framework -- based on Koopman mode (KM) decomposition -- for online identification and visualization of the cyberattack signatures in streaming time-series measurements from a power network. The KMs are capable of capturing the spatial embedding of both natural and anomalous modes of oscillations in the sensor measurements and thus revealing the specific influences of cyberattacks, even under existing non-malicious grid stress events. Most importantly, it enables us to quantitatively compare the outcomes of different potential cyberattacks injected by an attacker. The performance of the proposed algorithmic framework is illustrated on the IEEE 68-bus test system using synthetic attack scenarios. Such knowledge regarding the detection of various cyberattacks will enable us to devise appropriate diagnostic scheme while considering varied constraints arising from different attacks. △ Less

Submitted 4 August, 2024; originally announced August 2024.

Comments: accepted as a work-in-progress paper at the 2024 Annual Conference of the IEEE Industrial Electronics Society (IECON)

Report number: PNNL-SA-200494

Who should I trust? A Visual Analytics Approach for Comparing Net Load Forecasting Models

Authors: Kaustav Bhattacharjee, Soumya Kundu, Indrasis Chakraborty, Aritra Dasgupta

Abstract: Net load forecasting is crucial for energy planning and facilitating informed decision-making regarding trade and load distributions. However, evaluating forecasting models' performance against benchmark models remains challenging, thereby impeding experts' trust in the model's performance. In this context, there is a demand for technological interventions that allow scientists to compare models a… ▽ More Net load forecasting is crucial for energy planning and facilitating informed decision-making regarding trade and load distributions. However, evaluating forecasting models' performance against benchmark models remains challenging, thereby impeding experts' trust in the model's performance. In this context, there is a demand for technological interventions that allow scientists to compare models across various timeframes and solar penetration levels. This paper introduces a visual analytics-based application designed to compare the performance of deep-learning-based net load forecasting models with other models for probabilistic net load forecasting. This application employs carefully selected visual analytic interventions, enabling users to discern differences in model performance across different solar penetration levels, dataset resolutions, and hours of the day over multiple months. We also present observations made using our application through a case study, demonstrating the effectiveness of visualizations in aiding scientists in making informed decisions and enhancing trust in net load forecasting models. △ Less

Submitted 30 July, 2024; originally announced July 2024.

Comments: Accepted for publication in the proceedings of 2025 IEEE PES Grid Edge Technologies Conference & Exposition (Grid Edge)

Journal ref: GridEdge 2025, pp. 1-5, 2025

On the Impact of High-Order Harmonic Generation in Electrical Distribution Systems

Authors: Aaqib Peerzada, Bhaskar Mitra, Soumya Kundu, James P. Ogle

Abstract: The modern power grid has seen a rise in the integration of non-linear loads, presenting a significant concern for operators. These loads introduce unwanted harmonics, leading to potential issues such as overheating and improper functioning of circuit breakers. In pursuing a more sustainable grid, the adoption of electric vehicles (EVs) and photovoltaic (PV) systems in residential networks has inc… ▽ More The modern power grid has seen a rise in the integration of non-linear loads, presenting a significant concern for operators. These loads introduce unwanted harmonics, leading to potential issues such as overheating and improper functioning of circuit breakers. In pursuing a more sustainable grid, the adoption of electric vehicles (EVs) and photovoltaic (PV) systems in residential networks has increased. Understanding and examining the effects of high-order harmonic frequencies beyond $1.5$ kHz is crucial to understanding their impact on the operation and planning of electrical distribution systems under varying nonlinear loading conditions. This study investigates a diverse set of critical power electronic loads within a household modeled using PSCAD/EMTdc, analyzing their unique harmonic spectra. This information is utilized to run the time-series harmonic analysis program in OpenDSS on a modified IEEE 34 bus test system model. The impact of high-order harmonics is quantified using metrics that evaluate total harmonic distortion (THD), transformer harmonic-driven eddy current loss component, and propagation of harmonics from the source to the substation transformer. △ Less

Submitted 5 August, 2024; v1 submitted 30 July, 2024; originally announced July 2024.

Comments: accepted for presentation at the 2024 IEEE Energy Conversion Conference and Expo (ECCE)

Report number: PNNL-SA-201230

Data-driven Modeling for Grid Edge IBRs: A Digital Twin Perspective of User-Defined Models

Authors: Kaveri Mahapatra, Bhaskar Mitra, Soumya Kundu

Abstract: Recent Odessa disturbance events have brought attention to the challenges associated with the interaction between Inverter-Based Resources (IBRs) and the transmission and distribution system. The NERC event diagnosis report has highlighted several issues, emphasizing the need for continuous performance monitoring of these IBRs by system operators. Key areas of concern include the mismatch of contr… ▽ More Recent Odessa disturbance events have brought attention to the challenges associated with the interaction between Inverter-Based Resources (IBRs) and the transmission and distribution system. The NERC event diagnosis report has highlighted several issues, emphasizing the need for continuous performance monitoring of these IBRs by system operators. Key areas of concern include the mismatch of control and protection performance of IBRs between the original equipment manufacturer (OEM)-provided models and field measurements. The inability to replicate the realistic response can result in incorrect reliability and resilience studies. In this paper, we developed an approach on how to emulate the behavior of an IBR using measurement data obtained for system operators to utilize in real-time and long-term planning. Two experiments are conducted in the phasor domain and electromagnetic transients (EMT) domain to emulate the behavior for grid forming and grid following inverters under various operating conditions and the effectiveness of the proposed model is demonstrated in terms of accuracy and ease of utilizing user-defined models (UDMs). △ Less

Submitted 30 July, 2024; originally announced July 2024.

Comments: accepted for presentation at The 2024 Annual Conference of the IEEE Industrial Electronics Society (IECON)

Report number: PNNL-SA-200325

CLAMP-ViT: Contrastive Data-Free Learning for Adaptive Post-Training Quantization of ViTs

Authors: Akshat Ramachandran, Souvik Kundu, Tushar Krishna

Abstract: We present CLAMP-ViT, a data-free post-training quantization method for vision transformers (ViTs). We identify the limitations of recent techniques, notably their inability to leverage meaningful inter-patch relationships, leading to the generation of simplistic and semantically vague data, impacting quantization accuracy. CLAMP-ViT employs a two-stage approach, cyclically adapting between data g… ▽ More We present CLAMP-ViT, a data-free post-training quantization method for vision transformers (ViTs). We identify the limitations of recent techniques, notably their inability to leverage meaningful inter-patch relationships, leading to the generation of simplistic and semantically vague data, impacting quantization accuracy. CLAMP-ViT employs a two-stage approach, cyclically adapting between data generation and model quantization. Specifically, we incorporate a patch-level contrastive learning scheme to generate richer, semantically meaningful data. Furthermore, we leverage contrastive learning in layer-wise evolutionary search for fixed- and mixed-precision quantization to identify optimal quantization parameters while mitigating the effects of a non-smooth loss landscape. Extensive evaluations across various vision tasks demonstrate the superiority of CLAMP-ViT, with performance improvements of up to 3% in top-1 accuracy for classification, 0.6 mAP for object detection, and 1.5 mIoU for segmentation at similar or better compression ratio over existing alternatives. Code is available at https://github.com/georgia-tech-synergy-lab/CLAMP-ViT.git △ Less

Submitted 8 September, 2024; v1 submitted 7 July, 2024; originally announced July 2024.

Comments: ECCV 2024

Structural Impact of Grid-Forming Inverters on Power System Coherency

Authors: Sayak Mukherjee, Ramij Raja Hossain, Kaustav Chatterjee, Soumya Kundu, Kyung-Bin Kwon, Sameer Nekkalapu, Marcelo Elizondo

Abstract: This paper addresses the following fundamental research question: how does the integration of grid-forming inverters (GFMs) replacing conventional synchronous generators (SGs) impact the slow coherent eigen-structure and the low-frequency oscillatory behavior of future power systems? Due to time-scale separated dynamics, generator states inside a coherent area synchronize over a fast time-scale du… ▽ More This paper addresses the following fundamental research question: how does the integration of grid-forming inverters (GFMs) replacing conventional synchronous generators (SGs) impact the slow coherent eigen-structure and the low-frequency oscillatory behavior of future power systems? Due to time-scale separated dynamics, generator states inside a coherent area synchronize over a fast time-scale due to stronger coupling, while the areas themselves synchronize over a slower time scale. Our mathematical analysis shows that due to the large-scale integration of GFMs, the weighted Laplacian structure of the frequency dynamics is preserved, however, the entries of the Laplacian may be significantly modified based on the location and penetration levels of the GFMs. This can impact and potentially significantly alter the coherency structure of the system. We have validated our findings with numerical results using the IEEE 68-bus test system. △ Less

Submitted 15 May, 2024; originally announced May 2024.

Comments: 10 pages, 5 figures

Clustering Interval Load with Weather to Create Scenarios of Behind-the-Meter Solar Penetration

Authors: Allison M. Campbell, Soumya Kundu, Andrew P. Reiman, Orestis Vasios, Ian Beil, Andy Eiden

Abstract: Forecasting load at the feeder level has become increasingly challenging with the penetration of behind-the-meter solar, as this self-generation (also called total generation) is only visible to the utility as aggregated net-load. This work proposes a methodology for creation of scenarios of solar penetration at the feeder level for use by forecasters to test the robustness of their algorithm to p… ▽ More Forecasting load at the feeder level has become increasingly challenging with the penetration of behind-the-meter solar, as this self-generation (also called total generation) is only visible to the utility as aggregated net-load. This work proposes a methodology for creation of scenarios of solar penetration at the feeder level for use by forecasters to test the robustness of their algorithm to progressively higher penetrations of solar. The algorithm draws on publicly available observations of weather \emph{condition} (e.g., rainy/cloudy/fair) for use as proxies to sky clearness. These observations are used to mask and weight the interval deviations of similar native usage profiles from which average interval usage is calculated and subsequently added to interval net generation to reconstruct interval total generation. This approach improves the estimate of annual energy generation by 23\%; where the net generation signal currently only reflects 52\% of total annual generation, now 75\% is captured via the proposed algorithm. This proposed methodology is data driven and extensible to service territories which lack information on irradiance measurements and geo-coordinates. △ Less

Submitted 7 March, 2024; originally announced March 2024.

Comments: accepted for presentation at the IEEE PES General Meeting 2024

Report number: PNNL-SA-192596

LATIS: Lambda Abstraction-based Thermal Image Super-resolution

Authors: Gargi Panda, Soumitra Kundu, Saumik Bhattacharya, Aurobinda Routray

Abstract: Single image super-resolution (SISR) is an effective technique to improve the quality of low-resolution thermal images. Recently, transformer-based methods have achieved significant performance in SISR. However, in the SR task, only a small number of pixels are involved in the transformers self-attention (SA) mechanism due to the computational complexity of the attention mechanism. The lambda abst… ▽ More Single image super-resolution (SISR) is an effective technique to improve the quality of low-resolution thermal images. Recently, transformer-based methods have achieved significant performance in SISR. However, in the SR task, only a small number of pixels are involved in the transformers self-attention (SA) mechanism due to the computational complexity of the attention mechanism. The lambda abstraction is a promising alternative to SA in modeling long-range interactions while being computationally more efficient. This paper presents lambda abstraction-based thermal image super-resolution (LATIS), a novel lightweight architecture for SISR of thermal images. LATIS sequentially captures local and global information using the local and global feature block (LGFB). In LGFB, we introduce a global feature extraction (GFE) module based on the lambda abstraction mechanism, channel-shuffle and convolution (CSConv) layer to encode local context. Besides, to improve the performance further, we propose a differentiable patch-wise histogram-based loss function. Experimental results demonstrate that our LATIS, with the least model parameters and complexity, achieves better or comparable performance with state-of-the-art methods across multiple datasets. △ Less

Submitted 17 November, 2023; originally announced November 2023.

Forte: An Interactive Visual Analytic Tool for Trust-Augmented Net Load Forecasting

Authors: Kaustav Bhattacharjee, Soumya Kundu, Indrasis Chakraborty, Aritra Dasgupta

Abstract: Accurate net load forecasting is vital for energy planning, aiding decisions on trade and load distribution. However, assessing the performance of forecasting models across diverse input variables, like temperature and humidity, remains challenging, particularly for eliciting a high degree of trust in the model outcomes. In this context, there is a growing need for data-driven technological interv… ▽ More Accurate net load forecasting is vital for energy planning, aiding decisions on trade and load distribution. However, assessing the performance of forecasting models across diverse input variables, like temperature and humidity, remains challenging, particularly for eliciting a high degree of trust in the model outcomes. In this context, there is a growing need for data-driven technological interventions to aid scientists in comprehending how models react to both noisy and clean input variables, thus shedding light on complex behaviors and fostering confidence in the outcomes. In this paper, we present Forte, a visual analytics-based application to explore deep probabilistic net load forecasting models across various input variables and understand the error rates for different scenarios. With carefully designed visual interventions, this web-based interface empowers scientists to derive insights about model performance by simulating diverse scenarios, facilitating an informed decision-making process. We discuss observations made using Forte and demonstrate the effectiveness of visualization techniques to provide valuable insights into the correlation between weather inputs and net load forecasts, ultimately advancing grid capabilities by improving trust in forecasting models. △ Less

Submitted 10 November, 2023; originally announced November 2023.

Comments: Accepted for publication in the proceedings of 2024 IEEE Power & Energy Society Innovative Smart Grid Technologies Conference, North America (ISGT NA)

Bayesian longitudinal tensor response regression for modeling neuroplasticity

Authors: Suprateek Kundu, Alec Reinhardt, Serena Song, Joo Han, M. Lawson Meadows, Bruce Crosson, Venkatagiri Krishnamurthy

Abstract: A major interest in longitudinal neuroimaging studies involves investigating voxel-level neuroplasticity due to treatment and other factors across visits. However, traditional voxel-wise methods are beset with several pitfalls, which can compromise the accuracy of these approaches. We propose a novel Bayesian tensor response regression approach for longitudinal imaging data, which pools informatio… ▽ More A major interest in longitudinal neuroimaging studies involves investigating voxel-level neuroplasticity due to treatment and other factors across visits. However, traditional voxel-wise methods are beset with several pitfalls, which can compromise the accuracy of these approaches. We propose a novel Bayesian tensor response regression approach for longitudinal imaging data, which pools information across spatially-distributed voxels to infer significant changes while adjusting for covariates. The proposed method, which is implemented using Markov chain Monte Carlo (MCMC) sampling, utilizes low-rank decomposition to reduce dimensionality and preserve spatial configurations of voxels when estimating coefficients. It also enables feature selection via joint credible regions which respect the shape of the posterior distributions for more accurate inference. In addition to group level inferences, the method is able to infer individual-level neuroplasticity, allowing for examination of personalized disease or recovery trajectories. The advantages of the proposed approach in terms of prediction and feature selection over voxel-wise regression are highlighted via extensive simulation studies. Subsequently, we apply the approach to a longitudinal Aphasia dataset consisting of task functional MRI images from a group of subjects who were administered either a control intervention or intention treatment at baseline and were followed up over subsequent visits. Our analysis revealed that while the control therapy showed long-term increases in brain activity, the intention treatment produced predominantly short-term changes, both of which were concentrated in distinct localized regions. In contrast, the voxel-wise regression failed to detect any significant neuroplasticity after multiplicity adjustments, which is biologically implausible and implies lack of power. △ Less

Submitted 18 October, 2023; v1 submitted 12 September, 2023; originally announced September 2023.

Comments: 28 pages, 8 figures, 6 tables

Scaling Speech Technology to 1,000+ Languages

Authors: Vineel Pratap, Andros Tjandra, Bowen Shi, Paden Tomasello, Arun Babu, Sayani Kundu, Ali Elkahky, Zhaoheng Ni, Apoorv Vyas, Maryam Fazel-Zarandi, Alexei Baevski, Yossi Adi, Xiaohui Zhang, Wei-Ning Hsu, Alexis Conneau, Michael Auli

Abstract: Expanding the language coverage of speech technology has the potential to improve access to information for many more people. However, current speech technology is restricted to about one hundred languages which is a small fraction of the over 7,000 languages spoken around the world. The Massively Multilingual Speech (MMS) project increases the number of supported languages by 10-40x, depending on… ▽ More Expanding the language coverage of speech technology has the potential to improve access to information for many more people. However, current speech technology is restricted to about one hundred languages which is a small fraction of the over 7,000 languages spoken around the world. The Massively Multilingual Speech (MMS) project increases the number of supported languages by 10-40x, depending on the task. The main ingredients are a new dataset based on readings of publicly available religious texts and effectively leveraging self-supervised learning. We built pre-trained wav2vec 2.0 models covering 1,406 languages, a single multilingual automatic speech recognition model for 1,107 languages, speech synthesis models for the same number of languages, as well as a language identification model for 4,017 languages. Experiments show that our multilingual speech recognition model more than halves the word error rate of Whisper on 54 languages of the FLEURS benchmark while being trained on a small fraction of the labeled data. △ Less

Submitted 22 May, 2023; originally announced May 2023.

Technology-Circuit-Algorithm Tri-Design for Processing-in-Pixel-in-Memory (P2M)

Authors: Md Abdullah-Al Kaiser, Gourav Datta, Sreetama Sarkar, Souvik Kundu, Zihan Yin, Manas Garg, Ajey P. Jacob, Peter A. Beerel, Akhilesh R. Jaiswal

Abstract: The massive amounts of data generated by camera sensors motivate data processing inside pixel arrays, i.e., at the extreme-edge. Several critical developments have fueled recent interest in the processing-in-pixel-in-memory paradigm for a wide range of visual machine intelligence tasks, including (1) advances in 3D integration technology to enable complex processing inside each pixel in a 3D integ… ▽ More The massive amounts of data generated by camera sensors motivate data processing inside pixel arrays, i.e., at the extreme-edge. Several critical developments have fueled recent interest in the processing-in-pixel-in-memory paradigm for a wide range of visual machine intelligence tasks, including (1) advances in 3D integration technology to enable complex processing inside each pixel in a 3D integrated manner while maintaining pixel density, (2) analog processing circuit techniques for massively parallel low-energy in-pixel computations, and (3) algorithmic techniques to mitigate non-idealities associated with analog processing through hardware-aware training schemes. This article presents a comprehensive technology-circuit-algorithm landscape that connects technology capabilities, circuit design strategies, and algorithmic optimizations to power, performance, area, bandwidth reduction, and application-level accuracy metrics. We present our results using a comprehensive co-design framework incorporating hardware and algorithmic optimizations for various complex real-life visual intelligence tasks mapped onto our P2M paradigm. △ Less

Submitted 6 April, 2023; originally announced April 2023.

Journal ref: GLSVLSI '23: Great Lakes Symposium on VLSI 2023 Proceedings

An FPGA-Based Semi-Automated Traffic Control System Using Verilog HDL

Authors: Anik Mallik, Sanjoy Kundu, Md. Ashikur Rahman

Abstract: Traffic Congestion is one of the severe problems in heavily populated countries like Bangladesh where Automated Traffic Control System needs to be implemented. An FPGA-based Semi-automated system is introduced in this paper including a completely new feature "Safe State" to avoid sudden unwanted collision. Here we used sequential encoding which has made the program much simpler and so that easy to… ▽ More Traffic Congestion is one of the severe problems in heavily populated countries like Bangladesh where Automated Traffic Control System needs to be implemented. An FPGA-based Semi-automated system is introduced in this paper including a completely new feature "Safe State" to avoid sudden unwanted collision. Here we used sequential encoding which has made the program much simpler and so that easy to control and modify. The experimental result showed the automated change in traffic lights according to the specified timing sequences which would be able to conduct maximum possible transitions of vehicles occur at different directions simultaneously without facing any accident. △ Less

Submitted 8 March, 2023; originally announced March 2023.

Comments: In Proceedings of International Conference on Electrical, Computer and Telecommunication Engineering (ICECTE), RUET, Rajshahi, Bangladesh, 2012; 4 pages; 9 figures

Accounting for Temporal Variability in Functional Magnetic Resonance Imaging Improves Prediction of Intelligence

Authors: Yang Li, Xin Ma, Raj Sunderraman, Shihao Ji, Suprateek Kundu

Abstract: Neuroimaging-based prediction methods for intelligence and cognitive abilities have seen a rapid development in literature. Among different neuroimaging modalities, prediction based on functional connectivity (FC) has shown great promise. Most literature has focused on prediction using static FC, but there are limited investigations on the merits of such analysis compared to prediction based on dy… ▽ More Neuroimaging-based prediction methods for intelligence and cognitive abilities have seen a rapid development in literature. Among different neuroimaging modalities, prediction based on functional connectivity (FC) has shown great promise. Most literature has focused on prediction using static FC, but there are limited investigations on the merits of such analysis compared to prediction based on dynamic FC or region level functional magnetic resonance imaging (fMRI) times series that encode temporal variability. To account for the temporal dynamics in fMRI data, we propose a deep neural network involving bi-directional long short-term memory (bi-LSTM) approach that also incorporates feature selection mechanism. The proposed pipeline is implemented via an efficient GPU computation framework and applied to predict intelligence scores based on region level fMRI time series as well as dynamic FC. We compare the prediction performance for different intelligence measures based on static FC, dynamic FC, and region level time series acquired from the Adolescent Brain Cognitive Development (ABCD) study involving close to 7000 individuals. Our detailed analysis illustrates that static FC consistently has inferior prediction performance compared to region level time series or dynamic FC for unimodal rest and task fMRI experiments, and in almost all cases using a combination of task and rest features. In addition, the proposed bi-LSTM pipeline based on region level time series identifies several shared and differential important brain regions across task and rest fMRI experiments that drive intelligence prediction. A test-retest analysis of the selected features shows strong reliability across cross-validation folds. Given the large sample size from ABCD study, our results provide strong evidence that superior prediction of intelligence can be achieved by accounting for temporal variations in fMRI. △ Less

Submitted 14 December, 2022; v1 submitted 11 November, 2022; originally announced November 2022.

Analyzing Distribution Transformer Degradation with Increased Power Electronic Loads

Authors: Bhaskar Mitra, Ankit Singhal, Soumya Kundu, James P. Ogle

Abstract: The influx of non-linear power electronic loads into the distribution network has the potential to disrupt the existing distribution transformer operations. They were not designed to mediate the excessive heating losses generated from the harmonics. To have a good understanding of current standing challenges, a knowledge of the generation and load mix as well as the current harmonic estimations ar… ▽ More The influx of non-linear power electronic loads into the distribution network has the potential to disrupt the existing distribution transformer operations. They were not designed to mediate the excessive heating losses generated from the harmonics. To have a good understanding of current standing challenges, a knowledge of the generation and load mix as well as the current harmonic estimations are essential for designing transformers and evaluating their performance. In this paper, we investigate a mixture of essential power electronic loads for a household designed in PSCAD/EMTdc and their potential impacts on transformer eddy current losses and derating using harmonic analysis. The various scenarios have been studied with increasing PV penetrations. The peak load conditions are chosen for each scenario to perform a transformer derating analysis. Our findings reveal that in the presence of high power electronic loads (especially third harmonics), along with increasing PV generation may worsen transformer degradation. However, with a low amount of power electronic loads, additional PV generation helps to reduce the harmonic content in the current and improve transformer performance. △ Less

Submitted 26 October, 2022; originally announced October 2022.

Comments: The paper has been accepted at ISGT NA 2023 and will be presented there

Evaluating the Performance of StyleGAN2-ADA on Medical Images

Authors: McKell Woodland, John Wood, Brian M. Anderson, Suprateek Kundu, Ethan Lin, Eugene Koay, Bruno Odisio, Caroline Chung, Hyunseon Christine Kang, Aradhana M. Venkatesan, Sireesha Yedururi, Brian De, Yuan-Mao Lin, Ankit B. Patel, Kristy K. Brock

Abstract: Although generative adversarial networks (GANs) have shown promise in medical imaging, they have four main limitations that impeded their utility: computational cost, data requirements, reliable evaluation measures, and training complexity. Our work investigates each of these obstacles in a novel application of StyleGAN2-ADA to high-resolution medical imaging datasets. Our dataset is comprised of… ▽ More Although generative adversarial networks (GANs) have shown promise in medical imaging, they have four main limitations that impeded their utility: computational cost, data requirements, reliable evaluation measures, and training complexity. Our work investigates each of these obstacles in a novel application of StyleGAN2-ADA to high-resolution medical imaging datasets. Our dataset is comprised of liver-containing axial slices from non-contrast and contrast-enhanced computed tomography (CT) scans. Additionally, we utilized four public datasets composed of various imaging modalities. We trained a StyleGAN2 network with transfer learning (from the Flickr-Faces-HQ dataset) and data augmentation (horizontal flipping and adaptive discriminator augmentation). The network's generative quality was measured quantitatively with the Fréchet Inception Distance (FID) and qualitatively with a visual Turing test given to seven radiologists and radiation oncologists. The StyleGAN2-ADA network achieved a FID of 5.22 ($\pm$ 0.17) on our liver CT dataset. It also set new record FIDs of 10.78, 3.52, 21.17, and 5.39 on the publicly available SLIVER07, ChestX-ray14, ACDC, and Medical Segmentation Decathlon (brain tumors) datasets. In the visual Turing test, the clinicians rated generated images as real 42% of the time, approaching random guessing. Our computational ablation study revealed that transfer learning and data augmentation stabilize training and improve the perceptual quality of the generated images. We observed the FID to be consistent with human perceptual evaluation of medical images. Finally, our work found that StyleGAN2-ADA consistently produces high-quality results without hyperparameter searches or retraining. △ Less

Submitted 7 October, 2022; originally announced October 2022.

Comments: This preprint has not undergone post-submission improvements or corrections. The Version of Record of this contribution is published in LNCS, volume 13570, and is available online at https://doi.org/10.1007/978-3-031-16980-9_14

Journal ref: Lecture Notes in Computer Science 13570 (2022)

Dynamic Calibration of Nonlinear Sensors with Time-Drifts and Delays by Bayesian Inference

Authors: Soumyabrata Talukder, Souvik Kundu, Ratnesh Kumar

Abstract: Most sensor calibrations rely on the linearity and steadiness of their response characteristics, but practical sensors are nonlinear, and their response drifts with time, restricting their choices for adoption. To broaden the realm of sensors to allow nonlinearity and time-drift in the underlying dynamics, a Bayesian inference-based nonlinear, non-causal dynamic calibration method is introduced, w… ▽ More Most sensor calibrations rely on the linearity and steadiness of their response characteristics, but practical sensors are nonlinear, and their response drifts with time, restricting their choices for adoption. To broaden the realm of sensors to allow nonlinearity and time-drift in the underlying dynamics, a Bayesian inference-based nonlinear, non-causal dynamic calibration method is introduced, where the sensed value is estimated as a posterior conditional mean given a finite-length sequence of the sensor measurements and the elapsed time. Additionally, an algorithm is proposed to adjust an already learned calibration map online whenever new data arrives. The effectiveness of the proposed method is validated on continuous-glucose-monitoring (CGM) data from an alive rat equipped with an in-house optical glucose sensor. To allow flexibility in choice, the validation is also performed on a synthetic blood glucose level (BGL) dataset generated using FDA-approved virtual diabetic patient models together with an illustrative CGM sensor model. △ Less

Submitted 29 August, 2022; originally announced August 2022.

P2M-DeTrack: Processing-in-Pixel-in-Memory for Energy-efficient and Real-Time Multi-Object Detection and Tracking

Authors: Gourav Datta, Souvik Kundu, Zihan Yin, Joe Mathai, Zeyu Liu, Zixu Wang, Mulin Tian, Shunlin Lu, Ravi T. Lakkireddy, Andrew Schmidt, Wael Abd-Almageed, Ajey P. Jacob, Akhilesh R. Jaiswal, Peter A. Beerel

Abstract: Today's high resolution, high frame rate cameras in autonomous vehicles generate a large volume of data that needs to be transferred and processed by a downstream processor or machine learning (ML) accelerator to enable intelligent computing tasks, such as multi-object detection and tracking. The massive amount of data transfer incurs significant energy, latency, and bandwidth bottlenecks, which h… ▽ More Today's high resolution, high frame rate cameras in autonomous vehicles generate a large volume of data that needs to be transferred and processed by a downstream processor or machine learning (ML) accelerator to enable intelligent computing tasks, such as multi-object detection and tracking. The massive amount of data transfer incurs significant energy, latency, and bandwidth bottlenecks, which hinders real-time processing. To mitigate this problem, we propose an algorithm-hardware co-design framework called Processing-in-Pixel-in-Memory-based object Detection and Tracking (P2M-DeTrack). P2M-DeTrack is based on a custom faster R-CNN-based model that is distributed partly inside the pixel array (front-end) and partly in a separate FPGA/ASIC (back-end). The proposed front-end in-pixel processing down-samples the input feature maps significantly with judiciously optimized strided convolution and pooling. Compared to a conventional baseline design that transfers frames of RGB pixels to the back-end, the resulting P2M-DeTrack designs reduce the data bandwidth between sensor and back-end by up to 24x. The designs also reduce the sensor and total energy (obtained from in-house circuit simulations at Globalfoundries 22nm technology node) per frame by 5.7x and 1.14x, respectively. Lastly, they reduce the sensing and total frame latency by an estimated 1.7x and 3x, respectively. We evaluate our approach on the multi-object object detection (tracking) task of the large-scale BDD100K dataset and observe only a 0.5% reduction in the mean average precision (0.8% reduction in the identification F1 score) compared to the state-of-the-art. △ Less

Submitted 27 May, 2022; originally announced May 2022.

Comments: 6 pages, 4 figures, 4 tables

Optimization-Based Resiliency Verification in Microgrids via Maximal Adversarial Set Characterization

Authors: Nawaf Nazir, Thiagarajan Ramachandran, Saptarshi Bhattacharya, Ankit Singhal, Soumya Kundu, Veronica Adetola

Abstract: Critical energy infrastructures are increasingly relying on advanced sensing and control technologies for efficient and optimal utilization of flexible energy resources. Algorithmic procedures are needed to ensure that such systems are designed to be resilient to a wide range of cyber-physical adversarial events. This paper provides a robust optimization framework to quantify the range of adversar… ▽ More Critical energy infrastructures are increasingly relying on advanced sensing and control technologies for efficient and optimal utilization of flexible energy resources. Algorithmic procedures are needed to ensure that such systems are designed to be resilient to a wide range of cyber-physical adversarial events. This paper provides a robust optimization framework to quantify the range of adversarial perturbations that a system can accommodate without violating pre-specified resiliency metrics. An inner-approximation of the set of adversarial events which can be mitigated by the available flexibility is constructed using an optimization based approach. The proposed algorithm is illustrated on an islanded microgrid example: a modified IEEE 123-node feeder with distributed energy resources. Simulations are carried out to validate that the resiliency metrics are met for any event sampled from the constructed adversarial set for varying levels of available flexibility (energy reserves). △ Less

Submitted 28 March, 2022; originally announced March 2022.

Comments: accepted at the IEEE American Control Conference 2022

Report number: PNNL-SA-167569

KPF-AE-LSTM: A Deep Probabilistic Model for Net-Load Forecasting in High Solar Scenarios

Authors: Deepthi Sen, Indrasis Chakraborty, Soumya Kundu, Andrew P. Reiman, Ian Beil, Andy Eiden

Abstract: With the expected rise in behind-the-meter solar penetration within the distribution networks, there is a need to develop time-series forecasting methods that can reliably predict the net-load, accurately quantifying its uncertainty and variability. This paper presents a deep learning method to generate probabilistic forecasts of day-ahead net-load at 15-min resolution, at various solar penetratio… ▽ More With the expected rise in behind-the-meter solar penetration within the distribution networks, there is a need to develop time-series forecasting methods that can reliably predict the net-load, accurately quantifying its uncertainty and variability. This paper presents a deep learning method to generate probabilistic forecasts of day-ahead net-load at 15-min resolution, at various solar penetration levels. Our proposed deep-learning based architecture utilizes the dimensional reduction, from a higher-dimensional input to a lower-dimensional latent space, via a convolutional Autoencoder (AE). The extracted features from AE are then utilized to generate probability distributions across the latent space, by passing the features through a kernel-embedded Perron-Frobenius (kPF) operator. Finally, long short-term memory (LSTM) layers are used to synthesize time-series probability distributions of the forecasted net-load, from the latent space distributions. The models are shown to deliver superior forecast performance (as per several metrics), as well as maintain superior training efficiency, in comparison to existing benchmark models. Detailed analysis is carried out to evaluate the model performance across various solar penetration levels (up to 50\%), prediction horizons (e.g., 15\,min and 24\,hr ahead), and aggregation level of houses, as well as its robustness against missing measurements. △ Less

Submitted 5 March, 2022; originally announced March 2022.

Comments: presently under review at a IEEE PES journal

Report number: PNNL-SA-166731

Distributed Transient Safety Verification via Robust Control Invariant Sets: A Microgrid Application

Authors: Jean-Baptiste Bouvier, Sai Pushpak Nandanoori, Melkior Ornik, Soumya Kundu

Abstract: Modern safety-critical energy infrastructures are increasingly operated in a hierarchical and modular control framework which allows for limited data exchange between the modules. In this context, it is important for each module to synthesize and communicate constraints on the values of exchanged information in order to assure system-wide safety. To ensure transient safety in inverter-based microg… ▽ More Modern safety-critical energy infrastructures are increasingly operated in a hierarchical and modular control framework which allows for limited data exchange between the modules. In this context, it is important for each module to synthesize and communicate constraints on the values of exchanged information in order to assure system-wide safety. To ensure transient safety in inverter-based microgrids, we develop a set invariance-based distributed safety verification algorithm for each inverter module. Applying Nagumo's invariance condition, we construct a robust polynomial optimization problem to jointly search for safety-admissible set of control set-points and design parameters, under allowable disturbances from neighbors. We use sum-of-squares (SOS) programming to solve the verification problem and we perform numerical simulations using grid-forming inverters to illustrate the algorithm. △ Less

Submitted 18 February, 2022; originally announced February 2022.

Graph Neural Network and Koopman Models for Learning Networked Dynamics: A Comparative Study on Power Grid Transients Prediction

Authors: Sai Pushpak Nandanoori, Sheng Guan, Soumya Kundu, Seemita Pal, Khushbu Agarwal, Yinghui Wu, Sutanay Choudhury

Abstract: Continuous monitoring of the spatio-temporal dynamic behavior of critical infrastructure networks, such as the power systems, is a challenging but important task. In particular, accurate and timely prediction of the (electro-mechanical) transient dynamic trajectories of the power grid is necessary for early detection of any instability and prevention of catastrophic failures. Existing approaches f… ▽ More Continuous monitoring of the spatio-temporal dynamic behavior of critical infrastructure networks, such as the power systems, is a challenging but important task. In particular, accurate and timely prediction of the (electro-mechanical) transient dynamic trajectories of the power grid is necessary for early detection of any instability and prevention of catastrophic failures. Existing approaches for the prediction of dynamic trajectories either rely on the availability of accurate physical models of the system, use computationally expensive time-domain simulations, or are applicable only at local prediction problems (e.g., a single generator). In this paper, we report the application of two broad classes of data-driven learning models -- along with their algorithmic implementation and performance evaluation -- in predicting transient trajectories in power networks using only streaming measurements and the network topology as input. One class of models is based on the Koopman operator theory which allows for capturing the nonlinear dynamic behavior via an infinite-dimensional linear operator. The other class of models is based on the graph convolutional neural networks which are adept at capturing the inherent spatio-temporal correlations within the power network. Transient dynamic datasets for training and testing the models are synthesized by simulating a wide variety of load change events in the IEEE 68-bus system, categorized by the load change magnitudes, as well as by the degree of connectivity and the distance to nearest generator nodes. The results confirm that the proposed predictive models can successfully predict the post-disturbance transient evolution of the system with a high level of accuracy. △ Less

Submitted 16 February, 2022; originally announced February 2022.

Comments: 17 pages, this paper is currently under review in a journal

Developing and Validating Semi-Markov Occupancy Generative Models: A Technical Report

Authors: Soumya Kundu, Saptarshi Bhattacharya, Himanshu Sharma, Veronica Adetola

Abstract: This report documents recent technical work on developing and validating stochastic occupancy models in commercial buildings, performed by the Pacific Northwest National Laboratory (PNNL) as part of the Sensor Impact Evaluation and Verification project under the U.S. Department of Energy (DOE) Building Technologies Office (BTO). In this report, we present our work on developing and validating inho… ▽ More This report documents recent technical work on developing and validating stochastic occupancy models in commercial buildings, performed by the Pacific Northwest National Laboratory (PNNL) as part of the Sensor Impact Evaluation and Verification project under the U.S. Department of Energy (DOE) Building Technologies Office (BTO). In this report, we present our work on developing and validating inhomogeneous semi-Markov chain models for generating sequences of zone-level occupancy presence and occupancy counts in a commercial building. Real datasets are used to learn and validate the generative occupancy models. Relevant metrics such as normalized Jensen-Shannon distance (NJSD) are used to demonstrate the ability of the models to express realistic occupancy behavioral patterns. △ Less

Submitted 21 December, 2021; originally announced December 2021.

Report number: PNNL-31134

Harmonic Modeling, Data Generation, and Analysis of Power Electronics-Interfaced Residential Loads

Authors: Ankit Singhal, Dexin Wang, Andrew P. Reiman, Yuan Liu, Donald J. Hammerstrom, Soumya Kundu

Abstract: Integration of electronics-based residential appliances and distributed energy resources in homes is expected to rise with grid decarbonization. These devices may introduce significant harmonics into power networks that need to be closely studied in order to accurately model and forecast load. However, it can be difficult to obtain harmonic-rich voltage and current data -- necessary for identifyin… ▽ More Integration of electronics-based residential appliances and distributed energy resources in homes is expected to rise with grid decarbonization. These devices may introduce significant harmonics into power networks that need to be closely studied in order to accurately model and forecast load. However, it can be difficult to obtain harmonic-rich voltage and current data -- necessary for identifying accurate load models -- for residential electrical loads. Recognizing this need, first a set of electronics-based end-use loads is identified and modeled in an electromagnetic transients program tool for a residence. Second, an impedance-varying method is proposed to generate harmonic data that captures harmonic propagation to the supply voltage and harmonic interactions among end-use loads connected to the same supply voltage. Third, a harmonic-rich dataset produced via the proposed methodology is demonstrated to successfully identify frequency coupling matrix-based harmonic load models using the least-squares method. Numerical results demonstrate the accuracy of the model. The impact of limited data availability on model identification is also explored. △ Less

Submitted 5 November, 2021; originally announced November 2021.

Comments: Accepted at the IEEE ISGT 2022 Conference

Report number: PNNL-SA-165234

Sparse Control Synthesis for Uncertain Responsive Loads with Stochastic Stability Guarantees

Authors: Sai Pushpak Nandanoori, Soumya Kundu, Jianming Lian, Umesh Vaidya, Draguna Vrabie, Karanjit Kalsi

Abstract: Recent studies have demonstrated the potential of flexible loads in providing frequency response services. However, uncertainty and variability in various weather-related and end-use behavioral factors often affect the demand-side control performance. This work addresses this problem with the design of a demand-side control to achieve frequency response under load uncertainties. Our approach invol… ▽ More Recent studies have demonstrated the potential of flexible loads in providing frequency response services. However, uncertainty and variability in various weather-related and end-use behavioral factors often affect the demand-side control performance. This work addresses this problem with the design of a demand-side control to achieve frequency response under load uncertainties. Our approach involves modeling the load uncertainties via stochastic processes that appear as both multiplicative and additive to the system states in closed-loop power system dynamics. Extending the recently developed mean square exponential stability (MSES) results for stochastic systems, we formulate multi-objective linear matrix inequality (LMI)-based optimal control synthesis problems to not only guarantee stochastic stability, but also promote sparsity, enhance closed-loop transient performance, and maximize allowable uncertainties. The fundamental trade-off between the maximum allowable (\textit{critical}) uncertainty levels and the optimal stochastic stabilizing control efforts is established. Moreover, the sparse control synthesis problem is generalized to the realistic power systems scenario in which only partial-state measurements are available. Detailed numerical studies are carried out on IEEE 39-bus system to demonstrate the closed-loop stochastic stabilizing performance of the sparse controllers in enhancing frequency response under load uncertainties; as well as illustrate the fundamental trade-off between the allowable uncertainties and optimal control efforts. △ Less

Submitted 27 June, 2021; originally announced June 2021.

Comments: accepted for publication at the IEEE Transactions on Power Sysems

Report number: PNNL-SA-156076

Occupancy-Driven Stochastic Decision Framework for Ranking Commercial Building Loads

Authors: Milan Jain, Soumya Kundu, Arnab Bhattacharya, Sen Huang, Vikas Chandan, Nikitha Radhakrishnan, Veronica Adetola, Draguna Vrabie

Abstract: For effective integration of building operations into the evolving demand response programs of the power grid, real-time decisions concerning the use of building appliances for grid services must excel on multiple criteria, ranging from the added value to occupants' comfort to the quality of the grid services. In this paper, we present a data-driven decision-support framework to dynamically rank l… ▽ More For effective integration of building operations into the evolving demand response programs of the power grid, real-time decisions concerning the use of building appliances for grid services must excel on multiple criteria, ranging from the added value to occupants' comfort to the quality of the grid services. In this paper, we present a data-driven decision-support framework to dynamically rank load control alternatives in a commercial building, addressing the needs of multiple decision criteria (e.g. occupant comfort, grid service quality) under uncertainties in occupancy patterns. We adopt a stochastic multi-criteria decision algorithm recently applied to prioritize residential on/off loads, and extend it to i) complex load control decisions (e.g. dimming of lights, changing zone temperature set-points) in a commercial building; and ii) systematic integration of zonal occupancy patterns to accurately identify short-term grid service opportunities. We evaluate the performance of the framework for curtailment of air-conditioning, lighting, and plug-loads in a multi-zone office building for a range of design choices. With the help of a prototype system that integrates an interactive \textit{Data Analytics and Visualization} frontend, we demonstrate a way for the building operators to monitor the flexibility in energy consumption and to develop trust in the decision recommendations by interpreting the rationale behind the ranking. △ Less

Submitted 21 March, 2021; originally announced March 2021.

Comments: accepted in the 2021 American Control Conference

Report number: PNNL-SA-156937

Model-Agnostic Algorithm for Real-Time Attack Identification in Power Grid using Koopman Modes

Authors: Sai Pushpak Nandanoori, Soumya Kundu, Seemita Pal, Khushbu Agarwal, Sutanay Choudhury

Abstract: Malicious activities on measurements from sensors like Phasor Measurement Units (PMUs) can mislead the control center operator into taking wrong control actions resulting in disruption of operation, financial losses, and equipment damage. In particular, false data attacks initiated during power systems transients caused due to abrupt changes in load and generation can fool the conventional model-b… ▽ More Malicious activities on measurements from sensors like Phasor Measurement Units (PMUs) can mislead the control center operator into taking wrong control actions resulting in disruption of operation, financial losses, and equipment damage. In particular, false data attacks initiated during power systems transients caused due to abrupt changes in load and generation can fool the conventional model-based detection methods relying on thresholds comparison to trigger an anomaly. In this paper, we propose a Koopman mode decomposition (KMD) based algorithm to detect and identify false data attacks in real-time. The Koopman modes (KMs) are capable of capturing the nonlinear modes of oscillation in the transient dynamics of the power networks and reveal the spatial embedding of both natural and anomalous modes of oscillations in the sensor measurements. The Koopman-based spatio-temporal nonlinear modal analysis is used to filter out the false data injected by an attacker. The performance of the algorithm is illustrated on the IEEE 68-bus test system using synthetic attack scenarios generated on GridSTAGE, a recently developed multivariate spatio-temporal data generation framework for simulation of adversarial scenarios in cyber-physical power systems. △ Less

Submitted 27 August, 2020; v1 submitted 22 July, 2020; originally announced July 2020.

Comments: This work has been accepted in the 2020 IEEE SmartGridComm

Transient Safety Filter Design for Grid-Forming Inverters

Authors: Soumya Kundu, Karanjit Kalsi

Abstract: Unlike conventional generators, inverter-based generation do not possess any rotational inertia. While grid-forming inverters can synthesize small (virtual) inertia via advanced feedback control loops, additional control mechanisms are needed to ensure safety and security of the power grid during transients. In this paper, we propose novel real-time safety-constrained feedback controllers ("safety… ▽ More Unlike conventional generators, inverter-based generation do not possess any rotational inertia. While grid-forming inverters can synthesize small (virtual) inertia via advanced feedback control loops, additional control mechanisms are needed to ensure safety and security of the power grid during transients. In this paper, we propose novel real-time safety-constrained feedback controllers ("safety filters") for droop-based (grid-forming) inverters to ensure transient security of the grid. The safety filter acts as a buffer between the network operational layer and the inverter-control layer, and only lets those dispatch control signals pass to the inverter droop-controller, which are guaranteed to not violate the safety specifications (frequency, voltage, current limits). Using a distributed barrier certificates method, we construct state-inclusive bounds on the allowable control inputs, which guarantee the satisfaction of transient safety specifications. Sum-of-square programming is used to synthesize the safety filters. Numerical simulation results are provided to illustrate the performance of the proposed filter in inverter-based microgrids. △ Less

Submitted 23 March, 2020; originally announced March 2020.

Comments: accepted for presentation at the 2020 American Control Conference. arXiv admin note: text overlap with arXiv:1903.09743

Report number: PNNL-SA-147958

Stochastic Virtual Battery Modeling of Uncertain Electrical Loads Using Variational Autoencoder

Authors: Indrasis Chakraborty, Sai Pushpak Nandanoori, Soumya Kundu, Karanjit Kalsi

Abstract: Effective utilization of flexible loads for grid services, while satisfying end-user preferences and constraints, requires an accurate estimation of the aggregated predictive flexibility offered by the electrical loads. Virtual battery (VB) models are often used to quantify the predictive flexibility in thermostatic loads (e.g. residential air-conditioners, electric water-heaters), which model the… ▽ More Effective utilization of flexible loads for grid services, while satisfying end-user preferences and constraints, requires an accurate estimation of the aggregated predictive flexibility offered by the electrical loads. Virtual battery (VB) models are often used to quantify the predictive flexibility in thermostatic loads (e.g. residential air-conditioners, electric water-heaters), which model the temporal evolution of a (virtual) energy state via a first order dynamics including self-dissipation rate, and power and energy capacities as parameters. Uncertainties and lack of information regarding end-usage and equipment models render deterministic VB models impractical. In this paper, we introduce the notion of stochastic VB models, and propose a \textit{variational autoencoder}-based deep learning algorithm to identify the probability distribution of the VB model parameters. Using available sensors and meters data, the proposed algorithm generates not only point estimates of the VB parameters, but also confidence intervals around those values. Effectiveness of the proposed frameworks is demonstrated on a collection of electric water-heater loads, whose operation is driven by uncertain water usage profiles. △ Less

Submitted 18 March, 2020; originally announced March 2020.

Comments: accepted for presentation at the 2020 American Control Conference

Report number: PNNL-SA-147862

Distributed Small-Signal Stability Conditions for Inverter-Based Unbalanced Microgrids

Authors: Sai Pushpak Nandanoori, Soumya Kundu, Wei Du, Francis Tuffner, Kevin Schneider

Abstract: The proliferation of inverter-based generation and advanced sensing, controls, and communication infrastructure have facilitated the accelerated deployment of microgrids. A coordinated network of microgrids can maintain reliable power delivery to critical facilities during extreme events. Low inertia offered by the power electronics interfaced energy resources however, can present significant chal… ▽ More The proliferation of inverter-based generation and advanced sensing, controls, and communication infrastructure have facilitated the accelerated deployment of microgrids. A coordinated network of microgrids can maintain reliable power delivery to critical facilities during extreme events. Low inertia offered by the power electronics interfaced energy resources however, can present significant challenges to ensuring stable operation of the microgrids. In this work, distributed small-signal stability conditions for inverter-based microgrids are developed that involve the droop controller parameters and the network parameters such as line impedances, loads, etc. The distributed closed-form parametric stability conditions derived in this paper can be verified in a computationally efficient manner, facilitating the reliable design and operations of networks of microgrids. Dynamic phasor models have been used to capture the effects of electromagnetic transients. Numerical results are presented, along with PSCAD simulations, to validate the analytical stability conditions. Effects of design choices, such as the conductor types, and inverter sizes, on the small-signal stability of inverter-based microgrids are investigated to identify interpretable stable or unstable region estimates. △ Less

Submitted 17 March, 2020; originally announced March 2020.

Comments: This paper is accepted in IEEE Transactions on Power Systems

A Nonlinear Regression Method for Composite Protection Modeling of Induction Motor Loads

Authors: Soumya Kundu, Zhigang Chu, Yuan Liu, Yingying Tang, Qiuhua Huang, Daniel James, Yu Zhang, Pavel Etingov, David P. Chassin

Abstract: Protection equipment is used to prevent damage to induction motor loads by isolating them from power systems in the event of severe faults. Modeling the response of induction motor loads and their protection is vital for power system planning and operation, especially in understanding system's dynamic performance and stability after a fault occurs. Induction motors are usually equipped with severa… ▽ More Protection equipment is used to prevent damage to induction motor loads by isolating them from power systems in the event of severe faults. Modeling the response of induction motor loads and their protection is vital for power system planning and operation, especially in understanding system's dynamic performance and stability after a fault occurs. Induction motors are usually equipped with several types of protection with different operation mechanisms, making it challenging to develop adequate yet not overly complex protection models and determine their parameters for aggregate induction motor models. This paper proposes an optimization-based nonlinear regression framework to determine protection model parameters for aggregate induction motor loads in commercial buildings. Using a mathematical abstraction, the task of determining a suitable set of parameters for the protection model in composite load models is formulated as a nonlinear regression problem. Numerical examples are provided to illustrate the application of the framework. Sensitivity studies are presented to demonstrate the impact of lack of available motor load information on the accuracy of the protection models. △ Less

Submitted 16 December, 2019; originally announced December 2019.

Comments: accepted for presentation at The Eleventh Conference on Innovative Smart Grid Technologies (ISGT 2020)

Report number: PNNL-SA-146910

Resilience of Traffic Networks with Partially Controlled Routing

Authors: Gianluca Bianchin, Fabio Pasqualetti, Soumya Kundu

Abstract: This paper investigates the use of Infrastructure-To-Vehicle (I2V) communication to generate routing suggestions for drivers in transportation systems, with the goal of optimizing a measure of overall network congestion. We define link-wise levels of trust to tolerate the non-cooperative behavior of part of the driver population, and we propose a real-time optimization mechanism that adapts to the… ▽ More This paper investigates the use of Infrastructure-To-Vehicle (I2V) communication to generate routing suggestions for drivers in transportation systems, with the goal of optimizing a measure of overall network congestion. We define link-wise levels of trust to tolerate the non-cooperative behavior of part of the driver population, and we propose a real-time optimization mechanism that adapts to the instantaneous network conditions and to sudden changes in the levels of trust. Our framework allows us to quantify the improvement in travel time in relation to the degree at which drivers follow the routing suggestions. We then study the resilience of the system, measured as the smallest change in routing choices that results in roads reaching their maximum capacity. Interestingly, our findings suggest that fluctuations in the extent to which drivers follow the provided routing suggestions can cause failures of certain links. These results imply that the benefits of using Infrastructure-To-Vehicle communication come at the cost of new fragilities, that should be appropriately addressed in order to guarantee the reliable operation of the infrastructure. △ Less

Submitted 16 April, 2019; originally announced April 2019.

Comments: Accepted for presentation at the IEEE 2019 American Control Conference

Distribution System State Estimation in the Presence of High Solar Penetration

Authors: Thiagarajan Ramachandran, Andrew Reiman, Sai Pushpak Nandanoori, Mark Rice, Soumya Kundu

Abstract: Low-to-medium voltage distribution networks are experiencing rising levels of distributed energy resources, including renewable generation, along with improved sensing, communication, and automation infrastructure. As such, state estimation methods for distribution systems are becoming increasingly relevant as a means to enable better control strategies that can both leverage the benefits and miti… ▽ More Low-to-medium voltage distribution networks are experiencing rising levels of distributed energy resources, including renewable generation, along with improved sensing, communication, and automation infrastructure. As such, state estimation methods for distribution systems are becoming increasingly relevant as a means to enable better control strategies that can both leverage the benefits and mitigate the risks associated with high penetration of variable and uncertain distributed generation resources. The primary challenges of this problem include modeling complexities (nonlinear, non-convex power-flow equations), limited availability of sensor measurements, and high penetration of uncertain renewable generation. This paper formulates the distribution system state estimation as a nonlinear, weighted, least squares problem, based on sensor measurements as well as forecast data (both load and generation). We investigate the sensitivity of state estimator accuracy to (load/generation) forecast uncertainties, sensor accuracy, and sensor coverage levels. △ Less

Submitted 16 April, 2019; originally announced April 2019.

Comments: accepted for presentation at the IEEE 2019 American Control Conference

Report number: PNNL-SA-138831

Identification and Validation of Virtual Battery Model for Heterogeneous Devices

Authors: Sai Pushpak Nandanoori, Indrasis Chakraborty, Thiagarajan Ramachandran, Soumya Kundu

Abstract: The potential of distributed energy resources in providing grid services can be maximized with the recent advancements in demand side control. Effective utilization of this control strategy requires the knowledge of aggregate flexibility of the distributed energy resources (DERs). Recent works have shown that the aggregate flexibility of DERs can be modeled as a virtual battery (VB) whose state ev… ▽ More The potential of distributed energy resources in providing grid services can be maximized with the recent advancements in demand side control. Effective utilization of this control strategy requires the knowledge of aggregate flexibility of the distributed energy resources (DERs). Recent works have shown that the aggregate flexibility of DERs can be modeled as a virtual battery (VB) whose state evolution is governed by a first order system including self-dissipation. The VB parameters (self-dissipation rate, energy capacity) are obtained by solving an optimization problem which minimizes the tracking performance of the ensemble and the proposed first-order model. For the identified first order model, time-varying power limits are calculated using binary search algorithms. Finally, this proposed framework is demonstrated for different homogeneous and heterogeneous ensembles consisting of air conditioners (ACs) and electric water heaters (EWHs). △ Less

Submitted 15 March, 2019; v1 submitted 4 March, 2019; originally announced March 2019.

Comments: This is a preprint version of PESGM 2019 (accepted) paper

Impact of Building-Level Motor Protection on Power System Transient Behaviors

Authors: Y. Liu, Y. Zhang, Q. Huang, S. Kundu, Y. Tang, D. James, P. Etingov, B. Mitra, D. Chassin

Abstract: Protection strategies for transmission and distribution systems have been extensively investigated to facilitate better coordination of physical protection devices. A diverse range of functional motors with dedicated protection schemes are being used more and more in commercial, residential, and industrial buildings. This paper focuses on simulating several of the most popular protection schemes u… ▽ More Protection strategies for transmission and distribution systems have been extensively investigated to facilitate better coordination of physical protection devices. A diverse range of functional motors with dedicated protection schemes are being used more and more in commercial, residential, and industrial buildings. This paper focuses on simulating several of the most popular protection schemes using the ElectroMagnetic Transient Program (EMTP) model for three-phase and single-phase induction motors in existing commercial buildings connected to typical distribution feeders. To investigate the behaviors of single-phase motors stalling, the actions of motor protection and reconnections, and the impacts of device-level protection on system-level dynamics, we imposed voltage depressions at the head of a feeder fully loaded with functional induction motors. Several distribution feeders are represented in a standard IEEE 39-bus transmission system to simulate fault-induced delayed voltage recovery (FIDVR) and explore mitigation strategies by optimally configuring the building-level motor protection settings. △ Less

Submitted 19 June, 2018; originally announced June 2018.

Comments: 6 figures, 2 tables, 5 pages, IEEE PES General Meeting 2018

Approximating Flexibility in Distributed Energy Resources: A Geometric Approach

Authors: Soumya Kundu, Karanjit Kalsi, Scott Backhaus

Abstract: With increasing availability of communication and control infrastructure at the distribution systems, it is expected that the distributed energy resources (DERs) will take an active part in future power systems operations. One of the main challenges associated with integration of DERs in grid planning and control is in estimating the available flexibility in a collection of (heterogeneous) DERs, e… ▽ More With increasing availability of communication and control infrastructure at the distribution systems, it is expected that the distributed energy resources (DERs) will take an active part in future power systems operations. One of the main challenges associated with integration of DERs in grid planning and control is in estimating the available flexibility in a collection of (heterogeneous) DERs, each of which may have local constraints that vary over time. In this work, we present a geometric approach for approximating the flexibility of a DER in modulating its active and reactive power consumption. The proposed method is agnostic about the type and model of the DERs, thereby facilitating a plug-and-play approach, and allows scalable aggregation of the flexibility of a collection of (heterogeneous) DERs at the distributed system level. Simulation results are presented to demonstrate the performance of the proposed method. △ Less

Submitted 14 March, 2018; originally announced March 2018.

Comments: accepted for presentation at the Power Systems Computations Conference 2018

Report number: PNNL-SA-127767

Decomposition of Nonlinear Dynamical Systems Using Koopman Gramians

Authors: Zhiyuan Liu, Soumya Kundu, Lijun Chen, Enoch Yeung

Abstract: In this paper we propose a new Koopman operator approach to the decomposition of nonlinear dynamical systems using Koopman Gramians. We introduce the notion of an input-Koopman operator, and show how input-Koopman operators can be used to cast a nonlinear system into the classical state-space form, and identify conditions under which input and state observable functions are well separated. We then… ▽ More In this paper we propose a new Koopman operator approach to the decomposition of nonlinear dynamical systems using Koopman Gramians. We introduce the notion of an input-Koopman operator, and show how input-Koopman operators can be used to cast a nonlinear system into the classical state-space form, and identify conditions under which input and state observable functions are well separated. We then extend an existing method of dynamic mode decomposition for learning Koopman operators from data known as deep dynamic mode decomposition to systems with controls or disturbances. We illustrate the accuracy of the method in learning an input-state separable Koopman operator for an example system, even when the underlying system exhibits mixed state-input terms. We next introduce a nonlinear decomposition algorithm, based on Koopman Gramians, that maximizes internal subsystem observability and disturbance rejection from unwanted noise from other subsystems. We derive a relaxation based on Koopman Gramians and multi-way partitioning for the resulting NP-hard decomposition problem. We lastly illustrate the proposed algorithm with the swing dynamics for an IEEE 39-bus system. △ Less

Submitted 4 October, 2017; originally announced October 2017.

Comments: 8 pages, submitted to IEEE 2018 ACC