-
Autoencoder-Based Domain Learning for Semantic Communication with Conceptual Spaces
Authors:
Dylan Wheeler,
Balasubramaniam Natarajan
Abstract:
Communication with the goal of accurately conveying meaning, rather than accurately transmitting symbols, has become an area of growing interest. This paradigm, termed semantic communication, typically leverages modern developments in artificial intelligence and machine learning to improve the efficiency and robustness of communication systems. However, a standard model for capturing and quantifyi…
▽ More
Communication with the goal of accurately conveying meaning, rather than accurately transmitting symbols, has become an area of growing interest. This paradigm, termed semantic communication, typically leverages modern developments in artificial intelligence and machine learning to improve the efficiency and robustness of communication systems. However, a standard model for capturing and quantifying the details of "meaning" is lacking, with many leading approaches to semantic communication adopting a black-box framework with little understanding of what exactly the model is learning. One solution is to utilize the conceptual spaces framework, which models meaning explicitly in a geometric manner. Though prior work studying semantic communication with conceptual spaces has shown promising results, these previous attempts involve hand-crafting a conceptual space model, severely limiting the scalability and practicality of the approach. In this work, we develop a framework for learning a domain of a conceptual space model using only the raw data with high-level property labels. In experiments using the MNIST and CelebA datasets, we show that the domains learned using the framework maintain semantic similarity relations and possess interpretable dimensions.
△ Less
Submitted 29 January, 2024;
originally announced January 2024.
-
Active Foundational Models for Fault Diagnosis of Electrical Motors
Authors:
Sriram Anbalagan,
Sai Shashank GP,
Deepesh Agarwal,
Balasubramaniam Natarajan,
Babji Srinivasan
Abstract:
Fault detection and diagnosis of electrical motors are of utmost importance in ensuring the safe and reliable operation of several industrial systems. Detection and diagnosis of faults at the incipient stage allows corrective actions to be taken in order to reduce the severity of faults. The existing data-driven deep learning approaches for machine fault diagnosis rely extensively on huge amounts…
▽ More
Fault detection and diagnosis of electrical motors are of utmost importance in ensuring the safe and reliable operation of several industrial systems. Detection and diagnosis of faults at the incipient stage allows corrective actions to be taken in order to reduce the severity of faults. The existing data-driven deep learning approaches for machine fault diagnosis rely extensively on huge amounts of labeled samples, where annotations are expensive and time-consuming. However, a major portion of unlabeled condition monitoring data is not exploited in the training process. To overcome this limitation, we propose a foundational model-based Active Learning framework that utilizes less amount of labeled samples, which are most informative and harnesses a large amount of available unlabeled data by effectively combining Active Learning and Contrastive Self-Supervised Learning techniques. It consists of a transformer network-based backbone model trained using an advanced nearest-neighbor contrastive self-supervised learning method. This approach empowers the backbone to learn improved representations of samples derived from raw, unlabeled vibration data. Subsequently, the backbone can undergo fine-tuning to address a range of downstream tasks, both within the same machines and across different machines. The effectiveness of the proposed methodology has been assessed through the fine-tuning of the backbone for multiple target tasks using three distinct machine-bearing fault datasets. The experimental evaluation demonstrates a superior performance as compared to existing state-of-the-art fault diagnosis methods with less amount of labeled data.
△ Less
Submitted 26 November, 2023;
originally announced November 2023.
-
Foundational Models for Fault Diagnosis of Electrical Motors
Authors:
Sriram Anbalagan,
Deepesh Agarwal,
Balasubramaniam Natarajan,
Babji Srinivasan
Abstract:
A majority of recent advancements related to the fault diagnosis of electrical motors are based on the assumption that training and testing data are drawn from the same distribution. However, the data distribution can vary across different operating conditions during real-world operating scenarios of electrical motors. Consequently, this assumption limits the practical implementation of existing s…
▽ More
A majority of recent advancements related to the fault diagnosis of electrical motors are based on the assumption that training and testing data are drawn from the same distribution. However, the data distribution can vary across different operating conditions during real-world operating scenarios of electrical motors. Consequently, this assumption limits the practical implementation of existing studies for fault diagnosis, as they rely on fully labelled training data spanning all operating conditions and assume a consistent distribution. This is because obtaining a large number of labelled samples for several machines across different fault cases and operating scenarios may be unfeasible. In order to overcome the aforementioned limitations, this work proposes a framework to develop a foundational model for fault diagnosis of electrical motors. It involves building a neural network-based backbone to learn high-level features using self-supervised learning, and then fine-tuning the backbone to achieve specific objectives. The primary advantage of such an approach is that the backbone can be fine-tuned to achieve a wide variety of target tasks using very less amount of training data as compared to traditional supervised learning methodologies. The empirical evaluation demonstrates the effectiveness of the proposed approach by obtaining more than 90\% classification accuracy by fine-tuning the backbone not only across different types of fault scenarios or operating conditions, but also across different machines. This illustrates the promising potential of the proposed approach for cross-machine fault diagnosis tasks in real-world applications.
△ Less
Submitted 31 July, 2023;
originally announced July 2023.
-
Knowledge-Driven Semantic Communication Enabled by the Geometry of Meaning
Authors:
Dylan Wheeler,
Balasubramaniam Natarajan
Abstract:
As our world grows increasingly connected and new technologies arise, global demands for data traffic continue to rise exponentially. Limited by the fundamental results of information theory, to meet these demands we are forced to either increase power or bandwidth usage. But what if there was a way to use these resources more efficiently? This question is the main driver behind the recent surge o…
▽ More
As our world grows increasingly connected and new technologies arise, global demands for data traffic continue to rise exponentially. Limited by the fundamental results of information theory, to meet these demands we are forced to either increase power or bandwidth usage. But what if there was a way to use these resources more efficiently? This question is the main driver behind the recent surge of interest in semantic communication, which seeks to leverage increased intelligence to move beyond the Shannon limit of technical communication. In this paper we expound a method of achieving semantic communication which utilizes the conceptual space model of knowledge representation. In contrast to other popular methods of semantic communication, our approach is intuitive, interpretable and efficient. We derive some preliminary results bounding the probability of semantic error under our framework, and show how our approach can serve as the underlying knowledge-driven foundation to higher-level intelligent systems. Taking inspiration from a metaverse application, we perform simulations to draw important insights about the proposed method and demonstrate how it can be used to achieve semantic communication with a 99.9% reduction in rate as compared to a more traditional setup.
△ Less
Submitted 6 September, 2023; v1 submitted 5 June, 2023;
originally announced June 2023.
-
Latent Neural ODE for Integrating Multi-timescale measurements in Smart Distribution Grids
Authors:
Shweta Dahale,
Sai Munikoti,
Balasubramaniam Natarajan,
Rui Yang
Abstract:
Under a smart grid paradigm, there has been an increase in sensor installations to enhance situational awareness. The measurements from these sensors can be leveraged for real-time monitoring, control, and protection. However, these measurements are typically irregularly sampled. These measurements may also be intermittent due to communication bandwidth limitations. To tackle this problem, this pa…
▽ More
Under a smart grid paradigm, there has been an increase in sensor installations to enhance situational awareness. The measurements from these sensors can be leveraged for real-time monitoring, control, and protection. However, these measurements are typically irregularly sampled. These measurements may also be intermittent due to communication bandwidth limitations. To tackle this problem, this paper proposes a novel latent neural ordinary differential equations (LODE) approach to aggregate the unevenly sampled multivariate time-series measurements. The proposed approach is flexible in performing both imputations and predictions while being computationally efficient. Simulation results on IEEE 37 bus test systems illustrate the efficiency of the proposed approach.
△ Less
Submitted 7 November, 2022;
originally announced November 2022.
-
Semantic Communication with Conceptual Spaces
Authors:
Dylan Wheeler,
Erin E. Tripp,
Balasubramaniam Natarajan
Abstract:
Despite the fact that Shannon and Weaver's Mathematical Theory of Communication was published over 70 years ago, all communication systems continue to operate at the first of three levels defined in this theory: the technical level. In this letter, we argue that a transition to the semantic level embodies a natural, important step in the evolution of communication technologies. Furthermore, we pro…
▽ More
Despite the fact that Shannon and Weaver's Mathematical Theory of Communication was published over 70 years ago, all communication systems continue to operate at the first of three levels defined in this theory: the technical level. In this letter, we argue that a transition to the semantic level embodies a natural, important step in the evolution of communication technologies. Furthermore, we propose a novel approach to engineering semantic communication using conceptual spaces and functional compression. We introduce a model of semantic communication utilizing this approach, and simulate communication of image semantics demonstrating a 99.79% reduction in rate.
△ Less
Submitted 6 January, 2023; v1 submitted 4 October, 2022;
originally announced October 2022.
-
Recursive Gaussian Process over graphs for Integrating Multi-timescale Measurements in Low-Observable Distribution Systems
Authors:
Shweta Dahale,
Balasubramaniam Natarajan
Abstract:
The transition to a smarter grid is empowered by enhanced sensor deployments and smart metering infrastructure in the distribution system. Measurements from these sensors and meters can be used for many applications, including distribution system state estimation (DSSE). However, these measurements are typically sampled at different rates and could be intermittent due to losses during the aggregat…
▽ More
The transition to a smarter grid is empowered by enhanced sensor deployments and smart metering infrastructure in the distribution system. Measurements from these sensors and meters can be used for many applications, including distribution system state estimation (DSSE). However, these measurements are typically sampled at different rates and could be intermittent due to losses during the aggregation process. These multi time-scale measurements should be reconciled in real-time to perform accurate grid monitoring. This paper tackles this problem by formulating a recursive multi-task Gaussian process (RGP-G) approach that sequentially aggregates sensor measurements. Specifically, we formulate a recursive multi-task GP with and without network connectivity information to reconcile the multi time-scale measurements in distribution systems. The proposed framework is capable of aggregating the multi-time scale measurements batch-wise or in real-time. Following the aggregation of the multi time-scale measurements, the spatial states of the consistent time-series are estimated using matrix completion based DSSE approach. Simulation results on IEEE 37 and IEEE 123 bus test systems illustrate the efficiency of the proposed methods from the standpoint of both multi time-scale data aggregation and DSSE.
△ Less
Submitted 4 September, 2022;
originally announced September 2022.
-
Engineering Semantic Communication: A Survey
Authors:
Dylan Wheeler,
Balasubramaniam Natarajan
Abstract:
As the global demand for data has continued to rise exponentially, some have begun turning to the idea of semantic communication as a means of efficiently meeting this demand. Pushing beyond the boundaries of conventional communication systems, semantic communication focuses on the accurate recovery of the meaning conveyed from source to receiver, as opposed to the accurate recovery of transmitted…
▽ More
As the global demand for data has continued to rise exponentially, some have begun turning to the idea of semantic communication as a means of efficiently meeting this demand. Pushing beyond the boundaries of conventional communication systems, semantic communication focuses on the accurate recovery of the meaning conveyed from source to receiver, as opposed to the accurate recovery of transmitted symbols. In this survey, we aim to provide a comprehensive view of the history and current state of semantic communication and the techniques for engineering this higher level of communication. A survey of the current literature reveals four broad approaches to engineering semantic communication. We term the earliest of these approaches classical semantic information, which seeks to extend information-theoretic results to include semantic information. A second approach makes use of knowledge graphs to achieve semantic communication, and a third utilizes the power of modern deep learning techniques to facilitate this communication. The fourth approach focuses on the significance of information, rather than its meaning, to achieve efficient, goal-oriented communication. We discuss each of these four approaches and their corresponding studies in detail, and provide some challenges and opportunities that pertain to each approach. Finally, we introduce a novel approach to semantic communication, which we term context-based semantic communication. Inspired by the way in which humans naturally communicate with one another, this context-based approach provides a general, optimization-based design framework for semantic communication systems. Together, this survey provides a useful guide for the design and implementation of semantic communication systems.
△ Less
Submitted 4 October, 2022; v1 submitted 12 August, 2022;
originally announced August 2022.
-
Asynchronous Multiuser Detection for SCMA with Unknown Delays: A Compressed Sensing Approach
Authors:
Dylan Wheeler,
Erin E. Tripp,
Balasubramaniam Natarajan
Abstract:
Despite being the subject of a growing body of research, non-orthogonal multiple access has failed to garner sufficient support to be included in modern standards. One of the more promising approaches to non-orthogonal multiple access is sparse code multiple access, which seeks to utilize non-orthogonal, sparse spreading codes to share bandwidth among users more efficiently than traditional orthog…
▽ More
Despite being the subject of a growing body of research, non-orthogonal multiple access has failed to garner sufficient support to be included in modern standards. One of the more promising approaches to non-orthogonal multiple access is sparse code multiple access, which seeks to utilize non-orthogonal, sparse spreading codes to share bandwidth among users more efficiently than traditional orthogonal methods. Nearly all of the studies regarding sparse code multiple access assume synchronization at the receiver, which may not always be a practical assumption. In this work, we aim to bring this promising technology closer to a practical realization by dropping the assumption of synchronization. We therefore propose a compressed sensing-based delay estimation technique developed specifically for an uplink sparse code multiple access system. The proposed technique can be used with nearly all of the numerous decoding algorithms proposed in the existing literature, including the popular message passing approach. Furthermore, we derive a theoretical bound regarding the recovery performance of the proposed technique, and use simulations to demonstrate its viability in a practical uplink system.
△ Less
Submitted 12 August, 2022;
originally announced August 2022.
-
An Information Theoretic approach to identify Dominant Voltage Influencers for Unbalanced Distribution Systems
Authors:
Sai Munikoti,
Mohammad Abujubbeh,
Kumarsinh Jhala,
Balasubramaniam Natarajan
Abstract:
Smart distribution grid with multiple renewable energy sources can experience random voltage fluctuations due to variable generation, which may result in voltage violations. Traditional voltage control algorithms are inadequate to handle fast voltage variations. Therefore, new dynamic control methods are being developed that can significantly benefit from the knowledge of dominant voltage influenc…
▽ More
Smart distribution grid with multiple renewable energy sources can experience random voltage fluctuations due to variable generation, which may result in voltage violations. Traditional voltage control algorithms are inadequate to handle fast voltage variations. Therefore, new dynamic control methods are being developed that can significantly benefit from the knowledge of dominant voltage influencer (DVI) nodes. DVI nodes for a particular node of interest refer to nodes that have a relatively high impact on the voltage fluctuations at that node. Conventional power flow-based algorithms to identify DVI nodes are computationally complex, which limits their use in real-time applications. This paper proposes a novel information theoretic voltage influencing score (VIS) that quantifies the voltage influencing capacity of nodes with DERs/active loads in a three phase unbalanced distribution system. VIS is then employed to rank the nodes and identify the DVI set. VIS is derived analytically in a computationally efficient manner and its efficacy to identify DVI nodes is validated using the IEEE 37-node test system. It is shown through experiments that KL divergence and Bhattacharyya distance are effective indicators of DVI nodes with an identifying accuracy of more than 90%. The computation burden is also reduced by an order of 5, thus providing the foundation for efficient voltage control.
△ Less
Submitted 3 June, 2021;
originally announced June 2021.
-
Joint Matrix Completion and Compressed Sensing for State Estimation in Low-observable Distribution System
Authors:
Shweta Dahale,
Balasubramaniam Natarajan
Abstract:
Limited measurement availability at the distribution grid presents challenges for state estimation and situational awareness. This paper combines the advantages of two sparsity-based state estimation approaches (matrix completion and compressive sensing) that have been proposed recently to address the challenge of unobservability. The proposed approach exploits both the low rank structure and a su…
▽ More
Limited measurement availability at the distribution grid presents challenges for state estimation and situational awareness. This paper combines the advantages of two sparsity-based state estimation approaches (matrix completion and compressive sensing) that have been proposed recently to address the challenge of unobservability. The proposed approach exploits both the low rank structure and a suitable transform domain representation to leverage the correlation structure of the spatio-temporal data matrix while incorporating the power-flow constraints of the distribution grid. Simulations are carried out on three phase unbalanced IEEE 37 test system to verify the effectiveness of the proposed approach. The performance results reveal - (1) the superiority over traditional matrix completion and (2) very low state estimation errors for high compression ratios representing very low observability.
△ Less
Submitted 13 April, 2021;
originally announced April 2021.
-
Multi Time-scale Imputation aided State Estimation in Distribution System
Authors:
Shweta Dahale,
Balasubramaniam Natarajan
Abstract:
With the transition to a smart grid, we are witnessing a significant growth in sensor deployments and smart metering infrastructure in the distribution system. However, information from these sensors and meters are typically unevenly sampled at different time-scales and are incomplete. It is critical to effectively aggregate these information sources for situational awareness. In order to reconcil…
▽ More
With the transition to a smart grid, we are witnessing a significant growth in sensor deployments and smart metering infrastructure in the distribution system. However, information from these sensors and meters are typically unevenly sampled at different time-scales and are incomplete. It is critical to effectively aggregate these information sources for situational awareness. In order to reconcile the heterogeneous multi-scale time-series data, we present a multi-task Gaussian process framework. This framework exploits the spatio-temporal correlation across the time-series data to impute data at any desired time-scale while providing confidence bounds on the imputations. The value of the imputed data for distribution system operation is illustrated via a matrix completion based state estimation strategy. Results on the IEEE 37 bus distribution system reveals the superior performance of the proposed approach relative to linear interpolation approaches.
△ Less
Submitted 21 November, 2020;
originally announced November 2020.
-
Spatio-Temporal Probabilistic Voltage Sensitivity Analysis - A Novel Framework for Hosting Capacity Analysis
Authors:
Sai Munikoti,
Mohammad Abujubbeh,
Kumarsinh Jhala,
Balasubramaniam Natarajan
Abstract:
Smart grids are envisioned to accommodate high penetration of distributed photovoltaic (PV) generation, which may cause adverse grid impacts in terms of voltage violations. Therefore, PV Hosting capacity (HC) is being used as a planning tool to determine the maximum PV installation capacity that causes the first voltage violation and above which would require infrastructure upgrades. Traditional m…
▽ More
Smart grids are envisioned to accommodate high penetration of distributed photovoltaic (PV) generation, which may cause adverse grid impacts in terms of voltage violations. Therefore, PV Hosting capacity (HC) is being used as a planning tool to determine the maximum PV installation capacity that causes the first voltage violation and above which would require infrastructure upgrades. Traditional methods of HC analysis are computationally complex as they are based on iterative load flow algorithms that require investigation of a large number of scenarios for accurate assessment of PV impacts. This paper first presents a computationally efficient analytical approach to compute the probability distribution of voltage change at a particular node due to random behavior of randomly located multiple distributed PVs. Next, the derived distribution is used to identify voltage violations for various PV penetration levels and subsequently determine the HC of the system without the need to examine multiple scenarios. Results from the proposed spatio-temporal probabilistic voltage sensitivity analysis and the HC are validated via conventional load flow based simulation approach on the IEEE 37 and IEEE 123 node test systems.
△ Less
Submitted 8 February, 2021; v1 submitted 17 September, 2020;
originally announced September 2020.
-
Probabilistic Voltage Sensitivity Analysis (PVSA) to Quantify Impact of High PV Penetration on Unbalanced Distribution System
Authors:
Sai Munikoti,
Balasubramaniam Natarajan,
Kumarsinh Jhala,
Kexing Lai
Abstract:
From an operational and planning perspective, it is important to quantify the impact of increasing penetration of photovoltaics on the distribution system. Most existing impact assessment studies are scenario-based where derived results are scenario specific and not generalizable. Moreover, stochasticity in the temporal behavior of spatially distributed PVs requires a large number of scenarios tha…
▽ More
From an operational and planning perspective, it is important to quantify the impact of increasing penetration of photovoltaics on the distribution system. Most existing impact assessment studies are scenario-based where derived results are scenario specific and not generalizable. Moreover, stochasticity in the temporal behavior of spatially distributed PVs requires a large number of scenarios that increase with the size of the network and the level of penetration. Therefore, we propose a new computationally efficient analytical framework of voltage sensitivity analysis that allows for stochastic analysis of voltage change due to random changes in PV generation. We first derive an analytical approximation for voltage change at any node of the network due to change in power at other nodes in an unbalanced distribution network. The quality of this approximation is reinforced via bounds on the approximation error. Then, we derive the probability distribution of voltage change at a certain node due to random changes in power injections/consumptions at multiple locations of the network. The accuracy of the proposed PVSA is illustrated using a modified version of the IEEE 37 bus test system. The proposed PVSA can serve as a powerful tool for proactive monitoring/control and ease the computational burden associated with perturbation based cybersecurity mechanisms.
△ Less
Submitted 12 September, 2020;
originally announced September 2020.
-
Analytical Voltage Sensitivity Analysis for Unbalanced Power Distribution System
Authors:
Sai Munikoti,
Kumarsinh Jhala,
Kexing Lai,
Balasubramaniam Natarajan
Abstract:
Large scale integration of distributed energy resources and electric vehicles in a transactive energy environment present new challenges in terms of voltage stability and fluctuations in a power distribution system. The impact of different level of DER/EV penetration on the voltages across the network is typically quantified through voltage sensitivity analyses. Existing methods of voltage sensiti…
▽ More
Large scale integration of distributed energy resources and electric vehicles in a transactive energy environment present new challenges in terms of voltage stability and fluctuations in a power distribution system. The impact of different level of DER/EV penetration on the voltages across the network is typically quantified through voltage sensitivity analyses. Existing methods of voltage sensitivity analysis are computationally expensive and prior efforts to develop analytical approximation lacks generality and have not been effectively validated. The objective of this work is to provide a new analytical method of voltage sensitivity analysis that has low computational cost and also allows for stochastic analysis of voltage change. This paper first derives an analytical approximation of change in voltage at a particular bus due to change in power consumption at other bus in a radial three phase unbalanced power distribution system. Then, the proposed method is shown to be valid for different load configurations, which demonstrates its generality. The results from our analytical approach is validated via classical load flow simulation of the test system based on IEEE 37 bus network. The proposed method is shown to have good accuracy, and computation complexity is of order O(1), compared to O(n3) in classical sensitivity analysis approaches.
△ Less
Submitted 11 September, 2020;
originally announced September 2020.
-
Robustness Assessment of Hetero-Functional Graph Theory Based Model of Interdependent Urban Utility Networks
Authors:
Sai Munikoti,
Kexing Lai,
Balasubramaniam Natarajan
Abstract:
The increasing urban population imposes a substantial and growing burden on the supporting infrastructure, such as electricity, water, heating, natural gas, road transportation, etc. This paper presents a Hetero-functional graph theory (HFGT) based modeling framework for these integrated infrastructures followed by an analysis of network robustness. The supporting infrastructures along with the in…
▽ More
The increasing urban population imposes a substantial and growing burden on the supporting infrastructure, such as electricity, water, heating, natural gas, road transportation, etc. This paper presents a Hetero-functional graph theory (HFGT) based modeling framework for these integrated infrastructures followed by an analysis of network robustness. The supporting infrastructures along with the infrastructure repair facilities are considered. In contrast to conventional graph representations, a weighted HFGT model is used to capture the system processes and mutual dependencies among resources. To assess robustness of the inter-dependent networks, impacts of complete/partial and random/targeted attacks are quantified. Specifically, various contingency scenarios are simulated and the vulnerability of the network is evaluated. Additionally, several robustness metrics are proposed to provide a comprehensive evaluation of system robustness. The proposed weighted HFGT modeling and robustness assessment approach is tested using a synthetic interdependent network, comprising of an electrical power system, a water network, a district heating network, a natural gas system and a road transportation network. Results demonstrate that system robustness can be enhanced via securing system information and mitigating attack strength.
△ Less
Submitted 26 August, 2020;
originally announced August 2020.
-
Probabilistic Voltage Sensitivity based Preemptive Voltage Monitoring in Unbalanced Distribution Networks
Authors:
Mohammad Abujubbeh,
Sai Munikoti,
Balasubramaniam Natarajan
Abstract:
With increasing penetration of renewable energy and active consumers, control and management of power distribution networks has become challenging. Renewable energy sources can cause random voltage fluctuations as their output power depends on weather conditions. Conventional voltage control schemes such as tap changers and capacitor banks lack the foresight required to quickly alleviate voltage v…
▽ More
With increasing penetration of renewable energy and active consumers, control and management of power distribution networks has become challenging. Renewable energy sources can cause random voltage fluctuations as their output power depends on weather conditions. Conventional voltage control schemes such as tap changers and capacitor banks lack the foresight required to quickly alleviate voltage violations. Thus, there is an urgent need for effective approaches for predicting and mitigating voltage violations as a result of random fluctuations in power injections. This work proposes a novel voltage monitoring approach based on low-complexity, data-driven probabilistic voltage sensitivity analysis. The usefulness of this work is not only in predicting voltage violations in unbalanced distribution grids, but also in opening up the door for optimal voltage control. Using system data and forecasts, the proposed approach predicts the distribution of system node voltages which is then used to to identify nodes that may violate the nominal operational limits with high probability. The method is tested on the IEEE 37 node distribution system considering integrated distributed solar energy sources. The method is validated against the classic load flow based method and offers over 95\% accuracy in predicting voltage violations.
△ Less
Submitted 25 August, 2020;
originally announced August 2020.
-
Parallel Intent and Slot Prediction using MLB Fusion
Authors:
Anmol Bhasin,
Bharatram Natarajan,
Gaurav Mathur,
Himanshu Mangla
Abstract:
Intent and Slot Identification are two important tasks in Spoken Language Understanding (SLU). For a natural language utterance, there is a high correlation between these two tasks. A lot of work has been done on each of these using Recurrent-Neural-Networks (RNN), Convolution Neural Networks (CNN) and Attention based models. Most of the past work used two separate models for intent and slot predi…
▽ More
Intent and Slot Identification are two important tasks in Spoken Language Understanding (SLU). For a natural language utterance, there is a high correlation between these two tasks. A lot of work has been done on each of these using Recurrent-Neural-Networks (RNN), Convolution Neural Networks (CNN) and Attention based models. Most of the past work used two separate models for intent and slot prediction. Some of them also used sequence-to-sequence type models where slots are predicted after evaluating the utterance-level intent. In this work, we propose a parallel Intent and Slot Prediction technique where separate Bidirectional Gated Recurrent Units (GRU) are used for each task. We posit the usage of MLB (Multimodal Low-rank Bilinear Attention Network) fusion for improvement in performance of intent and slot learning. To the best of our knowledge, this is the first attempt of using such a technique on text based problems. Also, our proposed methods outperform the existing state-of-the-art results for both intent and slot prediction on two benchmark datasets
△ Less
Submitted 20 March, 2020;
originally announced March 2020.
-
Reinforcement Learning for Mitigating Intermittent Interference in Terahertz Communication Networks
Authors:
Reza Barazideh,
Omid Semiari,
Solmaz Niknam,
Balasubramaniam Natarajan
Abstract:
Emerging wireless services with extremely high data rate requirements, such as real-time extended reality applications, mandate novel solutions to further increase the capacity of future wireless networks. In this regard, leveraging large available bandwidth at terahertz frequency bands is seen as a key enabler. To overcome the large propagation loss at these very high frequencies, it is inevitabl…
▽ More
Emerging wireless services with extremely high data rate requirements, such as real-time extended reality applications, mandate novel solutions to further increase the capacity of future wireless networks. In this regard, leveraging large available bandwidth at terahertz frequency bands is seen as a key enabler. To overcome the large propagation loss at these very high frequencies, it is inevitable to manage transmissions over highly directional links. However, uncoordinated directional transmissions by a large number of users can cause substantial interference in terahertz networks. While such interference will be received over short random time intervals, the received power can be large. In this work, a new framework based on reinforcement learning is proposed that uses an adaptive multi-thresholding strategy to efficiently detect and mitigate the intermittent interference from directional links in the time domain. To find the optimal thresholds, the problem is formulated as a multidimensional multi-armed bandit system. Then, an algorithm is proposed that allows the receiver to learn the optimal thresholds with very low complexity. Another key advantage of the proposed approach is that it does not rely on any prior knowledge about the interference statistics, and hence, it is suitable for interference mitigation in dynamic scenarios. Simulation results confirm the superior bit-error-rate performance of the proposed method compared with two traditional time-domain interference mitigation approaches.
△ Less
Submitted 10 March, 2020;
originally announced March 2020.
-
Analyzing the Trade-offs in Using Millimeter Wave Directional Links for High Data Rate Tactile Internet Applications
Authors:
Kishor Chandra Joshi,
Solmaz Niknam,
R. Venkatesha Prasad,
Balasubramaniam Natarajan
Abstract:
Ultra-low latency and high reliability communications are the two defining characteristics of Tactile Internet (TI). Nevertheless, some TI applications would also require high data-rate transfer of audio-visual information to complement the haptic data. Using Millimeter wave (mmWave) communications is an attractive choice for high datarate TI applications due to the availability of large bandwidth…
▽ More
Ultra-low latency and high reliability communications are the two defining characteristics of Tactile Internet (TI). Nevertheless, some TI applications would also require high data-rate transfer of audio-visual information to complement the haptic data. Using Millimeter wave (mmWave) communications is an attractive choice for high datarate TI applications due to the availability of large bandwidth in the mmWave bands. Moreover, mmWave radio access is also advantageous to attain the airinterface-diversity required for high reliability in TI systems as mmWave signal propagation significantly differs to sub-6GHz propagation. However, the use of narrow beamwidth in mmWave systems makes them susceptible to link misalignment-induced unreliability and high access latency. In this paper, we analyze the trade-offs between high gain of narrow beamwidth antennas and corresponding susceptibility to misalignment in mmWave links. To alleviate the effects of random antenna misalignment, we propose a beamwidth-adaptation scheme that significantly stabilize the link throughput performance.
△ Less
Submitted 9 September, 2019;
originally announced September 2019.
-
Impulsive Noise Mitigation in Underwater Acoustic Communication Systems: Experimental Studies
Authors:
Reza Barazideh,
Wensheng Sun,
Balasubramaniam Natarajan,
Alexei V. Nikitin,
Zhaohui Wang
Abstract:
Impulsive noise is a major impediment to orthogonal frequency-division multiplexing (OFDM) based underwater acoustic (UWA) communications. In this work, we evaluate the performance of a memoryless analog nonlinear preprocessor (MANP) that is used to mitigate outliers. The proposed MANP exhibits intermittent nonlinearity only in the presence of the impulsive noise and suppresses the power of outlie…
▽ More
Impulsive noise is a major impediment to orthogonal frequency-division multiplexing (OFDM) based underwater acoustic (UWA) communications. In this work, we evaluate the performance of a memoryless analog nonlinear preprocessor (MANP) that is used to mitigate outliers. The proposed MANP exhibits intermittent nonlinearity only in the presence of the impulsive noise and suppresses the power of outliers based on their amplitudes. Since the outliers are distinguishable in the analog domain prior to anti-aliasing filtering, the MANP outperforms its digital counterparts in all scenarios. Experimental results using data collected in an under-ice environment, demonstrate the superior BER performance of our approach relative to classical nonlinear approaches such as blanking and clipping.
△ Less
Submitted 2 January, 2019;
originally announced January 2019.
-
Impulsive Noise Detection in OFDM-based Systems: A Deep Learning Perspective
Authors:
Reza Barazideh,
Solmaz Niknam,
Balasubramaniam Natarajan
Abstract:
Efficient removal of impulsive noise (IN) from received signal is essential in many communication applications. In this paper, we propose a two stage IN mitigation approach for orthogonal frequency-division multiplexing (OFDM)-based communication systems. In the first stage, a deep neural network (DNN) is used to detect the instances of impulsivity. Then, the detected IN is blanked in the suppress…
▽ More
Efficient removal of impulsive noise (IN) from received signal is essential in many communication applications. In this paper, we propose a two stage IN mitigation approach for orthogonal frequency-division multiplexing (OFDM)-based communication systems. In the first stage, a deep neural network (DNN) is used to detect the instances of impulsivity. Then, the detected IN is blanked in the suppression stage to alleviate the harmful effects of outliers. Simulation results demonstrate the superior bit error rate (BER) performance of this approach relative to classic approaches such as blanking and clipping that use threshold to detect the IN. We demonstrate the robustness of the DNN-based approach under (i) mismatch between IN models considered for training and testing, and (ii) bursty impulsive environment when the receiver is empowered with interleaving techniques.
△ Less
Submitted 2 January, 2019;
originally announced January 2019.
-
Performance Analysis of Analog Intermittently Nonlinear Filter in the Presence of Impulsive Noise
Authors:
Reza Barazideh,
Balasubramaniam Natarajan,
Alexei V. Nikitin,
Solmaz Niknam
Abstract:
An Adaptive Nonlinear Differential Limiter (ANDL) is proposed in this paper to efficiently alleviate the impact of impulsive noise (IN) in a communication system. Unlike existing nonlinear methods, the ANDL is implemented in the analog domain where the broader acquisition bandwidth makes outliers more detectable and consequently it is easier to remove them. While the proposed ANDL behaves like a l…
▽ More
An Adaptive Nonlinear Differential Limiter (ANDL) is proposed in this paper to efficiently alleviate the impact of impulsive noise (IN) in a communication system. Unlike existing nonlinear methods, the ANDL is implemented in the analog domain where the broader acquisition bandwidth makes outliers more detectable and consequently it is easier to remove them. While the proposed ANDL behaves like a linear filter when there is no outlier, it exhibits intermittent nonlinearity in response to IN. Therefore, the structure of the matched filter in the receiver is modified to compensate the filtering effect of the ANDL in the linear regime. In this paper, we quantify the performance of the ANDL by deriving a closed-form analytical bound for the average signal-to-noise ratio (SNR) at the output of the filter. The calculation is based on the idea that the ANDL can be perceived as a time-variant linear filter whose bandwidth is modified based on the intensity of the IN. In addition, by linearizing the filter time parameter variations, we treat the ANDL as a set of linear filters where the exact operating filter at a given time depends upon the magnitude of the outliers. The theoretical average bit error rate (BER) is validated through simulations and the performance gains relative to classical methods such as blanking and clipping are quantified.
△ Less
Submitted 21 November, 2018;
originally announced November 2018.
-
Cross-layer Interference Modeling for 5G MmWave Networks in the Presence of Blockage
Authors:
Solmaz Niknam,
Reza Barazideh,
Balasubramaniam Natarajan
Abstract:
Fifth generation (5G) wireless technology is expected to utilize highly directive antennas at millimeter wave (mmWave) spectrum to offer higher data rates. However, given the high directivity of antennas and adverse propagation characteristics at mmWave frequencies, these signals are very susceptible to obstacles. One of the important factors that are highly impacted is interference behavior. In f…
▽ More
Fifth generation (5G) wireless technology is expected to utilize highly directive antennas at millimeter wave (mmWave) spectrum to offer higher data rates. However, given the high directivity of antennas and adverse propagation characteristics at mmWave frequencies, these signals are very susceptible to obstacles. One of the important factors that are highly impacted is interference behavior. In fact, signals received from other terminals can be easily blocked or attenuated at the receiver. In addition, higher number of terminals can transmit signals without introducing much interference and hence the traffic behavior, maintained by medium access control (MAC) layer, may change. In this paper, we provide an interference model to evaluate the interference power received at the physical layer of the receiving terminal, considering antenna directivity, effect of obstacles and MAC layer constraints that control the number of terminals transmitting simultaneously. We first develop a blockage model and then derive the Laplace transform of the interference power received at a typical receiving node. Subsequently, using the derived Laplace transform, we evaluate the network error performance using average bit-error-rate (BER). Analytical results are validated via Monte-Carlo simulations.
△ Less
Submitted 11 July, 2018;
originally announced July 2018.
-
On the Regimes in Millimeter wave Networks: Noise-limited or Interference-limited?
Authors:
Solmaz Niknam,
Balasubramaniam Natarajan
Abstract:
Given the overcrowding in the 300 MHz-3 GHz spectrum, millimeter wave (mmWave) spectrum is a promising candidate for the future generations of wireless networks. With the unique propagation characteristics at mmWave frequencies, one of the fundamental questions to address is whether mmWave networks are noise or interference-limited. The regime in which the network operates significantly impacts th…
▽ More
Given the overcrowding in the 300 MHz-3 GHz spectrum, millimeter wave (mmWave) spectrum is a promising candidate for the future generations of wireless networks. With the unique propagation characteristics at mmWave frequencies, one of the fundamental questions to address is whether mmWave networks are noise or interference-limited. The regime in which the network operates significantly impacts the MAC layer design, resource allocation procedure and also interference management techniques. In this paper, we first derive the statistical characteristic of the cumulative interference in finite-sized mmWave networks considering configuration randomness across spatial and spectral domains while including the effect of blockages. Subsequently, using the derived interference model we set up a likelihood ratio test (LRT) (that is dependent on various network parameters) in order to detect the regime of the network from an arbitrarily located user standpoint. Unlike traditional networks, in mmWave networks, different likelihood of experiencing an interference-limited regime can be observed at different locations.
△ Less
Submitted 10 April, 2018;
originally announced April 2018.
-
Practical Implementation of Adaptive Analog Nonlinear Filtering For Impulsive Noise Mitigation
Authors:
Reza Barazideh,
Alexei V. Nikitin,
Balasubramaniam Natarajan
Abstract:
It is well known that the performance of OFDM-based Powerline Communication (PLC) systems is impacted by impulsive noise. In this work, we propose a practical blind adaptive analog nonlinear filter to efficiently detect and mitigate impulsive noise. Specially, we design an Adaptive Canonical Differential Limiter (ACDL) which is constructed from a Clipped Mean Tracking Filter (CMTF) and Quartile Tr…
▽ More
It is well known that the performance of OFDM-based Powerline Communication (PLC) systems is impacted by impulsive noise. In this work, we propose a practical blind adaptive analog nonlinear filter to efficiently detect and mitigate impulsive noise. Specially, we design an Adaptive Canonical Differential Limiter (ACDL) which is constructed from a Clipped Mean Tracking Filter (CMTF) and Quartile Tracking Filters (QTFs). The QTFs help to determine a real-time range that excludes outliers. This range is fed into the CMTF which is responsible for mitigating impulsive noise. The CMTF is a nonlinear analog filter and its nonlinearity is controlled by the aforementioned range. Proper selection of this range ensures the improvement of the desired signal quality in impulsive environment. It is important to note that the proposed ACDL behaves like a linear filter in case of no impulsive noise. In this context, the traditional matched filter construction is modified to ensure distortionless processing of the desired signal. The performance improvement of the proposed ACDL is due to the fact that unlike other nonlinear methods, the ACDL is implemented in the analog domain where the outliers are still broadband and distinguishable. Simulation results in PRIME (OFDM-based narrowband PLC system) demonstrate the superior BER performance of ACDL relative to other nonlinear approaches such as blanking and clipping in impulsive noise environments.
△ Less
Submitted 1 March, 2018;
originally announced March 2018.
-
Performance of Analog Nonlinear Filtering for Impulsive Noise Mitigation in OFDM-based PLC Systems
Authors:
Reza Barazideh,
Balasubramaniam Natarajan,
Alexei V. Nikitin,
Ruslan L. Davidchack
Abstract:
Asynchronous and cyclostationary impulsive noise can severely impact the bit-error-rate (BER) of OFDM-based powerline communication systems. In this paper, we analyze an adaptive nonlinear analog front end filter that mitigates various types of impulsive noise without detrimental effects such as self-interference and out-of-band power leakage caused by other nonlinear approaches like clipping and…
▽ More
Asynchronous and cyclostationary impulsive noise can severely impact the bit-error-rate (BER) of OFDM-based powerline communication systems. In this paper, we analyze an adaptive nonlinear analog front end filter that mitigates various types of impulsive noise without detrimental effects such as self-interference and out-of-band power leakage caused by other nonlinear approaches like clipping and blanking. Our proposed Adaptive Nonlinear Differential Limiter (ANDL) is constructed from a linear analog filter by applying a feedback-based nonlinearity, controlled by a single resolution parameter. We present a simple practical method to find the value of this resolution parameter that ensures the mitigation of impulsive without impacting the desired OFDM signal. Unlike many prior approaches for impulsive noise mitigation that assume a statistical noise model, ANDL is blind to the exact nature of the noise distribution, and is designed to be fully compatible with existing linear front end filters. We demonstrate the potency of ANDL by simulating the OFDM-based narrowband PLC compliant with the IEEE standards. We show that the proposed ANDL outperforms other approaches in reducing the BER in impulsive noise environments.
△ Less
Submitted 8 December, 2017;
originally announced December 2017.
-
A Spatial-Spectral Interference Model for Millimeter Wave 5G Applications
Authors:
Solmaz Niknam,
Balasubramaniam Natarajan,
Hani Mehrpouyan
Abstract:
The potential of the millimeter wave (mmWave) band in meeting the ever growing demand for high data rate and capacity in emerging fifth generation (5G) wireless networks is well-established. Since mmWave systems are expected to use highly directional antennas with very focused beams to overcome severe pathloss and shadowing in this band, the nature of signal propagation in mmWave wireless networks…
▽ More
The potential of the millimeter wave (mmWave) band in meeting the ever growing demand for high data rate and capacity in emerging fifth generation (5G) wireless networks is well-established. Since mmWave systems are expected to use highly directional antennas with very focused beams to overcome severe pathloss and shadowing in this band, the nature of signal propagation in mmWave wireless networks may differ from current networks. One factor that is influenced by such propagation characteristics is the interference behavior, which is also impacted by simultaneous use of the unlicensed portion of the spectrum by multiple users. Therefore, considering the propagation characteristics in the mmWave band, we propose a spatial-spectral interference model for 5G mmWave applications, in the presence of Poisson field of blockages and interferers operating in licensed and unlicensed mmWave spectrum. Consequently, the average bit error rate of the network is calculated. Simulation is also carried out to verify the outcomes of the paper.
△ Less
Submitted 11 October, 2017;
originally announced October 2017.
-
A Spatial-Spectral Interference Model for Dense Finite-Area 5G mmWave Networks
Authors:
Solmaz Niknam,
Balasubramaniam Natarajan,
Reza Barazideh
Abstract:
With the overcrowded sub-6 GHz bands, millimeter wave (mmWave) bands offer a promising alternative for the next generation wireless standard, i.e., 5G. However, the susceptibility of mmWave signals to severe pathloss and shadowing requires the use of highly directional antennas to overcome such adverse characteristics. Building a network with directional beams changes the interference behavior, si…
▽ More
With the overcrowded sub-6 GHz bands, millimeter wave (mmWave) bands offer a promising alternative for the next generation wireless standard, i.e., 5G. However, the susceptibility of mmWave signals to severe pathloss and shadowing requires the use of highly directional antennas to overcome such adverse characteristics. Building a network with directional beams changes the interference behavior, since, narrow beams are vulnerable to blockages. Such sensitivity to blockages causes uncertainty in the active interfering node locations. Configuration uncertainty may also manifest in the spectral domain while applying dynamic channel and frequency assignment to support 5G applications. In this paper, we first propose a blockage model considering mmWave specifications. Subsequently, using the proposed blockage model, we derive a spatial-spectral interference model for dense finite-area 5G mmWave networks. The proposed interference model considers both spatial and spectral randomness in node configuration. Finally, the error performance of the network from an arbitrarily located user perspective is calculated in terms of bit error rate (BER) and outage probability metrics. The analytical results are validated via Monte-Carlo simulations. It is shown that considering mmWave specifications and also randomness in both spectral and spatial node configurations leads to a noticeably different interference profile.
△ Less
Submitted 11 October, 2017;
originally announced October 2017.
