Showing 1–27 of 27 results for author: Mukhopadhyay, S

Development of a Scaled Setup for Experimental Study of the Effect of Lateral Dynamics on Energy Consumption in Electric Vehicles: An Extension

Authors: Simran Kumari, Anand Ronald K., Siddhartha Mukhopadhyay, Ashish R. Hota

Abstract: Most of the existing state-of-the-art approaches for energy consumption analysis do not account for the effect of lateral dynamics on energy consumption in electric vehicles (EVs) during vehicle maneuvers. This paper aims to validate this effect through an experimental study. We develop a scaled model using a radio-controlled (RC) car, modified to achieve dynamic similitude with on-road vehicles,… ▽ More Most of the existing state-of-the-art approaches for energy consumption analysis do not account for the effect of lateral dynamics on energy consumption in electric vehicles (EVs) during vehicle maneuvers. This paper aims to validate this effect through an experimental study. We develop a scaled model using a radio-controlled (RC) car, modified to achieve dynamic similitude with on-road vehicles, to conduct scaled experiments. The experimental results confirm the impact of lateral dynamics on both energy demand and driving range in electric vehicles, aligning with our previous findings [1], and emphasize the need to incorporate these factors into energy consumption models. This is an extended version of a paper accepted at IEEE ITEC 2025. It includes additional results and analysis. △ Less

Submitted 21 May, 2025; v1 submitted 20 May, 2025; originally announced May 2025.

Signal-based online acceleration and strain data fusion using B-splines and Kalman filter for full-field dynamic displacement estimation

Authors: Aniruddha Das, Ashish Pal, Satish Nagarajaiah, Mohamed Sajeer M, Suparno Mukhopadhyay

Abstract: Displacement plays a crucial role in structural health monitoring (SHM) and damage detection of structural systems subjected to dynamic loads. However, due to the inconvenience associated with the direct measurement of displacement during dynamic loading and the high cost of displacement sensors, the use of displacement measurements often gets restricted. In recent years, indirect estimation of di… ▽ More Displacement plays a crucial role in structural health monitoring (SHM) and damage detection of structural systems subjected to dynamic loads. However, due to the inconvenience associated with the direct measurement of displacement during dynamic loading and the high cost of displacement sensors, the use of displacement measurements often gets restricted. In recent years, indirect estimation of displacement from acceleration and strain data has gained popularity. Several researchers have developed data fusion techniques to estimate displacement from acceleration and strain data. However, existing data fusion techniques mostly rely on system properties like mode shapes or finite element models and require accurate knowledge about the system for successful implementation. Hence, they have the inherent limitation of their applicability being restricted to relatively simple structures where such information is easily available. In this article, B-spline basis functions have been used to formulate a Kalman filter-based algorithm for acceleration and strain data fusion using only elementary information about the system, such as the geometry and boundary conditions, which is the major advantage of this method. Also, the proposed algorithm enables us to monitor the full-field displacement of the system online with only a limited number of sensors. The method has been validated on a numerically generated dataset from the finite element model of a tapered beam subjected to dynamic excitation. Later, the proposed data fusion technique was applied to an experimental benchmark test of a wind turbine blade under dynamic load to estimate the displacement time history. In both cases, the reconstructed displacement from strain and acceleration was found to match well with the response from the FE model. △ Less

Submitted 28 November, 2024; originally announced November 2024.

Comments: 20 pages, 17 figures

Aerodynamics and Sensing Analysis for Efficient Drone-Based Parcel Delivery

Authors: Avishkar Seth, Alice James, Endrowednes Kuantama, Subhas Mukhopadhyay, Richard Han

Abstract: In an era of rapid urbanization and e-commerce growth, efficient parcel delivery methods are crucial. This paper presents a detailed study of the aerodynamics and sensing analysis of drones for parcel delivery. Utilizing Computational Fluid Dynamics (CFD), the study offers a comprehensive airflow analysis, revealing the aerodynamic forces affecting drone stability due to payload capacity. A multid… ▽ More In an era of rapid urbanization and e-commerce growth, efficient parcel delivery methods are crucial. This paper presents a detailed study of the aerodynamics and sensing analysis of drones for parcel delivery. Utilizing Computational Fluid Dynamics (CFD), the study offers a comprehensive airflow analysis, revealing the aerodynamic forces affecting drone stability due to payload capacity. A multidisciplinary approach is employed, integrating mechanical design, control theory, and sensing systems to address the complex issue of parcel positioning. The experimental validation section rigorously tests different size payloads and their positions and impact on drones with maximum thrusts of 2000 gf. The findings prove the drone's capacity to lift a large payload that covers up to 50 percent of the propeller, thereby contributing to optimizing drone designs and sustainable parcel delivery systems. It has been observed that the drone can lift a large payload smoothly when placed above the drone, with an error rate as low as 0.1 percent for roll, pitch, and yaw. This work paved the way for more versatile, real-world applications of drone technology, setting a new standard in the field. △ Less

Submitted 27 October, 2024; originally announced October 2024.

Comments: 6 pages, 9 figures

Optimal One- and Two-Sided Multi-level ASK Modulation or RIS-Assisted Noncoherent Communication Systems

Authors: Srijika Mukhopadhyay, Badri Ramanjaneya Reddy, Soumya P. Dash, George C. Alexandropoulos, Sonia Aissa

Abstract: In this paper, we analyze the performance of one- and two-sided amplitude shift keying (ASK) modulations in single-input single-output wireless communication aided by a reconfigurable intelligent surface (RIS). Two scenarios are considered for the channel conditions: a blocked direct channel between the transmitter and the receiver, and an unblocked one. For the receiver, a noncoherent maximum lik… ▽ More In this paper, we analyze the performance of one- and two-sided amplitude shift keying (ASK) modulations in single-input single-output wireless communication aided by a reconfigurable intelligent surface (RIS). Two scenarios are considered for the channel conditions: a blocked direct channel between the transmitter and the receiver, and an unblocked one. For the receiver, a noncoherent maximum likelihood detector is proposed, which detects the transmitted data signal based on statistical knowledge of the channel. The system's performance is then evaluated by deriving the symbol error probability (SEP) for both scenarios using the proposed noncoherent receiver structures. We also present a novel optimization framework to obtain the optimal one- and two-sided ASK modulation schemes that minimize the SEP under constraints on the available average transmit power for both the blocked and unblocked direct channel scenarios. Our extensive numerical investigations showcase that the considered RIS-aided communication system achieves superior error performance with both derived SEP-optimal ASK modulation schemes as compared to respective traditional ASK modulation. It is also demonstrated that, between the two proposed modulation schemes, the two-sided one yields the best SEP. The error performance is further analyzed for different system parameters, providing a comprehensive performance investigation of RIS-assisted noncoherent wireless communication systems. △ Less

Submitted 2 October, 2024; originally announced October 2024.

Comments: 13 pages, 6 figures

Bridging Autoencoders and Dynamic Mode Decomposition for Reduced-order Modeling and Control of PDEs

Authors: Priyabrata Saha, Saibal Mukhopadhyay

Abstract: Modeling and controlling complex spatiotemporal dynamical systems driven by partial differential equations (PDEs) often necessitate dimensionality reduction techniques to construct lower-order models for computational efficiency. This paper explores a deep autoencoding learning method for reduced-order modeling and control of dynamical systems governed by spatiotemporal PDEs. We first analytically… ▽ More Modeling and controlling complex spatiotemporal dynamical systems driven by partial differential equations (PDEs) often necessitate dimensionality reduction techniques to construct lower-order models for computational efficiency. This paper explores a deep autoencoding learning method for reduced-order modeling and control of dynamical systems governed by spatiotemporal PDEs. We first analytically show that an optimization objective for learning a linear autoencoding reduced-order model can be formulated to yield a solution closely resembling the result obtained through the dynamic mode decomposition with control algorithm. We then extend this linear autoencoding architecture to a deep autoencoding framework, enabling the development of a nonlinear reduced-order model. Furthermore, we leverage the learned reduced-order model to design controllers using stability-constrained deep neural networks. Numerical experiments are presented to validate the efficacy of our approach in both modeling and control using the example of a reaction-diffusion system. △ Less

Submitted 9 September, 2024; originally announced September 2024.

Comments: 8 pages, 5 figures. Accepted to IEEE Conference on Decision and Control (CDC 2024)

RoboKoop: Efficient Control Conditioned Representations from Visual Input in Robotics using Koopman Operator

Authors: Hemant Kumawat, Biswadeep Chakraborty, Saibal Mukhopadhyay

Abstract: Developing agents that can perform complex control tasks from high-dimensional observations is a core ability of autonomous agents that requires underlying robust task control policies and adapting the underlying visual representations to the task. Most existing policies need a lot of training samples and treat this problem from the lens of two-stage learning with a controller learned on top of pr… ▽ More Developing agents that can perform complex control tasks from high-dimensional observations is a core ability of autonomous agents that requires underlying robust task control policies and adapting the underlying visual representations to the task. Most existing policies need a lot of training samples and treat this problem from the lens of two-stage learning with a controller learned on top of pre-trained vision models. We approach this problem from the lens of Koopman theory and learn visual representations from robotic agents conditioned on specific downstream tasks in the context of learning stabilizing control for the agent. We introduce a Contrastive Spectral Koopman Embedding network that allows us to learn efficient linearized visual representations from the agent's visual data in a high dimensional latent space and utilizes reinforcement learning to perform off-policy control on top of the extracted representations with a linear controller. Our method enhances stability and control in gradient dynamics over time, significantly outperforming existing approaches by improving efficiency and accuracy in learning task policies over extended horizons. △ Less

Submitted 4 September, 2024; originally announced September 2024.

Comments: Accepted to the $8^{th}$ Conference on Robot Learning (CoRL 2024)

Real-time Digital RF Emulation -- II: A Near Memory Custom Accelerator

Authors: Mandovi Mukherjee, Xiangyu Mao, Nael Rahman, Coleman DeLude, Joe Driscoll, Sudarshan Sharma, Payman Behnam, Uday Kamal, Jongseok Woo, Daehyun Kim, Sharjeel Khan, Jianming Tong, Jamin Seo, Prachi Sinha, Madhavan Swaminathan, Tushar Krishna, Santosh Pande, Justin Romberg, Saibal Mukhopadhyay

Abstract: A near memory hardware accelerator, based on a novel direct path computational model, for real-time emulation of radio frequency systems is demonstrated. Our evaluation of hardware performance uses both application-specific integrated circuits (ASIC) and field programmable gate arrays (FPGA) methodologies: 1). The ASIC testchip implementation, using TSMC 28nm CMOS, leverages distributed autonomous… ▽ More A near memory hardware accelerator, based on a novel direct path computational model, for real-time emulation of radio frequency systems is demonstrated. Our evaluation of hardware performance uses both application-specific integrated circuits (ASIC) and field programmable gate arrays (FPGA) methodologies: 1). The ASIC testchip implementation, using TSMC 28nm CMOS, leverages distributed autonomous control to extract concurrency in compute as well as low latency. It achieves a $518$ MHz per channel bandwidth in a prototype $4$-node system. The maximum emulation range supported in this paradigm is $9.5$ km with $0.24$ $μ$s of per-sample emulation latency. 2). The FPGA-based implementation, evaluated on a Xilinx ZCU104 board, demonstrates a $9$-node test case (two Transmitters, one Receiver, and $6$ passive reflectors) with an emulation range of $1.13$ km to $27.3$ km at $215$ MHz bandwidth. △ Less

Submitted 12 June, 2024; originally announced June 2024.

Real-time Digital RF Emulation -- I: The Direct Path Computational Model

Authors: Coleman DeLude, Joe Driscoll, Mandovi Mukherjee, Nael Rahman, Uday Kamal, Xiangyu Mao, Sharjeel Khan, Hariharan Sivaraman, Eric Huang, Jeffrey McHarg, Madhavan Swaminathan, Santosh Pande, Saibal Mukhopadhyay, Justin Romberg

Abstract: In this paper we consider the problem of developing a computational model for emulating an RF channel. The motivation for this is that an accurate and scalable emulator has the potential to minimize the need for field testing, which is expensive, slow, and difficult to replicate. Traditionally, emulators are built using a tapped delay line model where long filters modeling the physical interaction… ▽ More In this paper we consider the problem of developing a computational model for emulating an RF channel. The motivation for this is that an accurate and scalable emulator has the potential to minimize the need for field testing, which is expensive, slow, and difficult to replicate. Traditionally, emulators are built using a tapped delay line model where long filters modeling the physical interactions of objects are implemented directly. For an emulation scenario consisting of $M$ objects all interacting with one another, the tapped delay line model's computational requirements scale as $O(M^3)$ per sample: there are $O(M^2)$ channels, each with $O(M)$ complexity. In this paper, we develop a new ``direct path" model that, while remaining physically faithful, allows us to carefully factor the emulator operations, resulting in an $O(M^2)$ per sample scaling of the computational requirements. The impact of this is drastic, a $200$ object scenario sees about a $100\times$ reduction in the number of per sample computations. Furthermore, the direct path model gives us a natural way to distribute the computations for an emulation: each object is mapped to a computational node, and these nodes are networked in a fully connected communication graph. Alongside a discussion of the model and the physical phenomena it emulates, we show how to efficiently parameterize antenna responses and scattering profiles within this direct path framework. To verify the model and demonstrate its viability in hardware, we provide several numerical experiments produced using a cycle level C++ simulator of a hardware implementation of the model. △ Less

Submitted 12 June, 2024; originally announced June 2024.

Learning Locally Interacting Discrete Dynamical Systems: Towards Data-Efficient and Scalable Prediction

Authors: Beomseok Kang, Harshit Kumar, Minah Lee, Biswadeep Chakraborty, Saibal Mukhopadhyay

Abstract: Locally interacting dynamical systems, such as epidemic spread, rumor propagation through crowd, and forest fire, exhibit complex global dynamics originated from local, relatively simple, and often stochastic interactions between dynamic elements. Their temporal evolution is often driven by transitions between a finite number of discrete states. Despite significant advancements in predictive model… ▽ More Locally interacting dynamical systems, such as epidemic spread, rumor propagation through crowd, and forest fire, exhibit complex global dynamics originated from local, relatively simple, and often stochastic interactions between dynamic elements. Their temporal evolution is often driven by transitions between a finite number of discrete states. Despite significant advancements in predictive modeling through deep learning, such interactions among many elements have rarely explored as a specific domain for predictive modeling. We present Attentive Recurrent Neural Cellular Automata (AR-NCA), to effectively discover unknown local state transition rules by associating the temporal information between neighboring cells in a permutation-invariant manner. AR-NCA exhibits the superior generalizability across various system configurations (i.e., spatial distribution of states), data efficiency and robustness in extremely data-limited scenarios even in the presence of stochastic interactions, and scalability through spatial dimension-independent prediction. △ Less

Submitted 27 May, 2024; v1 submitted 9 April, 2024; originally announced April 2024.

Comments: Accepted in Learning for Dynamics and Control Conference (L4DC) 2024

Source Camera Identification and Detection in Digital Videos through Blind Forensics

Authors: Venkata Udaya Sameer, Shilpa Mukhopadhyay, Ruchira Naskar, Ishaan Dali

Abstract: Source camera identification in digital videos is the problem of associating an unknown digital video with its source device, within a closed set of possible devices. The existing techniques in source detection of digital videos try to find a fingerprint of the actual source in the video in form of PRNU (Photo Response Non--Uniformity), and match it against the SPN (Sensor Pattern Noise) of each p… ▽ More Source camera identification in digital videos is the problem of associating an unknown digital video with its source device, within a closed set of possible devices. The existing techniques in source detection of digital videos try to find a fingerprint of the actual source in the video in form of PRNU (Photo Response Non--Uniformity), and match it against the SPN (Sensor Pattern Noise) of each possible device. The highest correlation indicates the correct source. We investigate the problem of identifying a video source through a feature based approach using machine learning. In this paper, we present a blind forensic technique of video source authentication and identification, based on feature extraction, feature selection and subsequent source classification. The main aim is to determine whether a claimed source for a video is actually its original source. If not, we identify its original source. Our experimental results prove the efficiency of the proposed method compared to traditional fingerprint based technique. △ Less

Submitted 6 September, 2023; originally announced September 2023.

Comments: Submitted to IEEE for inclusion in Xplore- Digital Library. Paper presented at the International Conference on Recent Trends in Computational Engineering & Technologies (ICRTCET 18)with Paper Id: ICRTCET-227

A Local Measurement Based Comprehensive Protection Scheme for AC Microgrid

Authors: Sindhura Gupta, Susovan Mukhopadhyay, Ambarnath Banerji, Sujit K. Biswas, Prasun Sanki

Abstract: The popularity of low-voltage ac distribution networks is increasing day by day. However, an efficient protection scheme for low-voltage ac distribution systems is still challenging. This paper introduces a protection scheme suitable for low-voltage grid connected and islanded ac microgrid based on local measurements in order to locate, identify and isolate faults. Here current decomposition metho… ▽ More The popularity of low-voltage ac distribution networks is increasing day by day. However, an efficient protection scheme for low-voltage ac distribution systems is still challenging. This paper introduces a protection scheme suitable for low-voltage grid connected and islanded ac microgrid based on local measurements in order to locate, identify and isolate faults. Here current decomposition method is specifically incorporated to accomplish fault type identification. MATLAB/SIMULINK platform is chosen to examine the performance of the proposed scheme both in grid connected and islanded low-voltage ac microgrid. The feasibility of the protection scheme is extensively investigated by simulating all types of faults with substantial variations like different fault location, different fault resistances etc. The test results ensure that the proposed protection scheme is sufficiently reliable and faster for providing complete protection in low-voltage ac microgrid. △ Less

Submitted 29 July, 2023; originally announced July 2023.

Comments: International Conference Energy Systems, Drives, Power Electronics, Measurement and Sensors (ESDPEMS 2023)(Hybrid Mode) Organized By Department of Electrical Engineering Narula Institute of Technology, Kolkata

Energy Consumption of Electric Vehicles: Effect of Lateral Dynamics

Authors: Simran Kumari, Susenjit Ghosh, Ashish R. Hota, Siddhartha Mukhopadhyay

Abstract: Current research on energy related problems such as eco-routing, eco-driving and range prediction for electric vehicles (EVs) primarily considers the effect of longitudinal dynamics on EV energy consumption. However, real-world driving includes longitudinal as well as lateral motion. Therefore, it is important to understand the effects of lateral dynamics on battery energy consumption. This paper… ▽ More Current research on energy related problems such as eco-routing, eco-driving and range prediction for electric vehicles (EVs) primarily considers the effect of longitudinal dynamics on EV energy consumption. However, real-world driving includes longitudinal as well as lateral motion. Therefore, it is important to understand the effects of lateral dynamics on battery energy consumption. This paper conducts an analysis of the stated effect and validates its significance through simulations. Specifically, this study demonstrates that inclusion of the effect of lateral dynamics can improve accuracy and reliability of solutions in eco-routing, eco-driving and range prediction applications. △ Less

Submitted 5 July, 2023; originally announced July 2023.

Data-Driven Robust Optimization for Energy-Aware and Safe Navigation of Electric Vehicles

Authors: Simran Kumari, Ashish R. Hota, Siddhartha Mukhopadhyay

Abstract: In this paper, we simultaneously tackle the problem of energy optimal and safe navigation of electric vehicles in a data-driven robust optimization framework. We consider a dynamic model of the electric vehicle which includes kinematic variables in both inertial and body coordinate systems in order to capture both longitudinal and lateral motion as well as state-of-energy of the battery. We levera… ▽ More In this paper, we simultaneously tackle the problem of energy optimal and safe navigation of electric vehicles in a data-driven robust optimization framework. We consider a dynamic model of the electric vehicle which includes kinematic variables in both inertial and body coordinate systems in order to capture both longitudinal and lateral motion as well as state-of-energy of the battery. We leverage past data of obstacle motion to construct a future occupancy set with probabilistic guarantees, and formulate robust collision avoidance constraints with respect to such an occupancy set using convex programming duality. Consequently, we present the finite horizon optimal control problem subject to robust collision avoidance constraints while penalizing resulting energy consumption. Finally, we show the effectiveness of the proposed approach in reducing energy consumption and ensuring safe navigation via extensive simulations involving curved roads and multiple obstacles. △ Less

Submitted 22 July, 2023; v1 submitted 25 April, 2023; originally announced April 2023.

Brain-Inspired Spiking Neural Network for Online Unsupervised Time Series Prediction

Authors: Biswadeep Chakraborty, Saibal Mukhopadhyay

Abstract: Energy and data-efficient online time series prediction for predicting evolving dynamical systems are critical in several fields, especially edge AI applications that need to update continuously based on streaming data. However, current DNN-based supervised online learning models require a large amount of training data and cannot quickly adapt when the underlying system changes. Moreover, these mo… ▽ More Energy and data-efficient online time series prediction for predicting evolving dynamical systems are critical in several fields, especially edge AI applications that need to update continuously based on streaming data. However, current DNN-based supervised online learning models require a large amount of training data and cannot quickly adapt when the underlying system changes. Moreover, these models require continuous retraining with incoming data making them highly inefficient. To solve these issues, we present a novel Continuous Learning-based Unsupervised Recurrent Spiking Neural Network Model (CLURSNN), trained with spike timing dependent plasticity (STDP). CLURSNN makes online predictions by reconstructing the underlying dynamical system using Random Delay Embedding by measuring the membrane potential of neurons in the recurrent layer of the RSNN with the highest betweenness centrality. We also use topological data analysis to propose a novel methodology using the Wasserstein Distance between the persistence homologies of the predicted and observed time series as a loss function. We show that the proposed online time series prediction methodology outperforms state-of-the-art DNN models when predicting an evolving Lorenz63 dynamical system. △ Less

Submitted 31 May, 2023; v1 submitted 10 April, 2023; originally announced April 2023.

Comments: Manuscript accepted to be published in IJCNN 2023

Real Time Adaptive Estimation of Li-ion Battery Bank Parameters

Authors: Hafiz M. Usman, Shayok Mukhopadhyay, Habibur Rehman

Abstract: This paper proposes an accurate and efficient Universal Adaptive Stabilizer (UAS) based online parameters estimation technique for a 400 V Li-ion battery bank. The battery open circuit voltage, parameters modeling the transient response, and series resistance are all estimated in a single real-time test. In contrast to earlier UAS based work on individual battery packs, this work does not require… ▽ More This paper proposes an accurate and efficient Universal Adaptive Stabilizer (UAS) based online parameters estimation technique for a 400 V Li-ion battery bank. The battery open circuit voltage, parameters modeling the transient response, and series resistance are all estimated in a single real-time test. In contrast to earlier UAS based work on individual battery packs, this work does not require prior offline experimentation or any post-processing. Real time fast convergence of parameters' estimates with minimal experimental effort enables self-update of battery parameters in run-time. The proposed strategy is mathematically validated and its performance is demonstrated on a 400 V, 6.6 Ah Li-ion battery bank powering the induction motor driven prototype electric vehicle (EV) traction system. △ Less

Submitted 22 February, 2022; originally announced February 2022.

Identifying Friction in a Nonlinear Chaotic System Using a Universal Adaptive Stabilizer

Authors: Ali Wadi, Shayok Mukhopadhyay, Lotfi Romdhane

Abstract: This paper proposes a friction model parameter identification routine that can work with highly nonlinear and chaotic systems. The chosen system for this study is a passively-actuated tilted Furuta pendulum, which is known to have a highly non linear and coupled model. The pendulum is tilted to ensure the existence of a stable equilibrium configuration for all its degrees of freedom, and the link… ▽ More This paper proposes a friction model parameter identification routine that can work with highly nonlinear and chaotic systems. The chosen system for this study is a passively-actuated tilted Furuta pendulum, which is known to have a highly non linear and coupled model. The pendulum is tilted to ensure the existence of a stable equilibrium configuration for all its degrees of freedom, and the link weights are the only external forces applied to the system. A nonlinear analytical model of the pendulum is derived, and a continuous friction model considering static friction, dynamic friction, viscous friction, and the stribeck effect is selected from the literature. A high-gain Universal Adaptive Stabilizer (UAS) observer is designed to identify friction model parameters using joint angle measurements. The methodology is tested in simulation and validated on an experimental setup. Despite the high nonlinearity of the system, the methodology is proven to converge to the exact parameter values, in simulation, and to yield qualitative parameter magnitudes in experiments where the goodness of fit was around 85\% on average. The discrepancy between the simulation and the experimental results is attributed to the limitations of the friction model. The main advantage of the proposed method is the significant reduction in computational needs and the time required relative to conventional optimization-based identification routines. The proposed approach yielded more than 99\% reduction in the estimation time while being considerably more accurate than the optimization approach in every test performed. One more advantage is that the approach can be easily adapted to fit other models to experimental data. △ Less

Submitted 3 February, 2022; originally announced February 2022.

Comments: 16 pages, 12 figures

Journal ref: IEEE Access 2022

A Fully Spiking Hybrid Neural Network for Energy-Efficient Object Detection

Authors: Biswadeep Chakraborty, Xueyuan She, Saibal Mukhopadhyay

Abstract: This paper proposes a Fully Spiking Hybrid Neural Network (FSHNN) for energy-efficient and robust object detection in resource-constrained platforms. The network architecture is based on Convolutional SNN using leaky-integrate-fire neuron models. The model combines unsupervised Spike Time-Dependent Plasticity (STDP) learning with back-propagation (STBP) learning methods and also uses Monte Carlo D… ▽ More This paper proposes a Fully Spiking Hybrid Neural Network (FSHNN) for energy-efficient and robust object detection in resource-constrained platforms. The network architecture is based on Convolutional SNN using leaky-integrate-fire neuron models. The model combines unsupervised Spike Time-Dependent Plasticity (STDP) learning with back-propagation (STBP) learning methods and also uses Monte Carlo Dropout to get an estimate of the uncertainty error. FSHNN provides better accuracy compared to DNN based object detectors while being 150X energy-efficient. It also outperforms these object detectors, when subjected to noisy input data and less labeled training data with a lower uncertainty error. △ Less

Submitted 23 July, 2021; v1 submitted 21 April, 2021; originally announced April 2021.

Comments: 10 pages, Submitted Manuscript

Numerical Evaluation of a muon tomography system for imaging defects in concrete structures

Authors: Sridhar Tripathy, Jaydeep Datta, Nayana Majumdar, Supratik Mukhopadhyay

Abstract: Among numerous applications of muon tomography, deployment in civil structures has caught attraction of many recently. In this work, the appropriateness of muon scattering tomography to detect defects in concrete structures has been studied numerically. A few basic concrete structures that are frequently used in civil construction, have been considered as test cases. A simulation has been performe… ▽ More Among numerous applications of muon tomography, deployment in civil structures has caught attraction of many recently. In this work, the appropriateness of muon scattering tomography to detect defects in concrete structures has been studied numerically. A few basic concrete structures that are frequently used in civil construction, have been considered as test cases. A simulation has been performed on Geant4 platform where an imaging setup built with several gaseous ionization detectors, having a specific spatial resolution for tracking the muons, have been modeled. The images of the test cases with and without the defect have been simulated for a month-long exposure of cosmic muons on the basis of their scattering from the composite concrete structures. The images have been compared using t-test to evaluate the performance of the imaging setup in identifying the defects. Further processing of the images has been done with a pattern recognition method proposed in our earlier work to improve defect identification. The efficacy of the said method has been evaluated in terms of the PRM-score devised in this work. The limitation and advantages of the present application of the muon scattering tomography encompassing the imaging and image processing technique in non-destructive evaluation of concrete structures have been discussed. △ Less

Submitted 22 March, 2021; v1 submitted 17 February, 2021; originally announced February 2021.

Comments: Minimal Changes, submitted to EPJ plus

Computing Robust Forward Invariant Sets of Multidimensional Non-linear Systems via Geometric Deformation of Polytopes

Authors: Taha Ameen, Shayok Mukhopadhyay, Nasser Qaddoumi

Abstract: This paper develops and implements an algorithm to compute sequences of polytopic Robust Forward Invariant Sets (RFIS) that can parametrically vary in size between the maximal and minimal RFIS of a nonlinear dynamical system. This is done through a novel computational approach that geometrically deforms a polytope into an invariant set using a sequence of homeomorphishms, based on an invariance co… ▽ More This paper develops and implements an algorithm to compute sequences of polytopic Robust Forward Invariant Sets (RFIS) that can parametrically vary in size between the maximal and minimal RFIS of a nonlinear dynamical system. This is done through a novel computational approach that geometrically deforms a polytope into an invariant set using a sequence of homeomorphishms, based on an invariance condition that only needs to be satisfied at a finite set of test points. For achieving this, a fast computational test is developed to establish if a given polytopic set is an RFIS. The geometric nature of the proposed approach makes it applicable for arbitrary Lipschitz continuous nonlinear systems in the presence of bounded additive disturbances. The versatility of the proposed approach is presented through simulation results on a variety of nonlinear dynamical systems in two and three dimensions, for which, sequences of invariant sets are computed. △ Less

Submitted 25 January, 2021; originally announced January 2021.

Comments: 17 pages, 17 figures

Neural Identification for Control

Authors: Priyabrata Saha, Magnus Egerstedt, Saibal Mukhopadhyay

Abstract: We present a new method for learning control law that stabilizes an unknown nonlinear dynamical system at an equilibrium point. We formulate a system identification task in a self-supervised learning setting that jointly learns a controller and corresponding stable closed-loop dynamics hypothesis. The input-output behavior of the unknown dynamical system under random control inputs is used as the… ▽ More We present a new method for learning control law that stabilizes an unknown nonlinear dynamical system at an equilibrium point. We formulate a system identification task in a self-supervised learning setting that jointly learns a controller and corresponding stable closed-loop dynamics hypothesis. The input-output behavior of the unknown dynamical system under random control inputs is used as the supervising signal to train the neural network-based system model and the controller. The proposed method relies on the Lyapunov stability theory to generate a stable closed-loop dynamics hypothesis and corresponding control law. We demonstrate our method on various nonlinear control problems such as n-link pendulum balancing and trajectory tracking, pendulum on cart balancing, and wheeled vehicle path following. △ Less

Submitted 15 March, 2022; v1 submitted 24 September, 2020; originally announced September 2020.

Comments: Copyright 2021 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works

Journal ref: IEEE Robotics and Automation Letters, vol. 6, no. 3, pp. 4648-4655, July 2021

SleepPoseNet: Multi-View Learning for Sleep Postural Transition Recognition Using UWB

Authors: Maytus Piriyajitakonkij, Patchanon Warin, Payongkit Lakhan, Pitsharponrn Leelaarporn, Theerasarn Pianpanit, Nakorn Kumchaiseemak, Supasorn Suwajanakorn, Nattee Niparnan, Subhas Chandra Mukhopadhyay, Theerawit Wilaiprasitporn

Abstract: Recognizing movements during sleep is crucial for the monitoring of patients with sleep disorders, and the utilization of ultra-wideband (UWB) radar for the classification of human sleep postures has not been explored widely. This study investigates the performance of an off-the-shelf single antenna UWB in a novel application of sleep postural transition (SPT) recognition. The proposed Multi-View… ▽ More Recognizing movements during sleep is crucial for the monitoring of patients with sleep disorders, and the utilization of ultra-wideband (UWB) radar for the classification of human sleep postures has not been explored widely. This study investigates the performance of an off-the-shelf single antenna UWB in a novel application of sleep postural transition (SPT) recognition. The proposed Multi-View Learning, entitled SleepPoseNet or SPN, with time series data augmentation aims to classify four standard SPTs. SPN exhibits an ability to capture both time and frequency features, including the movement and direction of sleeping positions. The data recorded from 38 volunteers displayed that SPN with a mean accuracy of $73.7 \pm 0.8 \%$ significantly outperformed the mean accuracy of $59.9 \pm 0.7 \%$ obtained from deep convolution neural network (DCNN) in recent state-of-the-art work on human activity recognition using UWB. Apart from UWB system, SPN with the data augmentation can ultimately be adopted to learn and classify time series data in various applications. △ Less

Submitted 23 August, 2020; v1 submitted 2 May, 2020; originally announced May 2020.

Journal ref: IEEE Journal of Biomedical and Health Informatics (2020)

Decoding EEG Rhythms During Action Observation, Motor Imagery, and Execution for Standing and Sitting

Authors: Rattanaphon Chaisaen, Phairot Autthasan, Nopparada Mingchinda, Pitshaporn Leelaarporn, Narin Kunaseth, Suppakorn Tammajarung, Poramate Manoonpong, Subhas Chandra Mukhopadhyay, Theerawit Wilaiprasitporn

Abstract: Event-related desynchronization and synchronization (ERD/S) and movement-related cortical potential (MRCP) play an important role in brain-computer interfaces (BCI) for lower limb rehabilitation, particularly in standing and sitting. However, little is known about the differences in the cortical activation between standing and sitting, especially how the brain's intention modulates the pre-movemen… ▽ More Event-related desynchronization and synchronization (ERD/S) and movement-related cortical potential (MRCP) play an important role in brain-computer interfaces (BCI) for lower limb rehabilitation, particularly in standing and sitting. However, little is known about the differences in the cortical activation between standing and sitting, especially how the brain's intention modulates the pre-movement sensorimotor rhythm as they do for switching movements. In this study, we aim to investigate the decoding of continuous EEG rhythms during action observation (AO), motor imagery (MI), and motor execution (ME) for the actions of standing and sitting. We developed a behavioral task in which participants were instructed to perform both AO and MI/ME in regard to the transitioning actions of sit-to-stand and stand-to-sit. Our results demonstrated that the ERD was prominent during AO, whereas ERS was typical during MI at the alpha band across the sensorimotor area. A combination of the filter bank common spatial pattern (FBCSP) and support vector machine (SVM) for classification was used for both offline and classifier testing analyses. The offline analysis indicated the classification of AO and MI providing the highest mean accuracy at 82.73$\pm$2.54\% in the stand-to-sit transition. By applying the classifier testing analysis, we demonstrated the higher performance of decoding neural intentions from the MI paradigm in comparison to the ME paradigm. These observations led us to the promising aspect of using our developed tasks based on the integration of both AO and MI to build future exoskeleton-based rehabilitation systems. △ Less

Submitted 27 June, 2020; v1 submitted 7 April, 2020; originally announced April 2020.

Comments: in press

Journal ref: IEEE Sensors Journal 2020

Low Power Unsupervised Anomaly Detection by Non-Parametric Modeling of Sensor Statistics

Authors: Ahish Shylendra, Priyesh Shukla, Saibal Mukhopadhyay, Swarup Bhunia, Amit Ranjan Trivedi

Abstract: This work presents AEGIS, a novel mixed-signal framework for real-time anomaly detection by examining sensor stream statistics. AEGIS utilizes Kernel Density Estimation (KDE)-based non-parametric density estimation to generate a real-time statistical model of the sensor data stream. The likelihood estimate of the sensor data point can be obtained based on the generated statistical model to detect… ▽ More This work presents AEGIS, a novel mixed-signal framework for real-time anomaly detection by examining sensor stream statistics. AEGIS utilizes Kernel Density Estimation (KDE)-based non-parametric density estimation to generate a real-time statistical model of the sensor data stream. The likelihood estimate of the sensor data point can be obtained based on the generated statistical model to detect outliers. We present CMOS Gilbert Gaussian cell-based design to realize Gaussian kernels for KDE. For outlier detection, the decision boundary is defined in terms of kernel standard deviation ($σ_{Kernel}$) and likelihood threshold ($P_{Thres}$). We adopt a sliding window to update the detection model in real-time. We use time-series dataset provided from Yahoo to benchmark the performance of AEGIS. A f1-score higher than 0.87 is achieved by optimizing parameters such as length of the sliding window and decision thresholds which are programmable in AEGIS. Discussed architecture is designed using 45nm technology node and our approach on average consumes $\sim$75 $μ$W power at a sampling rate of 2 MHz while using ten recent inlier samples for density estimation. \textcolor{red}{Full-version of this research has been published at IEEE TVLSI} △ Less

Submitted 23 March, 2020; originally announced March 2020.

A One-Shot Learning Framework for Assessment of Fibrillar Collagen from Second Harmonic Generation Images of an Infarcted Myocardium

Authors: Qun Liu, Supratik Mukhopadhyay, Maria Ximena Bastidas Rodriguez, Xing Fu, Sushant Sahu, David Burk, Manas Gartia

Abstract: Myocardial infarction (MI) is a scientific term that refers to heart attack. In this study, we infer highly relevant second harmonic generation (SHG) cues from collagen fibers exhibiting highly non-centrosymmetric assembly together with two-photon excited cellular autofluorescence in infarcted mouse heart to quantitatively probe fibrosis, especially targeted at an early stage after MI. We present… ▽ More Myocardial infarction (MI) is a scientific term that refers to heart attack. In this study, we infer highly relevant second harmonic generation (SHG) cues from collagen fibers exhibiting highly non-centrosymmetric assembly together with two-photon excited cellular autofluorescence in infarcted mouse heart to quantitatively probe fibrosis, especially targeted at an early stage after MI. We present a robust one-shot machine learning algorithm that enables determination of 2D assembly of collagen with high spatial resolution along with its structural arrangement in heart tissues post-MI with spectral specificity and sensitivity. Detection, evaluation, and precise quantification of fibrosis extent at early stage would guide one to develop treatment therapies that may prevent further progression and determine heart transplant needs for patient survival. △ Less

Submitted 29 January, 2020; v1 submitted 23 January, 2020; originally announced January 2020.

Comments: Paper was accepted at the IEEE International Symposium on Biomedical Imaging (ISBI 2020)

DeepSat V2: Feature Augmented Convolutional Neural Nets for Satellite Image Classification

Authors: Qun Liu, Saikat Basu, Sangram Ganguly, Supratik Mukhopadhyay, Robert DiBiano, Manohar Karki, Ramakrishna Nemani

Abstract: Satellite image classification is a challenging problem that lies at the crossroads of remote sensing, computer vision, and machine learning. Due to the high variability inherent in satellite data, most of the current object classification approaches are not suitable for handling satellite datasets. The progress of satellite image analytics has also been inhibited by the lack of a single labeled h… ▽ More Satellite image classification is a challenging problem that lies at the crossroads of remote sensing, computer vision, and machine learning. Due to the high variability inherent in satellite data, most of the current object classification approaches are not suitable for handling satellite datasets. The progress of satellite image analytics has also been inhibited by the lack of a single labeled high-resolution dataset with multiple class labels. In a preliminary version of this work, we introduced two new high resolution satellite imagery datasets (SAT-4 and SAT-6) and proposed DeepSat framework for classification based on "handcrafted" features and a deep belief network (DBN). The present paper is an extended version, we present an end-to-end framework leveraging an improved architecture that augments a convolutional neural network (CNN) with handcrafted features (instead of using DBN-based architecture) for classification. Our framework, having access to fused spatial information obtained from handcrafted features as well as CNN feature maps, have achieved accuracies of 99.90% and 99.84% respectively, on SAT-4 and SAT-6, surpassing all the other state-of-the-art results. A statistical analysis based on Distribution Separability Criterion substantiates the robustness of our approach in learning better representations for satellite imagery. △ Less

Submitted 14 November, 2019; originally announced November 2019.

Comments: This is an Accepted Manuscript of an article published by Taylor & Francis Group in Remote Sensing Letters. arXiv admin note: text overlap with arXiv:1509.03602

Convergence Analysis of l0-RLS Adaptive Filter

Authors: B. K. Das, S. Mukhopadhyay, M. Chakraborty

Abstract: This paper presents first and second order convergence analysis of the sparsity aware l0-RLS adaptive filter. The theorems 1 and 2 state the steady state value of mean and mean square deviation of the adaptive filter weight vector. This paper presents first and second order convergence analysis of the sparsity aware l0-RLS adaptive filter. The theorems 1 and 2 state the steady state value of mean and mean square deviation of the adaptive filter weight vector. △ Less

Submitted 16 October, 2017; originally announced October 2017.

Robustness Analysis for Battery Supported Cyber-Physical Systems

Authors: Fumin Zhang, Zhenwu Shi, Shayok Mukhopadhyay

Abstract: This paper establishes a novel analytical approach to quantify robustness of scheduling and battery management for battery supported cyber-physical systems. A dynamic schedulability test is introduced to determine whether tasks are schedulable within a finite time window. The test is used to measure robustness of a real-time scheduling algorithm by evaluating the strength of computing time perturb… ▽ More This paper establishes a novel analytical approach to quantify robustness of scheduling and battery management for battery supported cyber-physical systems. A dynamic schedulability test is introduced to determine whether tasks are schedulable within a finite time window. The test is used to measure robustness of a real-time scheduling algorithm by evaluating the strength of computing time perturbations that break schedulability at runtime. Robustness of battery management is quantified analytically by an adaptive threshold on the state of charge. The adaptive threshold significantly reduces the false alarm rate for battery management algorithms to decide when a battery needs to be replaced. △ Less

Submitted 24 November, 2011; originally announced November 2011.

Comments: This paper has been accepted by ACM Transactions in Embedded Computing Systems (TECS) in October, 2011

ACM Class: C.3; D.4.1; G.4