-
CommSense: A Rapid and Accurate ISAC Paradigm
Authors:
Sandip Jana,
Amit Kumar Mishra,
Mohammed Zafar Ali Khan
Abstract:
Future 6G networks envisions to blur the line between communication and sensing, leveraging ubiquitous OFDM waveforms for both high throughput data and environmental awareness. In this work, we do a thorough analysis of Communication based Sensing (CommSense) framework that embeds lightweight, PCA based detectors into standard OFDM receivers; enabling real-time, device free detection of passive sc…
▽ More
Future 6G networks envisions to blur the line between communication and sensing, leveraging ubiquitous OFDM waveforms for both high throughput data and environmental awareness. In this work, we do a thorough analysis of Communication based Sensing (CommSense) framework that embeds lightweight, PCA based detectors into standard OFDM receivers; enabling real-time, device free detection of passive scatterers (e.g.\ drones, vehicles etc.) without any extra transmitters. Starting from a realistic three link Rician channel model (direct Tx\(\rightarrow\)Rx, cascaded Tx\(\rightarrow\)Scatterer and Scatterer\(\rightarrow\)Rx), we compare four detectors: the full dimensional Likelihood Ratio Test (Full LRT), PCA based LRT, PCA+SVM with linear and RBF kernels. By projecting \(N\)-dimensional CSI onto a \(P\ll N\) principal component subspace, inference time gets reduced by an order of magnitude compared to the full LRT, while achieving optimal error rates i.e. empirical errors align tightly with the Bhattacharyya error bound and Area Under ROC Curve (AUC)\(\approx1\) for \(P\approx10\). PCA+SVM classifiers further improve robustness in very high dimensions (\(N=1024\)), maintaining AUC\(\gtrsim0.60\) at \(-10\)dB and exceeding 0.90 by 0dB even when full LRT fails due to numerical overflow. From the simulated result we have shown LRT based techniques are susceptible to the parameter estimation error, where as SVM is resilient to that. Our results demonstrate that PCA driven detection when paired with lightweight SVMs can deliver fast, accurate, and robust scatterer sensing, paving the way for integrated sensing and communication (ISAC) in 6G and beyond.
△ Less
Submitted 9 June, 2025;
originally announced June 2025.
-
Multilook Coherent Imaging: Theoretical Guarantees and Algorithms
Authors:
Xi Chen,
Soham Jana,
Christopher A. Metzler,
Arian Maleki,
Shirin Jalali
Abstract:
Multilook coherent imaging is a widely used technique in applications such as digital holography, ultrasound imaging, and synthetic aperture radar. A central challenge in these systems is the presence of multiplicative noise, commonly known as speckle, which degrades image quality. Despite the widespread use of coherent imaging systems, their theoretical foundations remain relatively underexplored…
▽ More
Multilook coherent imaging is a widely used technique in applications such as digital holography, ultrasound imaging, and synthetic aperture radar. A central challenge in these systems is the presence of multiplicative noise, commonly known as speckle, which degrades image quality. Despite the widespread use of coherent imaging systems, their theoretical foundations remain relatively underexplored. In this paper, we study both the theoretical and algorithmic aspects of likelihood-based approaches for multilook coherent imaging, providing a rigorous framework for analysis and method development. Our theoretical contributions include establishing the first theoretical upper bound on the Mean Squared Error (MSE) of the maximum likelihood estimator under the deep image prior hypothesis. Our results capture the dependence of MSE on the number of parameters in the deep image prior, the number of looks, the signal dimension, and the number of measurements per look. On the algorithmic side, we employ projected gradient descent (PGD) as an efficient method for computing the maximum likelihood solution. Furthermore, we introduce two key ideas to enhance the practical performance of PGD. First, we incorporate the Newton-Schulz algorithm to compute matrix inverses within the PGD iterations, significantly reducing computational complexity. Second, we develop a bagging strategy to mitigate projection errors introduced during PGD updates. We demonstrate that combining these techniques with PGD yields state-of-the-art performance. Our code is available at https://github.com/Computational-Imaging-RU/Bagged-DIP-Speckle.
△ Less
Submitted 29 May, 2025;
originally announced May 2025.
-
AI-based 3-Lead to 12-Lead ECG Reconstruction: Towards Smartphone-based Public Healthcare
Authors:
Aditya Mallick,
Rahul L R,
Albert Shaiju,
Satya Deepika Neelapala,
Lopamudra Giri,
Rahuldeb Sarkar,
Soumya Jana
Abstract:
Clinicians generally diagnose cardiovascular diseases (CVDs) using standard 12-Lead electrocardiogram (ECG). However, for smartphone-based public healthcare systems, a reduced 3-lead system may be preferred because of (i) increased portability, and (ii) reduced requirement for power, storage and bandwidth. Subsequently, clinicians require accurate 3-lead to 12-Lead ECG reconstruction, which has so…
▽ More
Clinicians generally diagnose cardiovascular diseases (CVDs) using standard 12-Lead electrocardiogram (ECG). However, for smartphone-based public healthcare systems, a reduced 3-lead system may be preferred because of (i) increased portability, and (ii) reduced requirement for power, storage and bandwidth. Subsequently, clinicians require accurate 3-lead to 12-Lead ECG reconstruction, which has so far been studied only in the personalized setting. When each device is dedicated to one individual, artificial intelligence (AI) methods such as temporal long short-term memory (LSTM) and a further improved spatio-temporal LSTM-UNet combine have proven effective. In contrast, in the current smartphone-based public health setting where a common device is shared by many, developing an AI lead-reconstruction model that caters to the extensive ECG signal variability in the general population appears a far greater challenge. In this direction, we take a first step, and observe that the performance improvement achieved by a generative model, specifically, 1D Pix2Pix GAN (generative adversarial network), over LSTM-UNet is encouraging.
△ Less
Submitted 18 October, 2024; v1 submitted 17 October, 2024;
originally announced October 2024.
-
Next-Generation Teleophthalmology: AI-enabled Quality Assessment Aiding Remote Smartphone-based Consultation
Authors:
Dhruv Srikanth,
Jayang Gurung,
N Satya Deepika,
Vineet Joshi,
Lopamudra Giri,
Pravin Vaddavalli,
Soumya Jana
Abstract:
Blindness and other eye diseases are a global health concern, particularly in low- and middle-income countries like India. In this regard, during the COVID-19 pandemic, teleophthalmology became a lifeline, and the Grabi attachment for smartphone-based eye imaging gained in use. However, quality of user-captured image often remained inadequate, requiring clinician vetting and delays. In this backdr…
▽ More
Blindness and other eye diseases are a global health concern, particularly in low- and middle-income countries like India. In this regard, during the COVID-19 pandemic, teleophthalmology became a lifeline, and the Grabi attachment for smartphone-based eye imaging gained in use. However, quality of user-captured image often remained inadequate, requiring clinician vetting and delays. In this backdrop, we propose an AI-based quality assessment system with instant feedback mimicking clinicians' judgments and tested on patient-captured images. Dividing the complex problem hierarchically, here we tackle a nontrivial part, and demonstrate a proof of the concept.
△ Less
Submitted 7 August, 2024; v1 submitted 11 February, 2024;
originally announced February 2024.
-
3-Lead to 12-Lead ECG Reconstruction: A Novel AI-based Spatio-Temporal Method
Authors:
Rahul LR,
Albert Shaiju,
Soumya Jana
Abstract:
Diagnosis of cardiovascular diseases usually relies on the widely used standard 12-Lead (S12) ECG system. However, such a system could be bulky, too resource-intensive, and too specialized for personalized home-based monitoring. In contrast, clinicians are generally not trained on the alternative proposal, i.e., the reduced lead (RL) system. This necessitates mapping RL to S12. In this context, to…
▽ More
Diagnosis of cardiovascular diseases usually relies on the widely used standard 12-Lead (S12) ECG system. However, such a system could be bulky, too resource-intensive, and too specialized for personalized home-based monitoring. In contrast, clinicians are generally not trained on the alternative proposal, i.e., the reduced lead (RL) system. This necessitates mapping RL to S12. In this context, to improve upon traditional linear transformation (LT) techniques, artificial intelligence (AI) approaches like long short-term memory (LSTM) networks capturing non-linear temporal dependencies, have been suggested. However, LSTM does not adequately interpolate spatially (in 3D). To fill this gap, we propose a combined LSTM-UNet model that also handles spatial aspects of the problem, and demonstrate performance improvement. Evaluated on PhysioNet PTBDB database, our LSTM-UNet achieved a mean R^2 value of 94.37%, surpassing LSTM by 0.79% and LT by 2.73%. Similarly, for PhysioNet INCARTDB database, LSTM-UNet achieved a mean R^2 value of 93.91%, outperforming LSTM by 1.78% and LT by 12.17%.
△ Less
Submitted 12 August, 2023;
originally announced August 2023.
-
Diagnostic Quality Assessment of Fundus Photographs: Hierarchical Deep Learning with Clinically Significant Explanations
Authors:
Shanmukh Reddy Manne,
Jose-Alain Sahel,
Jay Chhablani,
Kiran Kumar Vupparaboinab,
Soumya Jana
Abstract:
Fundus photography (FP) remains the primary imaging modality in screening various retinal diseases including age-related macular degeneration, diabetic retinopathy and glaucoma. FP allows the clinician to examine the ocular fundus structures such as the macula, the optic disc (OD) and retinal vessels, whose visibility and clarity in an FP image remain central to ensuring diagnostic accuracy, and h…
▽ More
Fundus photography (FP) remains the primary imaging modality in screening various retinal diseases including age-related macular degeneration, diabetic retinopathy and glaucoma. FP allows the clinician to examine the ocular fundus structures such as the macula, the optic disc (OD) and retinal vessels, whose visibility and clarity in an FP image remain central to ensuring diagnostic accuracy, and hence determine the diagnostic quality (DQ). Images with low DQ, resulting from eye movement, improper illumination and other possible causes, should obviously be recaptured. However, the technician, often unfamiliar with DQ criteria, initiates recapture only based on expert feedback. The process potentially engages the imaging device multiple times for single subject, and wastes the time and effort of the ophthalmologist, the technician and the subject. The burden could be prohibitive in case of teleophthalmology, where obtaining feedback from the remote expert entails additional communication cost and delay. Accordingly, a strong need for automated diagnostic quality assessment (DQA) has been felt, where an image is immediately assigned a DQ category. In response, motivated by the notional continuum of DQ, we propose a hierarchical deep learning (DL) architecture to distinguish between good, usable and unusable categories. On the public EyeQ dataset, we achieve an accuracy of 89.44%, improving upon existing methods. In addition, using gradient based class activation map (Grad-CAM), we generate a visual explanation which agrees with the expert intuition. Future FP cameras equipped with the proposed DQA algorithm will potentially improve the efficacy of the teleophthalmology as well as the traditional system.
△ Less
Submitted 18 February, 2023;
originally announced February 2023.
-
Sensing the Environment with 5G Scattered Signals (5G-CommSense): A Feasibility Analysis
Authors:
Sandip Jana,
Amit Kumar Mishra,
Mohammed Zafar Ali Khan
Abstract:
By making use of the sensors and AI (SensAI) algorithms for a specialized task, Application Specific INstrumentation (ASIN) framework uses less computational overhead and gives a good performance. This work evaluates the feasibility of the ASIN framework dependent Communication based Sensing (CommSense) system using 5th Generation New Radio (5G NR) infrastructure. Since our proposed system is back…
▽ More
By making use of the sensors and AI (SensAI) algorithms for a specialized task, Application Specific INstrumentation (ASIN) framework uses less computational overhead and gives a good performance. This work evaluates the feasibility of the ASIN framework dependent Communication based Sensing (CommSense) system using 5th Generation New Radio (5G NR) infrastructure. Since our proposed system is backed up by 5G NR infra, this system is termed as 5G-CommSense. In this paper, we have used NR channel models specified by the 3rd Generation Partnership Project (3GPP) and added white Gaussian noise (AWGN) to vary the signal to noise ratio at the receiver. Finally, from our simulation result, we conclude that the proposed system is practically feasible.
△ Less
Submitted 10 January, 2023;
originally announced January 2023.
-
Development of Decision Support System for Effective COVID-19 Management
Authors:
shuvrangshu Jana,
Rudrashis Majumder,
Aashay Bhise,
Nobin Paul,
Stuti Garg,
Debasish Ghose
Abstract:
This paper discusses a Decision Support System (DSS) for cases prediction, allocation of resources, and lockdown management for managing COVID-19 at different levels of a government authority. Algorithms incorporated in the DSS are based on a data-driven modeling approach and independent of physical parameters of the region, and hence the proposed DSS is applicable to any area. Based on predicted…
▽ More
This paper discusses a Decision Support System (DSS) for cases prediction, allocation of resources, and lockdown management for managing COVID-19 at different levels of a government authority. Algorithms incorporated in the DSS are based on a data-driven modeling approach and independent of physical parameters of the region, and hence the proposed DSS is applicable to any area. Based on predicted active cases, the demand of lower-level units and total availability, allocation, and lockdown decision is made. A MATLAB-based GUI is developed based on the proposed DSS and could be implemented by the local authority.
△ Less
Submitted 12 March, 2022;
originally announced March 2022.
-
Cyclone Preparedness, Rescue Operations and Damage Assessment using UAVs
Authors:
Rudrashis Majumder,
Shuvrangshu Jana,
Prathyush P. Menon,
Debasish Ghose,
N. M. Prusty,
Bipasha Mukherjee,
Aditi Ghosh
Abstract:
UAV's capability to access remote and inaccessible areas within a quick time can be utilized for effective cyclone management. This paper presents the possible application of UAVs at different stages of cyclone mitigation. The overall system architecture necessary for preparedness, rescue operation, resource allocation, and damage assessment using UAVs during cyclones is described. Although genera…
▽ More
UAV's capability to access remote and inaccessible areas within a quick time can be utilized for effective cyclone management. This paper presents the possible application of UAVs at different stages of cyclone mitigation. The overall system architecture necessary for preparedness, rescue operation, resource allocation, and damage assessment using UAVs during cyclones is described. Although general commercial UAVs are reported to be used in cyclone operations, UAV systems should be planned specifically for cyclone operations to improve efficiency. Here, the specification required for effective and safe UAV operations in the post-cyclone scenario is presented. Mission planning required for various rescue, relief, and damage assessment missions related to cyclone management is discussed. A case study of deploying UAV in Amphan cyclone operation in West Bengal is also presented. This paper can help disaster management authorities to develop UAV systems specifically to cater to cyclone operations.
△ Less
Submitted 12 March, 2022;
originally announced March 2022.
-
Critical Medical Resource Allocation during COVID-19 Pandemic
Authors:
Shuvrangshu Jana,
Rudrashis Majumder,
Debasish Ghose
Abstract:
In this paper, an optimal resource allocation framework is proposed for the allocation of critical medical resources among different units during a pandemic. The framework is developed by considering the dynamics of Pandemic, hierarchical government structure, and non-uniformity of unit resource requirement among different units. The cost function is designed to minimize the difference between the…
▽ More
In this paper, an optimal resource allocation framework is proposed for the allocation of critical medical resources among different units during a pandemic. The framework is developed by considering the dynamics of Pandemic, hierarchical government structure, and non-uniformity of unit resource requirement among different units. The cost function is designed to minimize the difference between the demand, actual allocation, and ideal allocation, where ideal allocation for a region is considered based on the predicted active cases in a fraction of predicted total active cases of all regions. Different cost functions are used at a different level of organization based on the available information. The model can also accommodate severity of disaster in a region in this framework. A sample allocation case study is presented for the allocation of oxygen for different states of India.
△ Less
Submitted 11 March, 2022;
originally announced March 2022.
-
Optimal Lockdown Management using Short Term COVID-19 Prediction Model
Authors:
Shuvrangshu Jana,
Debasish Ghose
Abstract:
This paper proposes optimal lockdown management policies based on short-term prediction of active COVID-19 confirmed cases to ensure the availability of critical medical resources. The optimal time to start the lockdown from the current time is obtained after maximizing a cost function considering economic value subject to constraints of availability of medical resources, and maximum allowable val…
▽ More
This paper proposes optimal lockdown management policies based on short-term prediction of active COVID-19 confirmed cases to ensure the availability of critical medical resources. The optimal time to start the lockdown from the current time is obtained after maximizing a cost function considering economic value subject to constraints of availability of medical resources, and maximum allowable value of daily growth rate and Test Positive Ratio. The estimated value of required medical resources is calculated as a function of total active cases. The predicted value of active cases is calculated using an adaptive short-term prediction model. The proposed approach can be easily implementable by a local authority. An optimal lockdown case study for Delhi during the second wave in the month of April 2021 is presented using the proposed formulation.
△ Less
Submitted 7 March, 2022;
originally announced March 2022.
-
Autonomous Cooperative Multi-Vehicle System for Interception of Aerial and Stationary Targets in Unknown Environments
Authors:
Lima Agnel Tony,
Shuvrangshu Jana,
Varun V. P.,
Aashay Anil Bhise,
Aruul Mozhi Varman S.,
Vidyadhara B. V.,
Mohitvishnu S. Gadde,
Raghu Krishnapuram,
Debasish Ghose
Abstract:
This paper presents the design, development, and testing of hardware-software systems by the IISc-TCS team for Challenge 1 of the Mohammed Bin Zayed International Robotics Challenge 2020. The goal of Challenge 1 was to grab a ball suspended from a moving and maneuvering UAV and pop balloons anchored to the ground, using suitable manipulators. The important tasks carried out to address this challen…
▽ More
This paper presents the design, development, and testing of hardware-software systems by the IISc-TCS team for Challenge 1 of the Mohammed Bin Zayed International Robotics Challenge 2020. The goal of Challenge 1 was to grab a ball suspended from a moving and maneuvering UAV and pop balloons anchored to the ground, using suitable manipulators. The important tasks carried out to address this challenge include the design and development of a hardware system with efficient grabbing and popping mechanisms, considering the restrictions in volume and payload, design of accurate target interception algorithms using visual information suitable for outdoor environments, and development of a software architecture for dynamic multi-agent aerial systems performing complex dynamic missions. In this paper, a single degree of freedom manipulator attached with an end-effector is designed for grabbing and popping, and robust algorithms are developed for the interception of targets in an uncertain environment. Vision-based guidance and tracking laws are proposed based on the concept of pursuit engagement and artificial potential function. The software architecture presented in this work proposes an Operation Management System (OMS) architecture that allocates static and dynamic tasks collaboratively among multiple UAVs to perform any given mission. An important aspect of this work is that all the systems developed were designed to operate in completely autonomous mode. A detailed description of the architecture along with simulations of complete challenge in the Gazebo environment and field experiment results are also included in this work. The proposed hardware-software system is particularly useful for counter-UAV systems and can also be modified in order to cater to several other applications.
△ Less
Submitted 1 September, 2021;
originally announced September 2021.
-
Correlation in Neuronal Calcium Spiking: Quantification based on Empirical Mutual Information Rate
Authors:
Sathish Ande,
Srinivas Avasarala,
Ajith Karunarathne,
Lopamudra Giri,
Soumya Jana
Abstract:
Quantification of neuronal correlations in neuron populations helps us to understand neural coding rules. Such quantification could also reveal how neurons encode information in normal and disease conditions like Alzheimer's and Parkinson's. While neurons communicate with each other by transmitting spikes, there would be a change in calcium concentration within the neurons inherently. Accordingly,…
▽ More
Quantification of neuronal correlations in neuron populations helps us to understand neural coding rules. Such quantification could also reveal how neurons encode information in normal and disease conditions like Alzheimer's and Parkinson's. While neurons communicate with each other by transmitting spikes, there would be a change in calcium concentration within the neurons inherently. Accordingly, there would be correlations in calcium spike trains and they could have heterogeneous memory structures. In this context, estimation of mutual information rate in calcium spike trains assumes primary significance. However, such estimation is difficult with available methods which would consider longer blocks for convergence without noticing that neuronal information changes in short time windows. Against this backdrop, we propose a faster method that exploits the memory structures in pair of calcium spike trains to quantify mutual information shared between them. Our method has shown superior performance with example Markov processes as well as experimental spike trains. Such mutual information rate analysis could be used to identify signatures of neuronal behavior in large populations in normal and abnormal conditions.
△ Less
Submitted 7 May, 2021;
originally announced May 2021.
-
Heterogeneity in Neuronal Calcium Spike Trains based on Empirical Distance
Authors:
Sathish Ande,
Jayanth R Regatti,
Neha Pandey,
Ajith Karunarathne,
Lopamudra Giri,
Soumya Jana
Abstract:
Statistical similarities between neuronal spike trains could reveal significant information on complex underlying processing. In general, the similarity between synchronous spike trains is somewhat easy to identify. However, the similar patterns also potentially appear in an asynchronous manner. However, existing methods for their identification tend to converge slowly, and cannot be applied to sh…
▽ More
Statistical similarities between neuronal spike trains could reveal significant information on complex underlying processing. In general, the similarity between synchronous spike trains is somewhat easy to identify. However, the similar patterns also potentially appear in an asynchronous manner. However, existing methods for their identification tend to converge slowly, and cannot be applied to short sequences. In response, we propose Hellinger distance measure based on empirical probabilities, which we show to be as accurate as existing techniques, yet faster to converge for synthetic as well as experimental spike trains. Further, we cluster pairs of neuronal spike trains based on statistical similarities and found two non-overlapping classes, which could indicate functional similarities in neurons. Significantly, our technique detected functional heterogeneity in pairs of neuronal responses with the same performance as existing techniques, while exhibiting faster convergence. We expect the proposed method to facilitate large-scale studies of functional clustering, especially involving short sequences, which would in turn identify signatures of various diseases in terms of clustering patterns.
△ Less
Submitted 13 March, 2021;
originally announced March 2021.
-
Information Content in Neuronal Calcium Spike Trains: Entropy Rate Estimation based on Empirical Probabilities
Authors:
Sathish Ande,
Srinivas Avasarala,
Jayanth R Regatti,
Neha Pandey,
Sarpras Swain,
Ajith Karunarathne,
Lopamudra Giri,
Soumya Jana
Abstract:
Quantification of information content and its temporal variation in intracellular calcium spike trains in neurons helps one understand functions such as memory, learning, and cognition. Such quantification could also reveal pathological signaling perturbation that potentially leads to devastating neurodegenerative conditions including Parkinson's, Alzheimer's, and Huntington's diseases. Accordingl…
▽ More
Quantification of information content and its temporal variation in intracellular calcium spike trains in neurons helps one understand functions such as memory, learning, and cognition. Such quantification could also reveal pathological signaling perturbation that potentially leads to devastating neurodegenerative conditions including Parkinson's, Alzheimer's, and Huntington's diseases. Accordingly, estimation of entropy rate, an information-theoretic measure of information content, assumes primary significance. However, such estimation in the present context is challenging because, while entropy rate is traditionally defined asymptotically for long blocks under the assumption of stationarity, neurons are known to encode information in short intervals and the associated spike trains often exhibit nonstationarity. Against this backdrop, we propose an entropy rate estimator based on empirical probabilities that operates within windows, short enough to ensure approximate stationarity. Specifically, our estimator, parameterized by the length of encoding contexts, attempts to model the underlying memory structures in neuronal spike trains. In an example Markov process, we compared the performance of the proposed method with that of versions of the Lempel-Ziv algorithm as well as with that of a certain stationary distribution method and found the former to exhibit higher accuracy levels and faster convergence. Also, in experimentally recorded calcium responses of four hippocampal neurons, the proposed method showed faster convergence. Significantly, our technique detected structural heterogeneity in the underlying process memory in the responses of the aforementioned neurons. We believe that the proposed method facilitates large-scale studies of such heterogeneity, which could in turn identify signatures of various diseases in terms of entropy rate estimates.
△ Less
Submitted 1 February, 2021;
originally announced February 2021.
-
Improvement of plant performance using Closed loop Reference Model Simple Adaptive Control for Micro Air Vehicle
Authors:
Shuvrangshu Jana,
M. Seetharama Bhat
Abstract:
In this paper, we present a novel idea to improve the transient performance of the existing Simple Adaptive Control architecture, without requiring high adaptation gains. Improvement in performance is achieved by incorporating the closed loop reference model based on the output feedback to the Simple Adaptive Control architecture. In this proposed scheme, the reference model dynamics is driven by…
▽ More
In this paper, we present a novel idea to improve the transient performance of the existing Simple Adaptive Control architecture, without requiring high adaptation gains. Improvement in performance is achieved by incorporating the closed loop reference model based on the output feedback to the Simple Adaptive Control architecture. In this proposed scheme, the reference model dynamics is driven by the desired command as well as the error signal between the plant output and the reference model output. It is shown that the modified control architecture improves the system performance without any additional control efforts, which is then validated through simulations of the lateral model dynamics of Micro Air Vehicle.
△ Less
Submitted 11 November, 2020;
originally announced November 2020.
-
Target State Estimation and Prediction for High Speed Interception
Authors:
Aashay Bhise,
Shuvrangshu Jana,
Lima Agnel Tony,
Debasish Ghose
Abstract:
Accurate estimation and prediction of trajectory is essential for interception of any high speed target. In this paper, an extended Kalman filter is used to estimate the current location of target from its visual information and then predict its future position by using the observation sequence. Target motion model is developed considering the approximate known pattern of the target trajectory. In…
▽ More
Accurate estimation and prediction of trajectory is essential for interception of any high speed target. In this paper, an extended Kalman filter is used to estimate the current location of target from its visual information and then predict its future position by using the observation sequence. Target motion model is developed considering the approximate known pattern of the target trajectory. In this work, we utilise visual information of the target to carry out the predictions. The proposed algorithm is developed in ROS-Gazebo environment and is verified using hardware implementation.
△ Less
Submitted 4 October, 2020;
originally announced October 2020.
-
Collaborative Tracking and Capture of Aerial Object using UAVs
Authors:
Lima Agnel Tony,
Shuvrangshu Jana,
Varun V P,
Vidyadhara B V,
Mohitvishnu S Gadde,
Abhishek Kashyap,
Rahul Ravichandran,
Debasish Ghose
Abstract:
This work details the problem of aerial target capture using multiple UAVs. This problem is motivated from the challenge 1 of Mohammed Bin Zayed International Robotic Challenge 2020. The UAVs utilise visual feedback to autonomously detect target, approach it and capture without disturbing the vehicle which carries the target. Multi-UAV collaboration improves the efficiency of the system and increa…
▽ More
This work details the problem of aerial target capture using multiple UAVs. This problem is motivated from the challenge 1 of Mohammed Bin Zayed International Robotic Challenge 2020. The UAVs utilise visual feedback to autonomously detect target, approach it and capture without disturbing the vehicle which carries the target. Multi-UAV collaboration improves the efficiency of the system and increases the chance of capturing the ball robustly in short span of time. In this paper, the proposed architecture is validated through simulation in ROS-Gazebo environment and is further implemented on hardware.
△ Less
Submitted 4 October, 2020;
originally announced October 2020.
-
Multi-Agent Collaboration for Building Construction
Authors:
Kumar Ankit,
Lima Agnel Tony,
Shuvrangshu Jana,
Debasish Ghose
Abstract:
This paper details the algorithms involved and task planner for vehicle collaboration in building a structure. This is the problem defined in challenge 2 of Mohammed Bin Zayed International Robotic Challenge 2020 (MBZIRC). The work addresses various aspects of the challenge for Unmanned Aerial Vehicles (UAVs) and Unmanned Ground Vehicle (UGV). The challenge involves repeated pick and place operati…
▽ More
This paper details the algorithms involved and task planner for vehicle collaboration in building a structure. This is the problem defined in challenge 2 of Mohammed Bin Zayed International Robotic Challenge 2020 (MBZIRC). The work addresses various aspects of the challenge for Unmanned Aerial Vehicles (UAVs) and Unmanned Ground Vehicle (UGV). The challenge involves repeated pick and place operations using UAVs and UGV to build two structures of different shape and sizes. The algorithms are implemented using the Robot Operating System (ROS) framework and visualised in Gazebo. The whole developed architecture could readily be implemented in suitable hardware.
△ Less
Submitted 25 September, 2020; v1 submitted 8 September, 2020;
originally announced September 2020.
-
Accurate Prediction and Estimation of 3D-Repetitive-Trajectories using Kalman Filter, Machine Learning and Curve-Fitting Method
Authors:
Aakriti Agrawal,
Aashay Bhise,
Rohitkumar Arasanipalai,
Lima Agnel Tony,
Shuvrangshu Jana,
Debasish Ghose
Abstract:
Accurate estimation and prediction of trajectory is essential for the capture of any high speed target. In this paper, an extended Kalman filter (EKF) is used to track the target in the first loop of the trajectory to collect data points and then a combination of machine learning with least-square curve-fitting is used to accurately estimate future positions for the subsequent loops. The EKF estim…
▽ More
Accurate estimation and prediction of trajectory is essential for the capture of any high speed target. In this paper, an extended Kalman filter (EKF) is used to track the target in the first loop of the trajectory to collect data points and then a combination of machine learning with least-square curve-fitting is used to accurately estimate future positions for the subsequent loops. The EKF estimates the current location of target from its visual information and then predicts its future position by using the observation sequence. We utilize noisy visual information of the target from the three dimensional trajectory to carry out the predictions. The proposed algorithm is developed in ROS-Gazebo environment and is implemented on hardware.
△ Less
Submitted 31 August, 2020;
originally announced September 2020.
-
Resilient Cyberphysical Systems and their Application Drivers: A Technology Roadmap
Authors:
Somali Chaterji,
Parinaz Naghizadeh,
Muhammad Ashraful Alam,
Saurabh Bagchi,
Mung Chiang,
David Corman,
Brian Henz,
Suman Jana,
Na Li,
Shaoshuai Mou,
Meeko Oishi,
Chunyi Peng,
Tiark Rompf,
Ashutosh Sabharwal,
Shreyas Sundaram,
James Weimer,
Jennifer Weller
Abstract:
Cyberphysical systems (CPS) are ubiquitous in our personal and professional lives, and they promise to dramatically improve micro-communities (e.g., urban farms, hospitals), macro-communities (e.g., cities and metropolises), urban structures (e.g., smart homes and cars), and living structures (e.g., human bodies, synthetic genomes). The question that we address in this article pertains to designin…
▽ More
Cyberphysical systems (CPS) are ubiquitous in our personal and professional lives, and they promise to dramatically improve micro-communities (e.g., urban farms, hospitals), macro-communities (e.g., cities and metropolises), urban structures (e.g., smart homes and cars), and living structures (e.g., human bodies, synthetic genomes). The question that we address in this article pertains to designing these CPS systems to be resilient-from-the-ground-up, and through progressive learning, resilient-by-reaction. An optimally designed system is resilient to both unique attacks and recurrent attacks, the latter with a lower overhead. Overall, the notion of resilience can be thought of in the light of three main sources of lack of resilience, as follows: exogenous factors, such as natural variations and attack scenarios; mismatch between engineered designs and exogenous factors ranging from DDoS (distributed denial-of-service) attacks or other cybersecurity nightmares, so called "black swan" events, disabling critical services of the municipal electrical grids and other connected infrastructures, data breaches, and network failures; and the fragility of engineered designs themselves encompassing bugs, human-computer interactions (HCI), and the overall complexity of real-world systems. In the paper, our focus is on design and deployment innovations that are broadly applicable across a range of CPS application areas.
△ Less
Submitted 19 December, 2019;
originally announced January 2020.
-
Robust Heartbeat Detection from Multimodal Data via CNN-based Generalizable Information Fusion
Authors:
B S Chandra,
C S Sastry,
S Jana
Abstract:
Objective: Heartbeat detection remains central to cardiac disease diagnosis and management, and is traditionally performed based on electrocardiogram (ECG). To improve robustness and accuracy of detection, especially, in certain critical-care scenarios, the use of additional physiological signals such as arterial blood pressure (BP) has recently been suggested. There, estimation of heartbeat locat…
▽ More
Objective: Heartbeat detection remains central to cardiac disease diagnosis and management, and is traditionally performed based on electrocardiogram (ECG). To improve robustness and accuracy of detection, especially, in certain critical-care scenarios, the use of additional physiological signals such as arterial blood pressure (BP) has recently been suggested. There, estimation of heartbeat location requires information fusion from multiple signals. However, reported efforts in this direction often obtain multimodal estimates somewhat indirectly, by voting among separately obtained signal-specific intermediate estimates. In contrast, we propose to directly fuse information from multiple signals without requiring intermediate estimates, and thence estimate heartbeat location in a robust manner. Method: We propose as a heartbeat detector, a convolutional neural network (CNN) that learns fused features from multiple physiological signals. This method eliminates the need for hand-picked signal-specific features and ad hoc fusion schemes. Further, being data-driven, the same algorithm learns suitable features from arbitrary set of signals. Results: Using ECG and BP signals of PhysioNet 2014 Challenge database, we obtained a score of 94%. Further, using two ECG channels of MIT-BIH arrhythmia database, we scored 99.92\%. Both those scores compare favourably with previously reported database-specific results. Also, our detector achieved high accuracy in a variety of clinical conditions. Conclusion: The proposed CNN-based information fusion (CIF) algorithm is generalizable, robust and efficient in detecting heartbeat location from multiple signals. Significance: In medical signal monitoring systems, our technique would accurately estimate heartbeat locations even when only a subset of channels are reliable.
△ Less
Submitted 29 June, 2018;
originally announced July 2018.
