-
Advancements in UAV-based Integrated Sensing and Communication: A Comprehensive Survey
Authors:
Manzoor Ahmed,
Ali Arshad Nasir,
Mudassir Masood,
Kamran Ali Memon,
Khurram Karim Qureshi,
Feroz Khan,
Wali Ullah Khan,
Fang Xu,
Zhu Han
Abstract:
Unmanned aerial vehicle (UAV)-based integrated sensing and communication (ISAC) systems are poised to revolutionize next-generation wireless networks by enabling simultaneous sensing and communication (S\&C). This survey comprehensively reviews UAV-ISAC systems, highlighting foundational concepts, key advancements, and future research directions. We explore recent advancements in UAV-based ISAC sy…
▽ More
Unmanned aerial vehicle (UAV)-based integrated sensing and communication (ISAC) systems are poised to revolutionize next-generation wireless networks by enabling simultaneous sensing and communication (S\&C). This survey comprehensively reviews UAV-ISAC systems, highlighting foundational concepts, key advancements, and future research directions. We explore recent advancements in UAV-based ISAC systems from various perspectives and objectives, including advanced channel estimation (CE), beam tracking, and system throughput optimization under joint sensing and communication S\&C constraints. Additionally, we examine weighted sum rate (WSR) and sensing trade-offs, delay and age of information (AoI) minimization, energy efficiency (EE), and security enhancement. These applications highlight the potential of UAV-based ISAC systems to improve spectrum utilization, enhance communication reliability, reduce latency, and optimize energy consumption across diverse domains, including smart cities, disaster relief, and defense operations. The survey also features summary tables for comparative analysis of existing methodologies, emphasizing performance, limitations, and effectiveness in addressing various challenges. By synthesizing recent advancements and identifying open research challenges, this survey aims to be a valuable resource for developing efficient, adaptive, and secure UAV-based ISAC systems.
△ Less
Submitted 11 January, 2025;
originally announced January 2025.
-
Unsupervised Learning Approach for Beamforming in Cell-Free Integrated Sensing and Communication
Authors:
Mohamed Elrashidy,
Mudassir Masood,
Ali Arshad Nasir
Abstract:
Cell-free massive multiple input multiple output (MIMO) systems can provide reliable connectivity and increase user throughput and spectral efficiency of integrated sensing and communication (ISAC) systems. This can only be achieved through intelligent beamforming design. While many works have proposed optimization methods to design beamformers for cell-free systems, the underlying algorithms are…
▽ More
Cell-free massive multiple input multiple output (MIMO) systems can provide reliable connectivity and increase user throughput and spectral efficiency of integrated sensing and communication (ISAC) systems. This can only be achieved through intelligent beamforming design. While many works have proposed optimization methods to design beamformers for cell-free systems, the underlying algorithms are computationally complex and potentially increase fronthaul link loads. To address this concern, we propose an unsupervised learning algorithm to jointly design the communication and sensing beamformers for cell-free ISAC system. Specifically, we adopt a teacher-student training model to guarantee a balanced maximization of sensing signal to noise ratio (SSNR) and signal to interference plus noise ratio (SINR), which represent the sensing and communication metrics, respectively. The proposed scheme is decentralized, which can reduce the load on the central processing unit (CPU) and the required fronthaul links. To avoid the tradeoff problem between sensing and communication counterparts of the cell-free system, we first train two identical models (teacher models) each biased towards one of the two tasks. A third identical model (a student model) is trained based on the maximum sensing and communication performance information obtained by the teacher models. While the results show that our proposed unsupervised DL approach yields a performance close to the state-of-the-art solution, the proposed approach is more computationally efficient than the state of the art by at least three orders of magnitude.
△ Less
Submitted 23 December, 2024;
originally announced December 2024.
-
Solving Inverse Problems with Model Mismatch using Untrained Neural Networks within Model-based Architectures
Authors:
Peimeng Guan,
Naveed Iqbal,
Mark A. Davenport,
Mudassir Masood
Abstract:
Model-based deep learning methods such as loop unrolling (LU) and deep equilibrium model}(DEQ) extensions offer outstanding performance in solving inverse problems (IP). These methods unroll the optimization iterations into a sequence of neural networks that in effect learn a regularization function from data. While these architectures are currently state-of-the-art in numerous applications, their…
▽ More
Model-based deep learning methods such as loop unrolling (LU) and deep equilibrium model}(DEQ) extensions offer outstanding performance in solving inverse problems (IP). These methods unroll the optimization iterations into a sequence of neural networks that in effect learn a regularization function from data. While these architectures are currently state-of-the-art in numerous applications, their success heavily relies on the accuracy of the forward model. This assumption can be limiting in many physical applications due to model simplifications or uncertainties in the apparatus. To address forward model mismatch, we introduce an untrained forward model residual block within the model-based architecture to match the data consistency in the measurement domain for each instance. We propose two variants in well-known model-based architectures (LU and DEQ) and prove convergence under mild conditions. Our approach offers a unified solution that is less parameter-sensitive, requires no additional data, and enables simultaneous fitting of the forward model and reconstruction in a single pass, benefiting both linear and nonlinear inverse problems. The experiments show significant quality improvement in removing artifacts and preserving details across three distinct applications, encompassing both linear and nonlinear inverse problems. Moreover, we highlight reconstruction effectiveness in intermediate steps and showcase robustness to random initialization of the residual block and a higher number of iterations during evaluation. Code is available at \texttt{https://github.com/InvProbs/A-adaptive-model-based-methods}.
△ Less
Submitted 10 June, 2024; v1 submitted 7 March, 2024;
originally announced March 2024.
-
Data-driven Integrated Sensing and Communication: Recent Advances, Challenges, and Future Prospects
Authors:
Hammam Salem,
MD Muzakkir Quamar,
Adeb Mansoor,
Mohammed Elrashidy,
Nasir Saeed,
Mudassir Masood
Abstract:
Integrated Sensing and Communication (ISAC), combined with data-driven approaches, has emerged as a highly significant field, garnering considerable attention from academia and industry. Its potential to enable wide-scale applications in the future sixth-generation (6G) networks has led to extensive recent research efforts. Machine learning (ML) techniques, including $K$-nearest neighbors (KNN), s…
▽ More
Integrated Sensing and Communication (ISAC), combined with data-driven approaches, has emerged as a highly significant field, garnering considerable attention from academia and industry. Its potential to enable wide-scale applications in the future sixth-generation (6G) networks has led to extensive recent research efforts. Machine learning (ML) techniques, including $K$-nearest neighbors (KNN), support vector machines (SVM), deep learning (DL) architectures, and reinforcement learning (RL) algorithms, have been deployed to address various design aspects of ISAC and its diverse applications. Therefore, this paper aims to explore integrating various ML techniques into ISAC systems, covering various applications. These applications span intelligent vehicular networks, encompassing unmanned aerial vehicles (UAVs) and autonomous cars, as well as radar applications, localization and tracking, millimeter wave (mmWave) and Terahertz (THz) communication, and beamforming. The contributions of this paper lie in its comprehensive survey of ML-based works in the ISAC domain and its identification of challenges and future research directions. By synthesizing the existing knowledge and proposing new research avenues, this survey serves as a valuable resource for researchers, practitioners, and stakeholders involved in advancing the capabilities of ISAC systems in the context of 6G networks.
△ Less
Submitted 17 August, 2023;
originally announced August 2023.
-
Review of Contemporary Energy Harvesting Techniques and Their Feasibility in Wireless Geophones
Authors:
Naveed Iqbal,
Mudassir Masood,
Ali Nasir,
Khurram Karim Qureshi
Abstract:
Energy harvesting converts ambient energy to electrical energy providing numerous opportunities to realize wireless sensors. Seismic exploration is a prime avenue to benefit from it as energy harvesting equipped geophones would relieve the burden of cables which account for the biggest chunk of exploration cost and equipment weight. Since numerous energies are abundantly available in seismic field…
▽ More
Energy harvesting converts ambient energy to electrical energy providing numerous opportunities to realize wireless sensors. Seismic exploration is a prime avenue to benefit from it as energy harvesting equipped geophones would relieve the burden of cables which account for the biggest chunk of exploration cost and equipment weight. Since numerous energies are abundantly available in seismic fields, these can be harvested to power up geophones. However, due to the random and intermittent nature of the harvested energy, it is important that geophones must be equipped to tap from several energy sources for a stable operation. It may involve some initial installation cost but in the long run, it is cost-effective and beneficial as the sources for energy harvesting are available naturally. Extensive research has been carried out in recent years to harvest energies from various sources. However, there has not been a thorough investigation of utilizing these developments in the seismic context. In this survey, a comprehensive literature review is provided on the research progress in energy harvesting methods suitable for direct adaptation in geophones. Specifically, the focus is on small form factor energy harvesting circuits and systems capable of harvesting energy from wind, sun, vibrations, temperature difference, and radio frequencies. Furthermore, case studies are presented to assess the suitability of the studied energy harvesting methods. Finally, a design of energy harvesting equipped geophone is also proposed.
△ Less
Submitted 8 August, 2023;
originally announced August 2023.
-
Learned Proximal Operator for Solving Seismic Deconvolution Problem
Authors:
Peimeng Guan,
Naveed Iqbal,
Mark A. Davenport,
Mudassir Masood
Abstract:
Seismic deconvolution is an essential step in seismic data processing that aims to extract layer information from noisy observed traces. In general, this is an ill-posed problem with non-unique solutions. Due to the sparse nature of the reflectivity sequence, spike-promoting regularizers such as the $\ell_1$-norm are frequently used. They either require rigorous coefficient tuning or strong assump…
▽ More
Seismic deconvolution is an essential step in seismic data processing that aims to extract layer information from noisy observed traces. In general, this is an ill-posed problem with non-unique solutions. Due to the sparse nature of the reflectivity sequence, spike-promoting regularizers such as the $\ell_1$-norm are frequently used. They either require rigorous coefficient tuning or strong assumptions about reflectivity, such as assuming reflectivity as sparse signals with known sparsity levels and zero-mean Gaussian noise with known noise levels. To overcome the limitations of traditional regularizers, learning-based regularizers are proposed in the recent past. This paper proposes a Learned Proximal operator for Seismic Deconvolution (LP4SD), which leverages a neural network to learn the proximal operator of a regularizer. LP4SD is trained in a loop unrolled manner and is capable of learning complicated structures from the training data. It is worth mentioning that the network is trained with synthetic data and evaluated on both synthetic and real data. LP4SD is shown to generate better reconstruction results in terms of three different metrics as compared to learning a direct inverse.
△ Less
Submitted 19 July, 2023;
originally announced July 2023.
-
Details Preserving Deep Collaborative Filtering-Based Method for Image Denoising
Authors:
Basit O. Alawode,
Mudassir Masood,
Tarig Ballal,
Tareq Al-Naffouri
Abstract:
In spite of the improvements achieved by the several denoising algorithms over the years, many of them still fail at preserving the fine details of the image after denoising. This is as a result of the smooth-out effect they have on the images. Most neural network-based algorithms have achieved better quantitative performance than the classical denoising algorithms. However, they also suffer from…
▽ More
In spite of the improvements achieved by the several denoising algorithms over the years, many of them still fail at preserving the fine details of the image after denoising. This is as a result of the smooth-out effect they have on the images. Most neural network-based algorithms have achieved better quantitative performance than the classical denoising algorithms. However, they also suffer from qualitative (visual) performance as a result of the smooth-out effect. In this paper, we propose an algorithm to address this shortcoming. We propose a deep collaborative filtering-based (Deep-CoFiB) algorithm for image denoising. This algorithm performs collaborative denoising of image patches in the sparse domain using a set of optimized neural network models. This results in a fast algorithm that is able to excellently obtain a trade-off between noise removal and details preservation. Extensive experiments show that the DeepCoFiB performed quantitatively (in terms of PSNR and SSIM) and qualitatively (visually) better than many of the state-of-the-art denoising algorithms.
△ Less
Submitted 14 July, 2021; v1 submitted 11 July, 2021;
originally announced July 2021.
-
Collaborative Filtering-Based Method for Low-Resolution and Details Preserving Image Denoising
Authors:
Basit O. Alawode,
Mudassir Masood,
Tarig Ballal,
Tareq Al-Naffouri
Abstract:
Over the years, progressive improvements in denoising performance have been achieved by several image denoising algorithms that have been proposed. Despite this, many of these state-of-the-art algorithms tend to smooth out the denoised image resulting in the loss of some image details after denoising. Many also distort images of lower resolution resulting in a partial or complete structural loss.…
▽ More
Over the years, progressive improvements in denoising performance have been achieved by several image denoising algorithms that have been proposed. Despite this, many of these state-of-the-art algorithms tend to smooth out the denoised image resulting in the loss of some image details after denoising. Many also distort images of lower resolution resulting in a partial or complete structural loss. In this paper, we address these shortcomings by proposing a collaborative filtering-based (CoFiB) denoising algorithm. Our proposed algorithm performs weighted sparse domain collaborative denoising by taking advantage of the fact that similar patches tend to have similar sparse representations in the sparse domain. This gives our algorithm the intelligence to strike a balance between image detail preservation and noise removal. Our extensive experiments showed that our proposed CoFiB algorithm does not only preserve the image details but also perform excellently for images of any given resolution where many denoising algorithms tend to struggle, specifically at low resolutions.
△ Less
Submitted 10 July, 2021;
originally announced July 2021.
-
Dense-Sparse Deep Convolutional Neural Networks Training for Image Denoising
Authors:
Basit O. Alawode,
Mudassir Masood
Abstract:
Recently, deep learning methods such as the convolutional neural networks have gained prominence in the area of image denoising. This is owing to their proven ability to surpass state-of-the-art classical image denoising algorithms such as block-matching and 3D filtering algorithm. Deep denoising convolutional neural networks use many feed-forward convolution layers with added regularization metho…
▽ More
Recently, deep learning methods such as the convolutional neural networks have gained prominence in the area of image denoising. This is owing to their proven ability to surpass state-of-the-art classical image denoising algorithms such as block-matching and 3D filtering algorithm. Deep denoising convolutional neural networks use many feed-forward convolution layers with added regularization methods of batch normalization and residual learning to speed up training and improve denoising performance significantly. However, this comes at the expense of a huge number of trainable parameters. In this paper, we show that by employing an enhanced dense-sparse-dense network training procedure to the deep denoising convolutional neural networks, comparable denoising performance level can be achieved at a significantly reduced number of trainable parameters. We derive motivation from the fact that networks trained using the dense-sparse-dense approach have been shown to attain performance boost with reduced number of parameters. The proposed reduced deep denoising convolutional neural networks network is an efficient denoising model with significantly reduced parameters and comparable performance to the deep denoising convolutional neural networks. Additionally, denoising was achieved at significantly reduced processing time.
△ Less
Submitted 30 August, 2024; v1 submitted 10 July, 2021;
originally announced July 2021.
-
Deepfakes Generation and Detection: State-of-the-art, open challenges, countermeasures, and way forward
Authors:
Momina Masood,
Marriam Nawaz,
Khalid Mahmood Malik,
Ali Javed,
Aun Irtaza
Abstract:
Easy access to audio-visual content on social media, combined with the availability of modern tools such as Tensorflow or Keras, open-source trained models, and economical computing infrastructure, and the rapid evolution of deep-learning (DL) methods, especially Generative Adversarial Networks (GAN), have made it possible to generate deepfakes to disseminate disinformation, revenge porn, financia…
▽ More
Easy access to audio-visual content on social media, combined with the availability of modern tools such as Tensorflow or Keras, open-source trained models, and economical computing infrastructure, and the rapid evolution of deep-learning (DL) methods, especially Generative Adversarial Networks (GAN), have made it possible to generate deepfakes to disseminate disinformation, revenge porn, financial frauds, hoaxes, and to disrupt government functioning. The existing surveys have mainly focused on the detection of deepfake images and videos. This paper provides a comprehensive review and detailed analysis of existing tools and machine learning (ML) based approaches for deepfake generation and the methodologies used to detect such manipulations for both audio and visual deepfakes. For each category of deepfake, we discuss information related to manipulation approaches, current public datasets, and key standards for the performance evaluation of deepfake detection techniques along with their results. Additionally, we also discuss open challenges and enumerate future directions to guide future researchers on issues that need to be considered to improve the domains of both deepfake generation and detection. This work is expected to assist the readers in understanding the creation and detection mechanisms of deepfakes, along with their current limitations and future direction.
△ Less
Submitted 22 November, 2021; v1 submitted 25 February, 2021;
originally announced March 2021.
-
Indoor occupancy estimation from carbon dioxide concentration
Authors:
Chaoyang Jiang,
Mustafa K. Masood,
Yeng Chai Soh,
Hua Li
Abstract:
This paper presents an indoor occupancy estimator with which we can estimate the number of real-time indoor occupants based on the carbon dioxide (CO2) measurement. The estimator is actually a dynamic model of the occupancy level. To identify the dynamic model, we propose the Feature Scaled Extreme Learning Machine (FS-ELM) algorithm, which is a variation of the standard Extreme Learning Machine (…
▽ More
This paper presents an indoor occupancy estimator with which we can estimate the number of real-time indoor occupants based on the carbon dioxide (CO2) measurement. The estimator is actually a dynamic model of the occupancy level. To identify the dynamic model, we propose the Feature Scaled Extreme Learning Machine (FS-ELM) algorithm, which is a variation of the standard Extreme Learning Machine (ELM) but is shown to perform better for the occupancy estimation problem. The measured CO2 concentration suffers from serious spikes. We find that pre-smoothing the CO2 data can greatly improve the estimation accuracy. In real applications, however, we cannot obtain the real-time globally smoothed CO2 data. We provide a way to use the locally smoothed CO2 data instead, which is real-time available. We introduce a new criterion, i.e. $x$-tolerance accuracy, to assess the occupancy estimator. The proposed occupancy estimator was tested in an office room with 24 cubicles and 11 open seats. The accuracy is up to 94 percent with a tolerance of four occupants.
△ Less
Submitted 20 July, 2016;
originally announced July 2016.