Showing 1–42 of 42 results for author: Khaliq, A

The Impact of COVID-19 on FinTech Lending in Indonesia: Evidence From Interrupted Time Series Analysis

Authors: Abdul Khaliq

Abstract: This study measures the impact of COVID-19 outbreaks on financial technology (FinTech) lending in Indonesia. Using monthly FinTech data published by Financial Services Authority (OJK) over the period 2018M02-2021M04, the article examines the impact of COVID-19 started on March 2020 on FinTech by adopting an interrupted time series (ITS) experiment. The estimation shows that the COVID-19 outbreaks… ▽ More This study measures the impact of COVID-19 outbreaks on financial technology (FinTech) lending in Indonesia. Using monthly FinTech data published by Financial Services Authority (OJK) over the period 2018M02-2021M04, the article examines the impact of COVID-19 started on March 2020 on FinTech by adopting an interrupted time series (ITS) experiment. The estimation shows that the COVID-19 outbreaks negatively affect changes in FinTech lending level in Indonesia, but the changes in the trend are positive. Moreover, the COVID-19 has been found to have a negative and statistically significant effect on the 90-day success loan settlement rate level. However, COVID-19 has positive and statistically significant effects on the 90-day default rate of loan repayment level. These estimation results recommend that the financial services authority of Indonesia should intensively promote various innovative financial technology (FinTech) lending post-COVID-19 to increase digital financial inclusion by providing peer to peer lending (P2P) to unbanked populations. △ Less

Submitted 10 May, 2025; originally announced May 2025.

Comments: 16 pages

The quest for explosive bubbles in the Indonesian Rupiah/US exchange rate: Does the uncertainty trinity matter?

Authors: Abdul Khaliq, Syafruddin Karimi, Werry Darta Taifur, Endrizal Ridwan

Abstract: The Generalized Supremum Augmented Dickey-Fuller (GSADF) technique is performed to resolve whether the Indonesian Rupiah/US exchange rate has experienced multiple explosive bubbles. The GSADF uncovers that the Indonesian Rupiah/US exchange rate deviates from the fundamental values by six times from January 1985 to September 2023, periodically indicating the presence of numerous explosive behaviors… ▽ More The Generalized Supremum Augmented Dickey-Fuller (GSADF) technique is performed to resolve whether the Indonesian Rupiah/US exchange rate has experienced multiple explosive bubbles. The GSADF uncovers that the Indonesian Rupiah/US exchange rate deviates from the fundamental values by six times from January 1985 to September 2023, periodically indicating the presence of numerous explosive behaviors. Once the full-sample period separates into the managed-floating regime and the free-floating regime, the GSADF still detects multiple bubbles. Of particular curiosity on uncertainty trinity, this study underlines that global geopolitical risk negatively drives explosive actions in the ratio of exchange rates for non-traded and traded goods. The global economic policy uncertainty negatively affects speculative bubbles in the exchange rate and the ratio of exchange rates for non-traded. The country's geopolitical risks negatively strike only speculative bubbles in the exchange rate. Further, we find heterogeneity in our results by examining different exchange rate systems. The robustness checks further firmly ascertain across baseline empirical findings. △ Less

Submitted 3 May, 2025; originally announced May 2025.

Comments: 12 pages

Multi-modal strain mapping of steel crack tips with micrometer spatial resolution

Authors: Ahmar Khaliq, Felix Wittwer, Markus Hartmann, Matthias Thimm, Robert Brandt, Dennis Brueckner, Jan Garrevoet, Gerald Falkenberg, Peter Modregger

Abstract: Due to their superior fatigue strength, martensitic steels are the material of choice for high cyclic loading applications such as coil springs. However, crack propagation is influenced by residual stresses and their interaction is poorly understood. In fact, Linear Elastic Fracture Mechanics predicts un-physical singularities in the strain around the crack tip. In this study, we have combined syn… ▽ More Due to their superior fatigue strength, martensitic steels are the material of choice for high cyclic loading applications such as coil springs. However, crack propagation is influenced by residual stresses and their interaction is poorly understood. In fact, Linear Elastic Fracture Mechanics predicts un-physical singularities in the strain around the crack tip. In this study, we have combined synchrotron-based x-ray diffraction, x-ray fluorescence, and optical microscopy to map the factual strain fields around crack tips with micrometer spatial resolution. X-ray fluorescence and optical images were co-registered to locate the crack in the x-ray diffraction maps. Observed crystal recovery close to cracks confirmed that the diffraction signal originates at least in parts from the cracks. The retrieved local strain field around the crack was further improved by averaging information over carefully selected diffraction peaks. This procedure provided strain maps around crack tips with a spatial resolution of about 1 micro meter and enabled a prediction of further crack growth. △ Less

Submitted 8 April, 2025; originally announced April 2025.

X-ray Strain and Stress Tensor Tomography

Authors: Peter Modregger, James. A. D. Ball, Felix Wittwer, Ahmar Khaliq, Jonathan Wright

Abstract: The microscopic distribution of strain and stress plays a crucial role for the performance, safety, and lifetime of components in aeronautics, automotive and critical infrastructure [1]. While non-destructive methods for measuring the stress close to the surface have long been long established, only a limited number of approaches for depth-resolved measurements based on x-rays or neutrons are avai… ▽ More The microscopic distribution of strain and stress plays a crucial role for the performance, safety, and lifetime of components in aeronautics, automotive and critical infrastructure [1]. While non-destructive methods for measuring the stress close to the surface have long been long established, only a limited number of approaches for depth-resolved measurements based on x-rays or neutrons are available [2]. These feature significant limitations, including long scan times, intricate experimental set-ups, limited spatial resolution or anisotropic gauge volumes with aspect ratios of 1:10 or worse. Here, we present a method that overcomes these limitations and obtains tomographic reconstructions of the full six-dimensional strain and stress tensor components. Using a simple and wide spread experimental set-up that combines x-ray powder diffraction with single axis tomography, we achieve non-destructive determination of depth-resolved strain and stress distributions with isotropic resolution. The presented method could be of interest for additive manufacturing of metals [3,4], battery research [5], in-situ metallurgy [6] and the experimental validation of finite element simulations [7]. △ Less

Submitted 8 April, 2025; originally announced April 2025.

Ultimate Sensitivity in X-ray Diffraction: Angular Moments vs. Shot Noise

Authors: Peter Modregger, Felix Wittwer, Ahmar Khaliq, Niklas Pyrlik, James A. D. Ball, Jan Garrevoet, Gerald Falkenberg, Alexander Liehr, Michael Stuckelberger

Abstract: The sensitivity of x-ray diffraction experiments towards Bragg peak parameters constitutes a crucial performance attribute of experimental setups. Frequently, diffraction peaks are characterized by model-free angular moment analysis, which offers a greater versatility compared to traditional model-based peak fitting. Here, we have determined the ultimate sensitivity of angular moments for diffract… ▽ More The sensitivity of x-ray diffraction experiments towards Bragg peak parameters constitutes a crucial performance attribute of experimental setups. Frequently, diffraction peaks are characterized by model-free angular moment analysis, which offers a greater versatility compared to traditional model-based peak fitting. Here, we have determined the ultimate sensitivity of angular moments for diffraction data that is limited by photon shot noise. We report experimentally achieved sensitivities of the first moment below $1/1000$th of a detector pixel and below $1μ$rad. We have demonstrated the validity of our theoretical predictions by an excellent agreement with experimental results from three different setups. The provided formulas for the uncertainties of angular moments allow for the rapid determination of experimentally achieved sensitivities from single diffraction frames. △ Less

Submitted 27 February, 2025; v1 submitted 25 February, 2025; originally announced February 2025.

Quantum Recurrent Neural Networks with Encoder-Decoder for Time-Dependent Partial Differential Equations

Authors: Yuan Chen, Abdul Khaliq, Khaled M. Furati

Abstract: Nonlinear time-dependent partial differential equations are essential in modeling complex phenomena across diverse fields, yet they pose significant challenges due to their computational complexity, especially in higher dimensions. This study explores Quantum Recurrent Neural Networks within an encoder-decoder framework, integrating Variational Quantum Circuits into Gated Recurrent Units and Long… ▽ More Nonlinear time-dependent partial differential equations are essential in modeling complex phenomena across diverse fields, yet they pose significant challenges due to their computational complexity, especially in higher dimensions. This study explores Quantum Recurrent Neural Networks within an encoder-decoder framework, integrating Variational Quantum Circuits into Gated Recurrent Units and Long Short-Term Memory networks. Using this architecture, the model efficiently compresses high-dimensional spatiotemporal data into a compact latent space, facilitating more efficient temporal evolution. We evaluate the algorithms on the Hamilton-Jacobi-Bellman equation, Burgers' equation, the Gray-Scott reaction-diffusion system, and the three dimensional Michaelis-Menten reaction-diffusion equation. The results demonstrate the superior performance of the quantum-based algorithms in capturing nonlinear dynamics, handling high-dimensional spaces, and providing stable solutions, highlighting their potential as an innovative tool in solving challenging and complex systems. △ Less

Submitted 18 February, 2025; originally announced February 2025.

VLAD-BuFF: Burst-aware Fast Feature Aggregation for Visual Place Recognition

Authors: Ahmad Khaliq, Ming Xu, Stephen Hausler, Michael Milford, Sourav Garg

Abstract: Visual Place Recognition (VPR) is a crucial component of many visual localization pipelines for embodied agents. VPR is often formulated as an image retrieval task aimed at jointly learning local features and an aggregation method. The current state-of-the-art VPR methods rely on VLAD aggregation, which can be trained to learn a weighted contribution of features through their soft assignment to cl… ▽ More Visual Place Recognition (VPR) is a crucial component of many visual localization pipelines for embodied agents. VPR is often formulated as an image retrieval task aimed at jointly learning local features and an aggregation method. The current state-of-the-art VPR methods rely on VLAD aggregation, which can be trained to learn a weighted contribution of features through their soft assignment to cluster centers. However, this process has two key limitations. Firstly, the feature-to-cluster weighting does not account for over-represented repetitive structures within a cluster, e.g., shadows or window panes; this phenomenon is also referred to as the `burstiness' problem, classically solved by discounting repetitive features before aggregation. Secondly, feature to cluster comparisons are compute-intensive for state-of-the-art image encoders with high-dimensional local features. This paper addresses these limitations by introducing VLAD-BuFF with two novel contributions: i) a self-similarity based feature discounting mechanism to learn Burst-aware features within end-to-end VPR training, and ii) Fast Feature aggregation by reducing local feature dimensions specifically through PCA-initialized learnable pre-projection. We benchmark our method on 9 public datasets, where VLAD-BuFF sets a new state of the art. Our method is able to maintain its high recall even for 12x reduced local feature dimensions, thus enabling fast feature aggregation without compromising on recall. Through additional qualitative studies, we show how our proposed weighting method effectively downweights the non-distinctive features. Source code: https://github.com/Ahmedest61/VLAD-BuFF/. △ Less

Submitted 28 September, 2024; originally announced September 2024.

Comments: Presented at ECCV 2024; Includes supplementary; 29 pages; 7 figures

Measurements of dislocations in 4H-SiC with rocking curve imaging

Authors: Ahmar Khaliq, Felix Wittwer, Niklas Pyrlik, Giovanni Fevola, Svenja Patjens, Jackson Barp, Gero Falkenberg, Sven Hampel, Michael Stuckelberger, Jan Garrevoet, Dennis Bruckner, Peter Modregger

Abstract: 4H Silicon Carbide (4H-SiC) combines many attractive properties such as a high carrier mobility, a wide bandgap, and a high thermal conductivity, making it an ideal candidate for high-power electronic devices. However, a primary challenge in utilizing 4H-SiC is the presence of defects in epitaxial layers, which can significantly degrade device performance. In this study, we have used X-ray transmi… ▽ More 4H Silicon Carbide (4H-SiC) combines many attractive properties such as a high carrier mobility, a wide bandgap, and a high thermal conductivity, making it an ideal candidate for high-power electronic devices. However, a primary challenge in utilizing 4H-SiC is the presence of defects in epitaxial layers, which can significantly degrade device performance. In this study, we have used X-ray transmission topography with a rocking curve imaging technique to characterize the types and distribution of defects in 4H-SiC. The derived maps from the fitted Gaussian parameters were used to investigate dislocations in 4H-SiC. Understanding the distribution of the dislocations provides valuable insights into the overall crystal quality, which can guide improvements for the fabrication processes. △ Less

Submitted 30 August, 2024; originally announced September 2024.

Parallax in angular sensitive powder diffraction tomography

Authors: Peter Modregger, Ahmar Khaliq, Felix Wittwer

Abstract: While a few methods for the determination of depth-resolved strain distributions each with inherent limitations are available, tomographic reconstruction has been applied to this problem in only a limited sense. One of the challenges was the potential impact of geometric parallax, which constitutes a non-negligible lateral offset of diffraction information arising from different sample depths at t… ▽ More While a few methods for the determination of depth-resolved strain distributions each with inherent limitations are available, tomographic reconstruction has been applied to this problem in only a limited sense. One of the challenges was the potential impact of geometric parallax, which constitutes a non-negligible lateral offset of diffraction information arising from different sample depths at the detector. Here, the effect of parallax was investigated and two main results have emerged. First, the impact of parallax was found to be additive to other offset contributions, which implies a straightforward correction. Second, for tomographic scans utilizing a full 360° rotation parallax has been found to have no impact on reconstructions of angular information. △ Less

Submitted 30 August, 2024; originally announced September 2024.

Quality Scalable Quantization Methodology for Deep Learning on Edge

Authors: Salman Abdul Khaliq, Rehan Hafiz

Abstract: Deep Learning Architectures employ heavy computations and bulk of the computational energy is taken up by the convolution operations in the Convolutional Neural Networks. The objective of our proposed work is to reduce the energy consumption and size of CNN for using machine learning techniques in edge computing on ubiquitous computing devices. We propose Systematic Quality Scalable Design Methodo… ▽ More Deep Learning Architectures employ heavy computations and bulk of the computational energy is taken up by the convolution operations in the Convolutional Neural Networks. The objective of our proposed work is to reduce the energy consumption and size of CNN for using machine learning techniques in edge computing on ubiquitous computing devices. We propose Systematic Quality Scalable Design Methodology consisting of Quality Scalable Quantization on a higher abstraction level and Quality Scalable Multipliers at lower abstraction level. The first component consists of parameter compression where we approximate representation of values in filters of deep learning models by encoding in 3 bits. A shift and scale based on-chip decoding hardware is proposed which can decode these 3-bit representations to recover approximate filter values. The size of the DNN model is reduced this way and can be sent over a communication channel to be decoded on the edge computing devices. This way power is reduced by limiting data bits by approximation. In the second component we propose a quality scalable multiplier which reduces the number of partial products by converting numbers in canonic sign digit representations and further approximating the number by reducing least significant bits. These quantized CNNs provide almost same ac-curacy as network with original weights with little or no fine-tuning. The hardware for the adaptive multipliers utilize gate clocking for reducing energy consumption during multiplications. The proposed methodology greatly reduces the memory and power requirements of DNN models making it a feasible approach to deploy Deep Learning on edge computing. The experiments done on LeNet and ConvNets show an increase upto 6% of zeros and memory savings upto 82.4919% while keeping the accuracy near the state of the art. △ Less

Submitted 15 July, 2024; originally announced July 2024.

RAGAR, Your Falsehood Radar: RAG-Augmented Reasoning for Political Fact-Checking using Multimodal Large Language Models

Authors: M. Abdul Khaliq, P. Chang, M. Ma, B. Pflugfelder, F. Miletić

Abstract: The escalating challenge of misinformation, particularly in political discourse, requires advanced fact-checking solutions; this is even clearer in the more complex scenario of multimodal claims. We tackle this issue using a multimodal large language model in conjunction with retrieval-augmented generation (RAG), and introduce two novel reasoning techniques: Chain of RAG (CoRAG) and Tree of RAG (T… ▽ More The escalating challenge of misinformation, particularly in political discourse, requires advanced fact-checking solutions; this is even clearer in the more complex scenario of multimodal claims. We tackle this issue using a multimodal large language model in conjunction with retrieval-augmented generation (RAG), and introduce two novel reasoning techniques: Chain of RAG (CoRAG) and Tree of RAG (ToRAG). They fact-check multimodal claims by extracting both textual and image content, retrieving external information, and reasoning subsequent questions to be answered based on prior evidence. We achieve a weighted F1-score of 0.85, surpassing a baseline reasoning technique by 0.14 points. Human evaluation confirms that the vast majority of our generated fact-check explanations contain all information from gold standard data. △ Less

Submitted 11 July, 2024; v1 submitted 18 April, 2024; originally announced April 2024.

Comments: 8 pages, submitted to ACL Rolling Review June 2024

On Computability of Computable Problems

Authors: Asad Khaliq

Abstract: Computational problems are classified into computable and uncomputable problems. If there exists an effective procedure (algorithm) to compute a problem then the problem is computable otherwise it is uncomputable. Turing machines can execute any algorithm therefore every computable problem is Turing computable. Cardinality of Turing machines and computable problems is equal-both are countably infi… ▽ More Computational problems are classified into computable and uncomputable problems. If there exists an effective procedure (algorithm) to compute a problem then the problem is computable otherwise it is uncomputable. Turing machines can execute any algorithm therefore every computable problem is Turing computable. Cardinality of Turing machines and computable problems is equal-both are countably infinite. In this paper we introduce new type of problems by constructing a transform technique and applying it on some computable problems. The transformed problems can be computable of uncomputable. △ Less

Submitted 5 September, 2024; v1 submitted 13 December, 2023; originally announced February 2024.

Comments: 12 Pages,4 figures, and 1 table

Rational Approximations for Oscillatory Two-Parameter Mittag-Leffler Function

Authors: Aljowhara H. Honain, Khaled M. Furati, Ibrahim O. Sarumi, Abdul Q. M. Khaliq

Abstract: The two-parameter Mittag-Leffler function $E_{α, β}$ is of fundamental importance in fractional calculus. It appears frequently in the solutions of fractional differential and integral equations. Nonetheless, this vital function is often expensive to compute. Several attempts have been made to construct cost-effective and accurate approximations. These attempts focus mainly on the completely monot… ▽ More The two-parameter Mittag-Leffler function $E_{α, β}$ is of fundamental importance in fractional calculus. It appears frequently in the solutions of fractional differential and integral equations. Nonetheless, this vital function is often expensive to compute. Several attempts have been made to construct cost-effective and accurate approximations. These attempts focus mainly on the completely monotone Mittag-Leffler functions. However, when $α> 1$ the monotonicity property is largely lost and as such roots and oscillations are exhibited. Consequently, existing approximants constructed mainly for $α\in (0,1)$ often fail to capture this oscillatory behavior. In this paper, we construct computationally efficient and accurate rational approximants for $E_{α, β}(-t)$, $t \ge 0$, with $α\in (1,2)$. This construction is fundamentally based on the decomposition of Mittag-Leffler function with real roots into one without and a polynomial. Following which new approximants are constructed by combining the global Padé approximation with a polynomial of appropriate degree. The rational approximants are extended to approximation of matrix Mittag-Leffler and different approaches to achieve efficient implementation for matrix arguments are discussed. Numerical experiments are provided to illustrate the significant accuracy improvement achieved by the proposed approximants. △ Less

Submitted 12 December, 2023; originally announced December 2023.

Comments: 20 pages, 14 figures and 5 tables

Extrinsic Anomalous Hall effect in Mn Doped GeSnTe Semiconductors in the Bad Metal Hopping Regime

Authors: A. Khaliq, R. Minikaev, S. Zakar, M. Arciszewska, A. Avdonin, V. E. Slynko, L. Kilanski

Abstract: We present high field magnetotransport studies of Ge1-x-y(SnxMny)Te bulk multiferroics with diamagnetic Sn and paramagnetic Mn concentration x = 0.38 to 0.79 and y = 0.02 to 0.086, respectively. The zero field resistivity, ρ(T) takes significant contribution from defects below T = 20 K however, a mixed scattering contribution from dynamic disorder and unusual sources is estimated from T = 20 K to… ▽ More We present high field magnetotransport studies of Ge1-x-y(SnxMny)Te bulk multiferroics with diamagnetic Sn and paramagnetic Mn concentration x = 0.38 to 0.79 and y = 0.02 to 0.086, respectively. The zero field resistivity, ρ(T) takes significant contribution from defects below T = 20 K however, a mixed scattering contribution from dynamic disorder and unusual sources is estimated from T = 20 K to 300 K. The carrier mobility shows anomalous temperature dependence from T0.2 to T0.5 which hints towards possible presence of polaronic effects resulting from coupling of holes with phonons. This anomalous behavior cannot be understood in terms of pure phononic scattering mechanism at high temperature. From point of view of high field results, the transverse component of magnetoresistivity manifests anomalous Hall effect originating from extrinsic scattering sources, particularly the side jump mechanism reveals a larger contribution. We also find that the correlation between the transverse and longitudinal conductivities follow the universal scaling law σxy ~ σxxn where n = 1.6 in the low conductivity limit. The values n = 1.5 to 1.8 obtained for the present GSMT alloys justify the bad metal hopping regime since the results fall in the low conductivity ferromagnetic family with σxx ~ 104 ohmcm-1. The interpretation of the n = 1.6 scaling in the low conductivity regime is thus far not fully understood. However, the anomalous Hall resistivity scaling with modified relation by Tian et al is indicative of the dominant side jump scattering along with noticeable role of skew scattering. △ Less

Submitted 12 July, 2023; originally announced July 2023.

Comments: 13 pages, 9 figures, 2 tables

Magnetic phase diagram of Ge1-x-ySnxMnyTe multiferroic semiconductors; coexistence of ferromagnetic and cluster glass ordering

Authors: Abdul Khaliq, Sabina Lewinska, Roman Minikaev, Monika Arciszewska, Andrei Avdonin, Beata Brodowska, Vasily E. Slynko, Anna Slawska Waniewska, Lukasz Kilanski

Abstract: We report the structural and magnetic results of polar α-GeTe doped with Sn and Mn from x = 0.185 to 0.841 and y = 0.02 to 0.086, respectively. The magnetic results of Ge1-x-y(SnxMny)Te (GSMT) crystals identify Mn-clustering effect with scaling parameter, R = 0.033 for x ~ 0.2 and y = 0.06. The excessive Sn ions are assumed to drive the inception of short range ferromagnetic clusters. For the crys… ▽ More We report the structural and magnetic results of polar α-GeTe doped with Sn and Mn from x = 0.185 to 0.841 and y = 0.02 to 0.086, respectively. The magnetic results of Ge1-x-y(SnxMny)Te (GSMT) crystals identify Mn-clustering effect with scaling parameter, R = 0.033 for x ~ 0.2 and y = 0.06. The excessive Sn ions are assumed to drive the inception of short range ferromagnetic clusters. For the crystals revealing glassy magnetic behavior, the irreversibility temperature, Tirr shifts at high dc magnetic field which is well described by de Almeida-Thouless equation, δTirr ~ HΦ/2 yielding Φ values of 1.55 and 1.7 that validates the formation of Mn clusters. The spin relaxation time, τ0 ~ 10-9 s, activation energy, Ea/kB ~ 5 TF where TF is freeing temperature and Vogel-Fulcher temperature, T0 ~ TF also signify intracluster interactions. Also, the Mn-hole magnetic exchange constant, Jpd drops from 0.24 eV for the samples with smaller Sn content of x ~ 0.2 to 0.16 eV for Sn rich alloy with x ~ 0.8. Consequently, we present a magnetic phase diagram for GSMT bulk crystals as a function of Mn(y) ions. △ Less

Submitted 21 May, 2023; originally announced May 2023.

Comments: This preprint has 18 pages, 8 main figures, 2 tables and 7 supporting figures

Fourier Spectral Methods with Exponential Time Differencing for Space-Fractional Partial Differential Equations in Population Dynamics

Authors: A. P. Harris, T. A. Biala, A. Q. M. Khaliq

Abstract: Physical laws governing population dynamics are generally expressed as differential equations. Research in recent decades has incorporated fractional-order (non-integer) derivatives into differential models of natural phenomena, such as reaction-diffusion systems. In this paper, we develop a method to numerically solve a multi-component and multi-dimensional space-fractional system. For space disc… ▽ More Physical laws governing population dynamics are generally expressed as differential equations. Research in recent decades has incorporated fractional-order (non-integer) derivatives into differential models of natural phenomena, such as reaction-diffusion systems. In this paper, we develop a method to numerically solve a multi-component and multi-dimensional space-fractional system. For space discretization, we apply a Fourier spectral method that is suited for multidimensional PDE systems. Efficient approximation of time-stepping is accomplished with a locally one dimensional exponential time differencing approach. We show the effect of different fractional parameters on growth models and consider the convergence, stability, and uniqueness of solutions, as well as the biological interpretation of parameters and boundary conditions. △ Less

Submitted 6 December, 2022; originally announced December 2022.

Comments: 13 pages, 2 figures

Show Me Your Face, And I'll Tell You How You Speak

Authors: Christen Millerdurai, Lotfy Abdel Khaliq, Timon Ulrich

Abstract: When we speak, the prosody and content of the speech can be inferred from the movement of our lips. In this work, we explore the task of lip to speech synthesis, i.e., learning to generate speech given only the lip movements of a speaker where we focus on learning accurate lip to speech mappings for multiple speakers in unconstrained, large vocabulary settings. We capture the speaker's voice ident… ▽ More When we speak, the prosody and content of the speech can be inferred from the movement of our lips. In this work, we explore the task of lip to speech synthesis, i.e., learning to generate speech given only the lip movements of a speaker where we focus on learning accurate lip to speech mappings for multiple speakers in unconstrained, large vocabulary settings. We capture the speaker's voice identity through their facial characteristics, i.e., age, gender, ethnicity and condition them along with the lip movements to generate speaker identity aware speech. To this end, we present a novel method "Lip2Speech", with key design choices to achieve accurate lip to speech synthesis in unconstrained scenarios. We also perform various experiments and extensive evaluation using quantitative, qualitative metrics and human evaluation. △ Less

Submitted 28 June, 2022; originally announced June 2022.

Multi-variant COVID-19 model with heterogeneous transmission rates using deep neural networks

Authors: K. D. Olumoyin, A. Q. M. Khaliq, K. M. Furati

Abstract: Mutating variants of COVID-19 have been reported across many US states since 2021. In the fight against COVID-19, it has become imperative to study the heterogeneity in the time-varying transmission rates for each variant in the presence of pharmaceutical and non-pharmaceutical mitigation measures. We develop a Susceptible-Exposed-Infected-Recovered mathematical model to highlight the differences… ▽ More Mutating variants of COVID-19 have been reported across many US states since 2021. In the fight against COVID-19, it has become imperative to study the heterogeneity in the time-varying transmission rates for each variant in the presence of pharmaceutical and non-pharmaceutical mitigation measures. We develop a Susceptible-Exposed-Infected-Recovered mathematical model to highlight the differences in the transmission of the B.1.617.2 delta variant and the original SARS-CoV-2. Theoretical results for the well-posedness of the model are discussed. A Deep neural network is utilized and a deep learning algorithm is developed to learn the time-varying heterogeneous transmission rates for each variant. The accuracy of the algorithm for the model is shown using error metrics in the data-driven simulation for COVID-19 variants in the US states of Florida, Alabama, Tennessee, and Missouri. Short-term forecasting of daily cases is demonstrated using long short term memory neural network and an adaptive neuro-fuzzy inference system. △ Less

Submitted 13 May, 2022; originally announced May 2022.

Breaking the De-Pois Poisoning Defense

Authors: Alaa Anani, Mohamed Ghanem, Lotfy Abdel Khaliq

Abstract: Attacks on machine learning models have been, since their conception, a very persistent and evasive issue resembling an endless cat-and-mouse game. One major variant of such attacks is poisoning attacks which can indirectly manipulate an ML model. It has been observed over the years that the majority of proposed effective defense models are only effective when an attacker is not aware of them bein… ▽ More Attacks on machine learning models have been, since their conception, a very persistent and evasive issue resembling an endless cat-and-mouse game. One major variant of such attacks is poisoning attacks which can indirectly manipulate an ML model. It has been observed over the years that the majority of proposed effective defense models are only effective when an attacker is not aware of them being employed. In this paper, we show that the attack-agnostic De-Pois defense is hardly an exception to that rule. In fact, we demonstrate its vulnerability to the simplest White-Box and Black-Box attacks by an attacker that knows the structure of the De-Pois defense model. In essence, the De-Pois defense relies on a critic model that can be used to detect poisoned data before passing it to the target model. In our work, we break this poison-protection layer by replicating the critic model and then performing a composed gradient-sign attack on both the critic and target models simultaneously -- allowing us to bypass the critic firewall to poison the target model. △ Less

Submitted 3 April, 2022; originally announced April 2022.

MultiRes-NetVLAD: Augmenting Place Recognition Training with Low-Resolution Imagery

Authors: Ahmad Khaliq, Michael Milford, Sourav Garg

Abstract: Visual Place Recognition (VPR) is a crucial component of 6-DoF localization, visual SLAM and structure-from-motion pipelines, tasked to generate an initial list of place match hypotheses by matching global place descriptors. However, commonly-used CNN-based methods either process multiple image resolutions after training or use a single resolution and limit multi-scale feature extraction to the la… ▽ More Visual Place Recognition (VPR) is a crucial component of 6-DoF localization, visual SLAM and structure-from-motion pipelines, tasked to generate an initial list of place match hypotheses by matching global place descriptors. However, commonly-used CNN-based methods either process multiple image resolutions after training or use a single resolution and limit multi-scale feature extraction to the last convolutional layer during training. In this paper, we augment NetVLAD representation learning with low-resolution image pyramid encoding which leads to richer place representations. The resultant multi-resolution feature pyramid can be conveniently aggregated through VLAD into a single compact representation, avoiding the need for concatenation or summation of multiple patches in recent multi-scale approaches. Furthermore, we show that the underlying learnt feature tensor can be combined with existing multi-scale approaches to improve their baseline performance. Evaluation on 15 viewpoint-varying and viewpoint-consistent benchmarking datasets confirm that the proposed MultiRes-NetVLAD leads to state-of-the-art Recall@N performance for global descriptor based retrieval, compared against 11 existing techniques. Source code is publicly available at https://github.com/Ahmedest61/MultiRes-NetVLAD. △ Less

Submitted 18 February, 2022; originally announced February 2022.

Comments: 12 pages, 6 Figures, Accepted for publication in IEEE RA-L 2022 and ICRA 2022, includes supplementary material

Journal ref: IEEE Robotics and Automation Letters vol. 7 no. 2 (April 2022) pp. 3882-3889

Haptic Situational Awareness Using Continuous Vibrotactile Sensations

Authors: Muhammad Aakash Khaliq, Hammad Munawar, Qasim Ali

Abstract: In this research, we have developed a haptic situational awareness device that presents users with directional cues through continuous vibrotactile sensations. Using the device, we present user studies on the effectiveness of a torso-mounted haptic display in enhancing human situational awareness, when visual/auditory senses are degraded. A haptic display has been developed which generates continu… ▽ More In this research, we have developed a haptic situational awareness device that presents users with directional cues through continuous vibrotactile sensations. Using the device, we present user studies on the effectiveness of a torso-mounted haptic display in enhancing human situational awareness, when visual/auditory senses are degraded. A haptic display has been developed which generates continuous cues using tactile illusions and programmed to generate navigation commands. Participants are given navigation tasks where they may receive commands through any of the seven sensory modality combinations vibrotactile only, visual only, audio only, visual+vibrotactile, visual+audio, vibrotactile+audio and vibrotactile+audio+visual. Experimental results on human volunteers show that vibrotactile sensations enable enhanced situational awareness during sensory distraction as compared to visual-audio cues. This work is aimed at developing a viable haptic display for vehicle drivers, aircraft pilots and humans performing ground navigation, which can guide the wearer in situations when their visual/auditory senses may be degraded/overloaded. △ Less

Submitted 10 August, 2021; originally announced August 2021.

Comments: 18 Pages

Data-driven deep learning algorithms for time-varying infection rates of COVID-19 and mitigation measures

Authors: K. D. Olumoyin, A. Q. M. Khaliq, K. M. Furati

Abstract: Epidemiological models with constant parameters may not capture satisfactory infection patterns in the presence of pharmaceutical and non-pharmaceutical mitigation measures during a pandemic, since infectiousness is a function of time. In this paper, an Epidemiology-Informed Neural Network algorithm is introduced to learn the time-varying transmission rate for the COVID-19 pandemic in the presence… ▽ More Epidemiological models with constant parameters may not capture satisfactory infection patterns in the presence of pharmaceutical and non-pharmaceutical mitigation measures during a pandemic, since infectiousness is a function of time. In this paper, an Epidemiology-Informed Neural Network algorithm is introduced to learn the time-varying transmission rate for the COVID-19 pandemic in the presence of various mitigation scenarios. There are asymptomatic infectives, mostly unreported, and the proposed algorithm learns the proportion of the total infective individuals that are asymptomatic infectives. Using cumulative and daily reported cases of the symptomatic infectives, we simulate the impact of non-pharmaceutical mitigation measures such as early detection of infectives, contact tracing, and social distancing on the basic reproduction number. We demonstrate the effectiveness of vaccination on the transmission of COVID-19. The accuracy of the proposed algorithm is demonstrated using error metrics in the data-driven simulation for COVID-19 data of Italy, South Korea, the United Kingdom, and the United States. △ Less

Submitted 13 May, 2022; v1 submitted 5 April, 2021; originally announced April 2021.

Comments: Made changes to authors name, F.M. Furati to K.M. Furati

Domain-Adversarial Training of Self-Attention Based Networks for Land Cover Classification using Multi-temporal Sentinel-2 Satellite Imagery

Authors: Mauro Martini, Vittorio Mazzia, Aleem Khaliq, Marcello Chiaberge

Abstract: The increasing availability of large-scale remote sensing labeled data has prompted researchers to develop increasingly precise and accurate data-driven models for land cover and crop classification (LC&CC). Moreover, with the introduction of self-attention and introspection mechanisms, deep learning approaches have shown promising results in processing long temporal sequences in the multi-spectra… ▽ More The increasing availability of large-scale remote sensing labeled data has prompted researchers to develop increasingly precise and accurate data-driven models for land cover and crop classification (LC&CC). Moreover, with the introduction of self-attention and introspection mechanisms, deep learning approaches have shown promising results in processing long temporal sequences in the multi-spectral domain with a contained computational request. Nevertheless, most practical applications cannot rely on labeled data, and in the field, surveys are a time consuming solution that poses strict limitations to the number of collected samples. Moreover, atmospheric conditions and specific geographical region characteristics constitute a relevant domain gap that does not allow direct applicability of a trained model on the available dataset to the area of interest. In this paper, we investigate adversarial training of deep neural networks to bridge the domain discrepancy between distinct geographical zones. In particular, we perform a thorough analysis of domain adaptation applied to challenging multi-spectral, multi-temporal data, accurately highlighting the advantages of adapting state-of-the-art self-attention based models for LC&CC to different target zones where labeled data are not available. Extensive experimentation demonstrated significant performance and generalization gain in applying domain-adversarial training to source and target regions with marked dissimilarities between the distribution of extracted features. △ Less

Submitted 30 June, 2021; v1 submitted 1 April, 2021; originally announced April 2021.

Journal ref: Remote Sensing 13.13 (2021): 2564

Identification and prediction of time-varying parameters of COVID-19 model: a data-driven deep learning approach

Authors: Jie Long, Abdul Khaliq, Khaled Furati

Abstract: Data-driven deep learning provides efficient algorithms for parameter identification of epidemiology models. Unlike the constant parameters, the complexity of identifying time-varying parameters is largely increased. In this paper, a variant of physics-informed neural network (PINN) is adopted to identify the time-varying parameters of the Susceptible-Infectious-Recovered-Deceased model for the sp… ▽ More Data-driven deep learning provides efficient algorithms for parameter identification of epidemiology models. Unlike the constant parameters, the complexity of identifying time-varying parameters is largely increased. In this paper, a variant of physics-informed neural network (PINN) is adopted to identify the time-varying parameters of the Susceptible-Infectious-Recovered-Deceased model for the spread of COVID-19 by fitting daily reported cases. The learned parameters are verified by utilizing an ordinary differential equation solver to compute the corresponding solutions of this compartmental model. The effective reproduction number based on these parameters is calculated. Long Short-Term Memory (LSTM) neural network is employed to predict the future weekly time-varying parameters. The numerical simulations demonstrate that PINN combined with LSTM yields accurate and effective results. △ Less

Submitted 17 March, 2021; originally announced March 2021.

A Reliable Link-adaptive Position-based Routing Protocol for Flying Ad hoc Network

Authors: Qamar Usman, Omer Chughtai, Nadia Nawaz, Zeeshan Kaleem, Kishwer Abdul Khaliq, Long D. Nguyen

Abstract: Flying ad hoc network (FANET) provides portable and flexible communication for many applications and possesses several unique design challenges; a key one is the successful delivery of messages to the destination, reliably. For reliable communication, routing plays an important role, which establishes a path between source and destination on the basis of certain criteria. Conventional routing prot… ▽ More Flying ad hoc network (FANET) provides portable and flexible communication for many applications and possesses several unique design challenges; a key one is the successful delivery of messages to the destination, reliably. For reliable communication, routing plays an important role, which establishes a path between source and destination on the basis of certain criteria. Conventional routing protocols of FANET generally use a minimum hop count criterion to find the best route between source and destination, which results in lower latency with the consideration that there is single source/destination network environment. However, in a network with multiple sources, the minimum hop count routing criterion along with the 1-Hop HELLO messages broadcasted by each node in the network may deteriorate the network performance in terms of high End-to-End (ETE) delay and decrease in the lifetime of the network. This research work proposes a Reliable link-adaptive position-based routing protocol (RLPR) for FANET. It uses relative speed, signal strength, and energy of the nodes along with the geographic distance towards the destination using a forwarding angle. This angle is used to determine the forwarding zone that decreases the undesirable control messages in the network in order to discover the route. RLPR enhances the network performance by selecting those relay nodes which are in the forwarding zone and whose geographic movement is towards the destination. Additionally, RLPR selects the next hop with better energy level and uses signal strength and relative speed of the nodes to achieve high connectivity-level. Based on the performance evaluation performed in the Network simulator (ns-2.35), it has been analysed that RLPR outperforms the Robust and reliable predictive based routing (RARP) and Ad hoc on-demand distance vector (AODV) protocols in different scenarios. △ Less

Submitted 12 October, 2020; originally announced October 2020.

Comments: 17 pages, 16 figures

One-sided Shewhart control charts for monitoring the ratio of two normal variables in Short Production Runs

Authors: K. D. Tran, Q. U. A Khaliq, A. A. Nadi, H Tran, K. P. Tran

Abstract: Monitoring the ratio of two normal random variables plays an important role in several manufacturing environments. For short production runs, however, the control charts assumed infinite processes cannot function effectively to detect anomalies. In this paper, we tackle this problem by proposing two one-sided Shewhart-type charts to monitor the ratio of two normal random variables for an infinite… ▽ More Monitoring the ratio of two normal random variables plays an important role in several manufacturing environments. For short production runs, however, the control charts assumed infinite processes cannot function effectively to detect anomalies. In this paper, we tackle this problem by proposing two one-sided Shewhart-type charts to monitor the ratio of two normal random variables for an infinite horizon production. The statistical performance of the proposed charts is investigated using the truncated average run length as a performance measure in short production runs. In order to help the quality practitioner to implement these control charts, we have provided ready-to-use tables of the control limit parameters. An illustrative example from the food industry is given for illustration. △ Less

Submitted 3 October, 2020; originally announced October 2020.

MSC Class: 62P30

How Efficient is Contact Tracing in Mitigating the Spread of Covid-19? A Mathematical Modeling Approach

Authors: T. A. Biala, Y. O. Afolabi, A. Q. M. Khaliq

Abstract: Contact Tracing (CT) is one of the measures taken by government and health officials to mitigate the spread of the novel coronavirus. In this paper, we investigate its efficacy by developing a compartmental model for assessing its impact on mitigating the spread of the virus. We describe the impact on the reproduction number ${\mathcal{R}_0}$ of COVID-19. In particular, we discuss the importance a… ▽ More Contact Tracing (CT) is one of the measures taken by government and health officials to mitigate the spread of the novel coronavirus. In this paper, we investigate its efficacy by developing a compartmental model for assessing its impact on mitigating the spread of the virus. We describe the impact on the reproduction number ${\mathcal{R}_0}$ of COVID-19. In particular, we discuss the importance and relevance of parameters of the model such as the number of reported cases, effectiveness of tracking and monitoring policy, and the transmission rates to contact tracing. We describe the terms "perfect tracking", "perfect monitoring" and "perfect reporting" to indicate that traced contacts will be tracked while incubating, tracked contacts are efficiently monitored so that they do not cause secondary infections, and all infected persons are reported, respectively. We consider three special scenarios: (1) perfect monitoring and perfect tracking of contacts of a reported case, (2) perfect reporting of cases and perfect monitoring of tracked reported cases and (3) perfect reporting and perfect tracking of contacts of reported cases. Furthermore, we gave a lower bound on the proportion of contacts to be traced to ensure that the effective reproduction, ${\mathcal{R}_c}$, is below one and describe ${\mathcal{R}_c}$ in terms of observable quantities such as the proportion of reported and traced cases. Model simulations using the COVID-19 data obtained from John Hopkins University for some selected states in the US suggest that even late intervention of CT may reasonably reduce the transmission of COVID-19 and reduce peak hospitalizations and deaths. △ Less

Submitted 20 November, 2021; v1 submitted 9 August, 2020; originally announced August 2020.

Comments: 26 pages, 12 figures, 2 tables

A fractional-order compartmental model for predicting the spread of the Covid-19 pandemic

Authors: Toheeb A. Biala, Abdul Q. Khaliq

Abstract: We propose a time-fractional compartmental model (SEI$_A$I$_S$HRD) comprising of the susceptible, exposed, infected (asymptomatic and symptomatic), hospitalized, recovered and dead population for the Covid-19 pandemic. We study the properties and dynamics of the proposed model. The conditions under which the disease-free and endemic equilibrium points are asymptotically stable are discussed. Furth… ▽ More We propose a time-fractional compartmental model (SEI$_A$I$_S$HRD) comprising of the susceptible, exposed, infected (asymptomatic and symptomatic), hospitalized, recovered and dead population for the Covid-19 pandemic. We study the properties and dynamics of the proposed model. The conditions under which the disease-free and endemic equilibrium points are asymptotically stable are discussed. Furthermore, we study the sensitivity of the parameters and use the data from Tennessee state (as a case study) to discuss identifiability of the parameters of the model. The non-negative parameters in the model are obtained by solving inverse problems with empirical data from California, Florida, Georgia, Maryland, Tennessee, Texas, Washington and Wisconsin. The basic reproduction number is seen to be slightly above the critical value of one suggesting that stricter measures such as the use of face-masks, social distancing, contact tracing, and even longer stay-at-home orders need to be enforced in order to mitigate the spread of the virus. As stay-at-home orders are rescinded in some of these states, we see that the number of cases began to increase almost immediately and may continue to rise until the end of the year 2020 unless stricter measures are taken. △ Less

Submitted 14 February, 2021; v1 submitted 8 July, 2020; originally announced July 2020.

MSC Class: 65M05; 65M06

Multi-image Super Resolution of Remotely Sensed Images using Residual Feature Attention Deep Neural Networks

Authors: Francesco Salvetti, Vittorio Mazzia, Aleem Khaliq, Marcello Chiaberge

Abstract: Convolutional Neural Networks (CNNs) have been consistently proved state-of-the-art results in image Super-Resolution (SR), representing an exceptional opportunity for the remote sensing field to extract further information and knowledge from captured data. However, most of the works published in the literature have been focusing on the Single-Image Super-Resolution problem so far. At present, sat… ▽ More Convolutional Neural Networks (CNNs) have been consistently proved state-of-the-art results in image Super-Resolution (SR), representing an exceptional opportunity for the remote sensing field to extract further information and knowledge from captured data. However, most of the works published in the literature have been focusing on the Single-Image Super-Resolution problem so far. At present, satellite based remote sensing platforms offer huge data availability with high temporal resolution and low spatial resolution. In this context, the presented research proposes a novel residual attention model (RAMS) that efficiently tackles the multi-image super-resolution task, simultaneously exploiting spatial and temporal correlations to combine multiple images. We introduce the mechanism of visual feature attention with 3D convolutions in order to obtain an aware data fusion and information extraction of the multiple low-resolution images, transcending limitations of the local region of convolutional operations. Moreover, having multiple inputs with the same scene, our representation learning network makes extensive use of nestled residual connections to let flow redundant low-frequency signals and focus the computation on more important high-frequency components. Extensive experimentation and evaluations against other available solutions, either for single or multi-image super-resolution, have demonstrated that the proposed deep learning-based solution can be considered state-of-the-art for Multi-Image Super-Resolution for remote sensing applications. △ Less

Submitted 8 July, 2020; v1 submitted 6 July, 2020; originally announced July 2020.

Journal ref: Remote Sens. 2020, 12(14), 2207

UAV and Machine Learning Based Refinement of a Satellite-Driven Vegetation Index for Precision Agriculture

Authors: Vittorio Mazzia, Lorenzo Comba, Aleem Khaliq, Marcello Chiaberge, Paolo Gay

Abstract: Precision agriculture is considered to be a fundamental approach in pursuing a low-input, high-efficiency, and sustainable kind of agriculture when performing site-specific management practices. To achieve this objective, a reliable and updated description of the local status of crops is required. Remote sensing, and in particular satellite-based imagery, proved to be a valuable tool in crop mappi… ▽ More Precision agriculture is considered to be a fundamental approach in pursuing a low-input, high-efficiency, and sustainable kind of agriculture when performing site-specific management practices. To achieve this objective, a reliable and updated description of the local status of crops is required. Remote sensing, and in particular satellite-based imagery, proved to be a valuable tool in crop mapping, monitoring, and diseases assessment. However, freely available satellite imagery with low or moderate resolutions showed some limits in specific agricultural applications, e.g., where crops are grown by rows. Indeed, in this framework, the satellite's output could be biased by intra-row covering, giving inaccurate information about crop status. This paper presents a novel satellite imagery refinement framework, based on a deep learning technique which exploits information properly derived from high resolution images acquired by unmanned aerial vehicle (UAV) airborne multispectral sensors. To train the convolutional neural network, only a single UAV-driven dataset is required, making the proposed approach simple and cost-effective. A vineyard in Serralunga d'Alba (Northern Italy) was chosen as a case study for validation purposes. Refined satellite-driven normalized difference vegetation index (NDVI) maps, acquired in four different periods during the vine growing season, were shown to better describe crop status with respect to raw datasets by correlation analysis and ANOVA. In addition, using a K-means based classifier, 3-class vineyard vigor maps were profitably derived from the NDVI maps, which are a valuable tool for growers. △ Less

Submitted 29 April, 2020; originally announced April 2020.

Journal ref: Sensors 2020, 20(9), 2530

Real-Time Apple Detection System Using Embedded Systems With Hardware Accelerators: An Edge AI Application

Authors: Vittorio Mazzia, Francesco Salvetti, Aleem Khaliq, Marcello Chiaberge

Abstract: Real-time apple detection in orchards is one of the most effective ways of estimating apple yields, which helps in managing apple supplies more effectively. Traditional detection methods used highly computational machine learning algorithms with intensive hardware set up, which are not suitable for infield real-time apple detection due to their weight and power constraints. In this study, a real-t… ▽ More Real-time apple detection in orchards is one of the most effective ways of estimating apple yields, which helps in managing apple supplies more effectively. Traditional detection methods used highly computational machine learning algorithms with intensive hardware set up, which are not suitable for infield real-time apple detection due to their weight and power constraints. In this study, a real-time embedded solution inspired from "Edge AI" is proposed for apple detection with the implementation of YOLOv3-tiny algorithm on various embedded platforms such as Raspberry Pi 3 B+ in combination with Intel Movidius Neural Computing Stick (NCS), Nvidia's Jetson Nano and Jetson AGX Xavier. Data set for training were compiled using acquired images during field survey of apple orchard situated in the north region of Italy, and images used for testing were taken from widely used google data set by filtering out the images containing apples in different scenes to ensure the robustness of the algorithm. The proposed study adapts YOLOv3-tiny architecture to detect small objects. It shows the feasibility of deployment of the customized model on cheap and power-efficient embedded hardware without compromising mean average detection accuracy (83.64%) and achieved frame rate up to 30 fps even for the difficult scenarios such as overlapping apples, complex background, less exposure of apple due to leaves and branches. Furthermore, the proposed embedded solution can be deployed on the unmanned ground vehicles to detect, count, and measure the size of the apples in real-time to help the farmers and agronomists in their decision making and management skills. △ Less

Submitted 28 April, 2020; originally announced April 2020.

Journal ref: IEEE Access, vol. 8, pp. 9102-9114, 2020

Improvement in Land Cover and Crop Classification based on Temporal Features Learning from Sentinel-2 Data Using Recurrent-Convolutional Neural Network (R-CNN)

Authors: Vittorio Mazzia, Aleem Khaliq, Marcello Chiaberge

Abstract: The increasing spatial and temporal resolution of globally available satellite images, such as provided by Sentinel-2, creates new possibilities for researchers to use freely available multi-spectral optical images, with decametric spatial resolution and more frequent revisits for remote sensing applications such as land cover and crop classification (LC&CC), agricultural monitoring and management… ▽ More The increasing spatial and temporal resolution of globally available satellite images, such as provided by Sentinel-2, creates new possibilities for researchers to use freely available multi-spectral optical images, with decametric spatial resolution and more frequent revisits for remote sensing applications such as land cover and crop classification (LC&CC), agricultural monitoring and management, environment monitoring. Existing solutions dedicated to cropland mapping can be categorized based on per-pixel based and object-based. However, it is still challenging when more classes of agricultural crops are considered at a massive scale. In this paper, a novel and optimal deep learning model for pixel-based LC&CC is developed and implemented based on Recurrent Neural Networks (RNN) in combination with Convolutional Neural Networks (CNN) using multi-temporal sentinel-2 imagery of central north part of Italy, which has diverse agricultural system dominated by economic crop types. The proposed methodology is capable of automated feature extraction by learning time correlation of multiple images, which reduces manual feature engineering and modeling crop phenological stages. Fifteen classes, including major agricultural crops, were considered in this study. We also tested other widely used traditional machine learning algorithms for comparison such as support vector machine SVM, random forest (RF), Kernal SVM, and gradient boosting machine, also called XGBoost. The overall accuracy achieved by our proposed Pixel R-CNN was 96.5%, which showed considerable improvements in comparison with existing mainstream methods. This study showed that Pixel R-CNN based model offers a highly accurate way to assess and employ time-series data for multi-temporal classification tasks. △ Less

Submitted 5 May, 2020; v1 submitted 27 April, 2020; originally announced April 2020.

Journal ref: Appl. Sci. 2020, 10(1), 238

Highly Accurate Global Padé Approximations of Generalized Mittag-Leffler Function and its Inverse

Authors: Ibrahim O. Sarumi, Khaled M. Furati, Abdul Q. M. Khaliq

Abstract: The two-parametric Mittag-Leffler function (MLF), $E_{α,β}$, is fundamental to the study and simulation of fractional differential and integral equations. However, these functions are computationally expensive and their numerical implementations are challenging. In this paper, we present a unified framework for developing global rational approximants of $E_{α,β}(-x)$, $x>0$, with… ▽ More The two-parametric Mittag-Leffler function (MLF), $E_{α,β}$, is fundamental to the study and simulation of fractional differential and integral equations. However, these functions are computationally expensive and their numerical implementations are challenging. In this paper, we present a unified framework for developing global rational approximants of $E_{α,β}(-x)$, $x>0$, with $\{ (α,β): 0 < α\leq 1, β\geq α, (α,β) \ne (1,1) \}$. This framework is based on the series definition and the asymptotic expansion at infinity. In particular, we develop three types of fourth-order global rational approximations and discuss how they could be used to approximate the inverse function. Unlike existing approximations which are either limited to MLF of one parameter or of low accuracy for the two-parametric MLF, our rational approximants are of fourth order accuracy and have low percentage error globally. For efficient utilization, we study the partial fraction decomposition and use them to approximate the two-parametric MLF with a matrix argument which arise in the solutions of fractional evolution differential and integral equations. △ Less

Submitted 23 December, 2019; originally announced December 2019.

Comments: 25 pages

MSC Class: 33F05

CAMAL: Context-Aware Multi-layer Attention framework for Lightweight Environment Invariant Visual Place Recognition

Authors: Ahmad Khaliq, Shoaib Ehsan, Michael Milford, Klaus McDonald-Maier

Abstract: In the last few years, Deep Convolutional Neural Networks (D-CNNs) have shown state-of-the-art (SOTA) performance for Visual Place Recognition (VPR), a pivotal component of long-term intelligent robotic vision (vision-aware localization and navigation systems). The prestigious generalization power of D-CNNs gained upon training on large scale places datasets and learned persistent image regions wh… ▽ More In the last few years, Deep Convolutional Neural Networks (D-CNNs) have shown state-of-the-art (SOTA) performance for Visual Place Recognition (VPR), a pivotal component of long-term intelligent robotic vision (vision-aware localization and navigation systems). The prestigious generalization power of D-CNNs gained upon training on large scale places datasets and learned persistent image regions which are found to be robust for specific place recognition under changing conditions and camera viewpoints. However, against the computation and power intensive D-CNNs based VPR algorithms that are employed to determine the approximate location of resource-constrained mobile robots, lightweight VPR techniques are preferred. This paper presents a computation- and energy-efficient CAMAL framework that captures place-specific multi-layer convolutional attentions efficient for environment invariant-VPR. At 4x lesser power consumption, evaluating the proposed VPR framework on challenging benchmark place recognition datasets reveal better and comparable Area under Precision-Recall (AUC-PR) curves with approximately 4x improved image retrieval performance over the contemporary VPR methodologies. △ Less

Submitted 13 August, 2020; v1 submitted 17 September, 2019; originally announced September 2019.

Comments: under-review

FLAG: A Framework for FPGA-based LoAd Generation in Profinet Communication

Authors: Ahmad Khaliq, Sangeet Saha. Bina Bhatt, Dongbing Gu, Gareth Howells, Klaus McDonald-Maier

Abstract: Like other automated system technologies, PROFINET, a real-time Industrial Ethernet Standard has shown increasing level of integration into the present IT Infrastructure. Such vast use of PROFINET can expose the controllers and I/O devices to operate in critical failures when traffic goes unexpectedly higher than normal. Rigorous testing of the running devices then becomes essential and therefore,… ▽ More Like other automated system technologies, PROFINET, a real-time Industrial Ethernet Standard has shown increasing level of integration into the present IT Infrastructure. Such vast use of PROFINET can expose the controllers and I/O devices to operate in critical failures when traffic goes unexpectedly higher than normal. Rigorous testing of the running devices then becomes essential and therefore, in this paper, we prototype and design an FPGA based load Generating solution called FLAG (FPGA-based LoAd Generator) for PROFINET based traffic at the desired load configurations such as, bits per second, the number and size of the packets with their Ethertypes and MAC addresses. We have employed, a Zynq-7000 FPGA as our implementation platform for the proposed FLAG framework. The system can easily be deployed and accessed via the web or command line interface for successful load generation. Extensive experiments have been conducted to verify the effectiveness of our proposed solution and the results confirm that the proposed framework is capable to generate precise load at Fast/Gigabit line rate with a defined number of packets. △ Less

Submitted 9 September, 2019; originally announced September 2019.

Comments: Submitted at INAIT'19

Profi-Load: An FPGA-Based Solution for Generating Network Load in Profinet Communication

Authors: Ahmad Khaliq, Sangeet Saha, Bina Bhatt, Dongbing Gu, Klaus McDonald-Maier

Abstract: Industrial automation has received a considerable attention in the last few years with the rise of Internet of Things (IoT). Specifically, industrial communication network technology such as Profinet has proved to be a major game changer for such automation. However, industrial automation devices often have to exhibit robustness to dynamically changing network conditions and thus, demand a rigorou… ▽ More Industrial automation has received a considerable attention in the last few years with the rise of Internet of Things (IoT). Specifically, industrial communication network technology such as Profinet has proved to be a major game changer for such automation. However, industrial automation devices often have to exhibit robustness to dynamically changing network conditions and thus, demand a rigorous testing environment to avoid any safety-critical failures. Hence, in this paper, we have proposed an FPGA-based novel framework called Profi-Load to generate Profinet traffic with specific intensities for a specified duration of time. The proposed Profi-Load intends to facilitate the performance testing of the industrial automated devices under various network conditions. By using the advantage of inherent hardware parallelism and re-configurable features of FPGA, Profi-Load is able to generate Profinet traffic efficiently. Moreover, it can be reconfigured on the fly as per the specific requirements. We have developed our proposed Profi-Load framework by employing the Xilinx-based NetJury device which belongs to Zynq-7000 FPGA family. A series of experiments have been conducted to evaluate the effectiveness of Profi-Load and it has been observed that Profi-Load is able to generate precise load at a constant rate for stringent timing requirements. Furthermore, a suitable Human Machine Interface (HMI) has also been developed for quick access to our framework. The HMI at the client side can directly communicate with the NetJury device and parameters such as, required load amount, number of packet(s) to be sent or desired time duration can be selected using the HMI. △ Less

Submitted 30 July, 2019; v1 submitted 1 May, 2019; originally announced May 2019.

Comments: Accepted in IEEE SMC 2019 Industry 4.0

Are State-of-the-art Visual Place Recognition Techniques any Good for Aerial Robotics?

Authors: Mubariz Zaffar, Ahmad Khaliq, Shoaib Ehsan, Michael Milford, Kostas Alexis, Klaus McDonald-Maier

Abstract: Visual Place Recognition (VPR) has seen significant advances at the frontiers of matching performance and computational superiority over the past few years. However, these evaluations are performed for ground-based mobile platforms and cannot be generalized to aerial platforms. The degree of viewpoint variation experienced by aerial robots is complex, with their processing power and on-board memor… ▽ More Visual Place Recognition (VPR) has seen significant advances at the frontiers of matching performance and computational superiority over the past few years. However, these evaluations are performed for ground-based mobile platforms and cannot be generalized to aerial platforms. The degree of viewpoint variation experienced by aerial robots is complex, with their processing power and on-board memory limited by payload size and battery ratings. Therefore, in this paper, we collect $8$ state-of-the-art VPR techniques that have been previously evaluated for ground-based platforms and compare them on $2$ recently proposed aerial place recognition datasets with three prime focuses: a) Matching performance b) Processing power consumption c) Projected memory requirements. This gives a birds-eye view of the applicability of contemporary VPR research to aerial robotics and lays down the the nature of challenges for aerial-VPR. △ Less

Submitted 22 May, 2019; v1 submitted 16 April, 2019; originally announced April 2019.

Comments: IEEE ICRA 2019 Workshop on Aerial Robotics 8 pages, 7 figures

Levelling the Playing Field: A Comprehensive Comparison of Visual Place Recognition Approaches under Changing Conditions

Authors: Mubariz Zaffar, Ahmad Khaliq, Shoaib Ehsan, Michael Milford, Klaus McDonald-Maier

Abstract: In recent years there has been significant improvement in the capability of Visual Place Recognition (VPR) methods, building on the success of both hand-crafted and learnt visual features, temporal filtering and usage of semantic scene information. The wide range of approaches and the relatively recent growth in interest in the field has meant that a wide range of datasets and assessment methodolo… ▽ More In recent years there has been significant improvement in the capability of Visual Place Recognition (VPR) methods, building on the success of both hand-crafted and learnt visual features, temporal filtering and usage of semantic scene information. The wide range of approaches and the relatively recent growth in interest in the field has meant that a wide range of datasets and assessment methodologies have been proposed, often with a focus only on precision-recall type metrics, making comparison difficult. In this paper we present a comprehensive approach to evaluating the performance of 10 state-of-the-art recently-developed VPR techniques, which utilizes three standardized metrics: (a) Matching Performance b) Matching Time c) Memory Footprint. Together this analysis provides an up-to-date and widely encompassing snapshot of the various strengths and weaknesses of contemporary approaches to the VPR problem. The aim of this work is to help move this particular research field towards a more mature and unified approach to the problem, enabling better comparison and hence more progress to be made in future research. △ Less

Submitted 29 April, 2019; v1 submitted 21 March, 2019; originally announced March 2019.

Comments: ICRA 2019 Workshop on Database Generation and Benchmarking of SLAM Algorithms for Robotics and VR/AR

A Holistic Visual Place Recognition Approach using Lightweight CNNs for Significant ViewPoint and Appearance Changes

Authors: Ahmad Khaliq, Shoaib Ehsan, Zetao Chen, Michael Milford, Klaus McDonald-Maier

Abstract: This paper presents a lightweight visual place recognition approach, capable of achieving high performance with low computational cost, and feasible for mobile robotics under significant viewpoint and appearance changes. Results on several benchmark datasets confirm an average boost of 13% in accuracy, and 12x average speedup relative to state-of-the-art methods. This paper presents a lightweight visual place recognition approach, capable of achieving high performance with low computational cost, and feasible for mobile robotics under significant viewpoint and appearance changes. Results on several benchmark datasets confirm an average boost of 13% in accuracy, and 12x average speedup relative to state-of-the-art methods. △ Less

Submitted 27 October, 2019; v1 submitted 7 November, 2018; originally announced November 2018.

Comments: Conditionally Accepted as short paper at IEEE Transactions on Robotics (T-RO)

Slow-scale split-step tau-leap method for stiff stochastic chemical systems

Authors: Viktor Reshniak, Abdul Khaliq, David Voss

Abstract: Tau-leaping is a family of algorithms for the approximate simulation of the discrete state continuous time Markov chains. Motivation for the development of such methods can be found, for instance, in the fields of chemical kinetics and systems biology. It is known that the dynamical behavior of biochemical systems is often intrinsically stiff representing a serious challenge for their numerical ap… ▽ More Tau-leaping is a family of algorithms for the approximate simulation of the discrete state continuous time Markov chains. Motivation for the development of such methods can be found, for instance, in the fields of chemical kinetics and systems biology. It is known that the dynamical behavior of biochemical systems is often intrinsically stiff representing a serious challenge for their numerical approximation. The naive extension of stiff deterministic solvers to stochastic integration often yields numerical solutions with either impractically large relaxation times or incorrectly resolved covariance. In this paper, we propose a splitting heuristic which helps to resolve some of these issues. The proposed integrator contains a number of unknown parameters which are estimated for each particular problem from the moment equations of the corresponding linearized system. We show that this method is able to reproduce the exact mean and variance of the linear scalar test equation and demonstrates a good accuracy for the arbitrarily stiff systems at least in the linear case. The numerical examples for both linear and nonlinear systems are also provided and the obtained results confirm the efficiency of the considered splitting approach. △ Less

Submitted 18 December, 2018; v1 submitted 23 September, 2017; originally announced September 2017.

MSC Class: 65C40; 65C30; 92-08

Journal ref: Journal of Computational and Applied Mathematics 361 (2019)

Split-step Milstein methods for multi-channel stiff stochastic differential systems

Authors: V. Reshniak, A. Q. M. Khaliq, D. A. Voss, G. Zhang

Abstract: We consider split-step Milstein methods for the solution of stiff stochastic differential equations with an emphasis on systems driven by multi-channel noise. We show their strong order of convergence and investigate mean-square stability properties for different noise and drift structures. The stability matrices are established in a form convenient for analyzing their impact arising from differen… ▽ More We consider split-step Milstein methods for the solution of stiff stochastic differential equations with an emphasis on systems driven by multi-channel noise. We show their strong order of convergence and investigate mean-square stability properties for different noise and drift structures. The stability matrices are established in a form convenient for analyzing their impact arising from different deterministic drift integrators. Numerical examples are provided to illustrate the effectiveness and reliability of these methods. △ Less

Submitted 25 November, 2014; originally announced November 2014.

Comments: 31 pages, 38 figures

MSC Class: 65C30; 60H35; 93E15

Journal ref: Applied Numerical Mathematics 89 (2015) 1-23

Mobile node localization in cellular networks

Authors: Yasir Malik, Kishwer Abdul Khaliq, Bessam Abdulrazak, Usman Tariq

Abstract: Location information is the major component in location based applications. This information is used in different safety and service oriented applications to provide users with services according to their Geolocation. There are many approaches to locate mobile nodes in indoor and outdoor environments. In this paper, we are interested in outdoor localization particularly in cellular networks of mob… ▽ More Location information is the major component in location based applications. This information is used in different safety and service oriented applications to provide users with services according to their Geolocation. There are many approaches to locate mobile nodes in indoor and outdoor environments. In this paper, we are interested in outdoor localization particularly in cellular networks of mobile nodes and presented a localization method based on cell and user location information. Our localization method is based on hello message delay (sending and receiving time) and coordinate information of Base Transceiver Station (BTSs). To validate our method across cellular network, we implemented and simulated our method in two scenarios i.e. maintaining database of base stations in centralize and distributed system. Simulation results show the effectiveness of our approach and its implementation applicability in telecommunication systems. △ Less

Submitted 10 January, 2012; originally announced January 2012.

Comments: 10 Pages, 7 figures; ISSN:0975-3834 (Online); 0975-4679 (Print)

Journal ref: IJWMN Vol. 3, No. 6, December 2011 Pg-91-100