-
Matrix Pencil-Based DoA Estimation for Hybrid Receivers in Snapshot-Limited Scenarios
Authors:
Mona Mostafa,
Ramy H. Gohary,
Amr El-Keyi,
Yahia A. Eldemerdash Ahmed
Abstract:
The goal of this paper is to estimate the directions of arrival (DoAs) for hybrid analog/digital (HAD) receivers when the number of snapshots is too small for statistical averaging to be reliable. This goal is achieved in fully-digital receivers by employing the matrix pencil method (MPM). Unfortunately, the MPM cannot be directly applied in HAD receivers because of the entanglement induced by the…
▽ More
The goal of this paper is to estimate the directions of arrival (DoAs) for hybrid analog/digital (HAD) receivers when the number of snapshots is too small for statistical averaging to be reliable. This goal is achieved in fully-digital receivers by employing the matrix pencil method (MPM). Unfortunately, the MPM cannot be directly applied in HAD receivers because of the entanglement induced by the underlying analog combiners on the output signals. Furthermore, these analog combiners project the received signal onto a low-dimensional space, jeopardizing the reception of signals arriving from particular DoA ranges. To circumvent these difficulties, we propose two approaches to enable the MPM to extract the DoAs in HAD receivers. The two approaches avoid severe attenuation induced by low-dimensional projection by cycling over an exhaustive set of analog combiners, collectively spanning the entire space. The first approach can be applied to both fully-connected (FC) and partially-connected (PC) HADs and relies on the availability of periodic, potentially unknown, signals to disentangle the output of the HAD receiver. The second approach applies to PC-HADs only, and eliminates contingency on periodic signals by exploiting the underlying block diagonal structure. The superiority of the proposed approaches is demonstrated via numerical simulations and comparisons with the Cramér-Rao lower bound.
△ Less
Submitted 2 July, 2025;
originally announced July 2025.
-
End-to-end Training for Text-to-Image Synthesis using Dual-Text Embeddings
Authors:
Yeruru Asrar Ahmed,
Anurag Mittal
Abstract:
Text-to-Image (T2I) synthesis is a challenging task that requires modeling complex interactions between two modalities ( i.e., text and image). A common framework adopted in recent state-of-the-art approaches to achieving such multimodal interactions is to bootstrap the learning process with pre-trained image-aligned text embeddings trained using contrastive loss. Furthermore, these embeddings are…
▽ More
Text-to-Image (T2I) synthesis is a challenging task that requires modeling complex interactions between two modalities ( i.e., text and image). A common framework adopted in recent state-of-the-art approaches to achieving such multimodal interactions is to bootstrap the learning process with pre-trained image-aligned text embeddings trained using contrastive loss. Furthermore, these embeddings are typically trained generically and reused across various synthesis models. In contrast, we explore an approach to learning text embeddings specifically tailored to the T2I synthesis network, trained in an end-to-end fashion. Further, we combine generative and contrastive training and use two embeddings, one optimized to enhance the photo-realism of the generated images, and the other seeking to capture text-to-image alignment. A comprehensive set of experiments on three text-to-image benchmark datasets (Oxford-102, Caltech-UCSD, and MS-COCO) reveal that having two separate embeddings gives better results than using a shared one and that such an approach performs favourably in comparison with methods that use text representations from a pre-trained text encoder trained using a discriminative approach. Finally, we demonstrate that such learned embeddings can be used in other contexts as well, such as text-to-image manipulation.
△ Less
Submitted 3 February, 2025;
originally announced February 2025.
-
Power-Efficient Over-the-Air Aggregation with Receive Beamforming for Federated Learning
Authors:
Faeze Moradi Kalarde,
Min Dong,
Ben Liang,
Yahia A. Eldemerdash Ahmed,
Ho Ting Cheng
Abstract:
This paper studies power-efficient uplink transmission design for federated learning (FL) that employs over-the-air analog aggregation and multi-antenna beamforming at the server. We jointly optimize device transmit weights and receive beamforming at each FL communication round to minimize the total device transmit power while ensuring convergence in FL training. Through our convergence analysis,…
▽ More
This paper studies power-efficient uplink transmission design for federated learning (FL) that employs over-the-air analog aggregation and multi-antenna beamforming at the server. We jointly optimize device transmit weights and receive beamforming at each FL communication round to minimize the total device transmit power while ensuring convergence in FL training. Through our convergence analysis, we establish sufficient conditions on the aggregation error to guarantee FL training convergence. Utilizing these conditions, we reformulate the power minimization problem into a unique bi-convex structure that contains a transmit beamforming optimization subproblem and a receive beamforming feasibility subproblem. Despite this unconventional structure, we propose a novel alternating optimization approach that guarantees monotonic decrease of the objective value, to allow convergence to a partial optimum. We further consider imperfect channel state information (CSI), which requires accounting for the channel estimation errors in the power minimization problem and FL convergence analysis. We propose a CSI-error-aware joint beamforming algorithm, which can substantially outperform one that does not account for channel estimation errors. Simulation with canonical classification datasets demonstrates that our proposed methods achieve significant power reduction compared to existing benchmarks across a wide range of parameter settings, while attaining the same target accuracy under the same convergence rate.
△ Less
Submitted 29 January, 2025;
originally announced January 2025.
-
Beamforming and Device Selection Design in Federated Learning with Over-the-air Aggregation
Authors:
Faeze Moradi Kalarde,
Min Dong,
Ben Liang,
Yahia A. Eldemerdash Ahmed,
Ho Ting Cheng
Abstract:
Federated learning (FL) with over-the-air computation can efficiently utilize the communication bandwidth but is susceptible to analog aggregation error. Excluding those devices with weak channel conditions can reduce the aggregation error, but it also limits the amount of local training data for FL, which can reduce the training convergence rate. In this work, we jointly design uplink receiver be…
▽ More
Federated learning (FL) with over-the-air computation can efficiently utilize the communication bandwidth but is susceptible to analog aggregation error. Excluding those devices with weak channel conditions can reduce the aggregation error, but it also limits the amount of local training data for FL, which can reduce the training convergence rate. In this work, we jointly design uplink receiver beamforming and device selection for over-the-air FL over time-varying wireless channels to maximize the training convergence rate. We reformulate this stochastic optimization problem into a mixed-integer program using an upper bound on the global training loss over communication rounds. We then propose a Greedy Spatial Device Selection (GSDS) approach, which uses a sequential procedure to select devices based on a measure capturing both the channel strength and the channel correlation to the selected devices. We show that given the selected devices, the receiver beamforming optimization problem is equivalent to downlink single-group multicast beamforming. To reduce the computational complexity, we also propose an Alternating-optimization-based Device Selection and Beamforming (ADSBF) approach, which solves the receiver beamforming and device selection subproblems alternatingly. In particular, despite the device selection being an integer problem, we are able to develop an efficient algorithm to find its optimal solution.
Simulation results with real-world image classification demonstrate that our proposed methods achieve faster convergence with significantly lower computational complexity than existing alternatives. Furthermore, although ADSBF shows marginally inferior performance to GSDS, it offers the advantage of lower computational complexity when the number of devices is large.
△ Less
Submitted 6 March, 2024; v1 submitted 28 February, 2023;
originally announced February 2023.
-
Generalisability of fetal ultrasound deep learning models to low-resource imaging settings in five African countries
Authors:
Carla Sendra-Balcells,
Víctor M. Campello,
Jordina Torrents-Barrena,
Yahya Ali Ahmed,
Mustafa Elattar,
Benard Ohene Botwe,
Pempho Nyangulu,
William Stones,
Mohammed Ammar,
Lamya Nawal Benamer,
Harriet Nalubega Kisembo,
Senai Goitom Sereke,
Sikolia Z. Wanyonyi,
Marleen Temmerman,
Eduard Gratacós,
Elisenda Bonet,
Elisenda Eixarch,
Kamil Mikolaj,
Martin Grønnebæk Tolsgaard,
Karim Lekadir
Abstract:
Most artificial intelligence (AI) research have concentrated in high-income countries, where imaging data, IT infrastructures and clinical expertise are plentiful. However, slower progress has been made in limited-resource environments where medical imaging is needed. For example, in Sub-Saharan Africa the rate of perinatal mortality is very high due to limited access to antenatal screening. In th…
▽ More
Most artificial intelligence (AI) research have concentrated in high-income countries, where imaging data, IT infrastructures and clinical expertise are plentiful. However, slower progress has been made in limited-resource environments where medical imaging is needed. For example, in Sub-Saharan Africa the rate of perinatal mortality is very high due to limited access to antenatal screening. In these countries, AI models could be implemented to help clinicians acquire fetal ultrasound planes for diagnosis of fetal abnormalities. So far, deep learning models have been proposed to identify standard fetal planes, but there is no evidence of their ability to generalise in centres with limited access to high-end ultrasound equipment and data. This work investigates different strategies to reduce the domain-shift effect for a fetal plane classification model trained on a high-resource clinical centre and transferred to a new low-resource centre. To that end, a classifier trained with 1,792 patients from Spain is first evaluated on a new centre in Denmark in optimal conditions with 1,008 patients and is later optimised to reach the same performance in five African centres (Egypt, Algeria, Uganda, Ghana and Malawi) with 25 patients each. The results show that a transfer learning approach can be a solution to integrate small-size African samples with existing large-scale databases in developed countries. In particular, the model can be re-aligned and optimised to boost the performance on African populations by increasing the recall to $0.92\pm0.04$ and at the same time maintaining a high precision across centres. This framework shows promise for building new AI models generalisable across clinical centres with limited data acquired in challenging and heterogeneous conditions and calls for further research to develop new solutions for usability of AI in countries with less resources.
△ Less
Submitted 14 February, 2023; v1 submitted 20 September, 2022;
originally announced September 2022.
-
Evaluating Students Perspectives on ICT Readiness in Somali Higher Education towards Teaching -- Learning Acceptance
Authors:
Yunis Ali Ahmed,
Mohamed M. Mohamed,
Abdifatah Farah Ali,
Mohamud M. Alasso,
Ahmed Dahir Siyad Mohammad Nazir Ahmad
Abstract:
Along the rapid development of Information and communication technology (ICT) tools and growth of Internet access offer opportunities that facilitate teaching and learning activities in the context of higher education. However, the study of ICTs readiness and acceptance in Somalia higher education is meagre. This research aims to examine the current state of ICT readiness among university students…
▽ More
Along the rapid development of Information and communication technology (ICT) tools and growth of Internet access offer opportunities that facilitate teaching and learning activities in the context of higher education. However, the study of ICTs readiness and acceptance in Somalia higher education is meagre. This research aims to examine the current state of ICT readiness among university students and explores the factors that affect their readiness acceptance. It proposes an extended model, based on the Technology Acceptance Model (TAM), which explains how University students beliefs influence their readiness to accept ICT applications in their learning. Survey responses of 304 students from undergraduate and Graduate in Somalia higher education were collected and analyzed using structural equation modelling. The results of the data analysis demonstrated that the TAM explained university students readiness acceptance of ICT applications reasonably well. More specifically, perceived usefulness, Ease of Use, ICT Selfefficacy, Teaching-Learning autonomy, Students Optimism and Availability of ICT infrastructure are robust predictors of Students ICT readiness acceptance. Results also showed that internet affordability, network speed and quality, innovativeness, discomfort and insecurity do not have a meaningful effect on perceived usefulness and Ease of Use towards ICT readiness acceptance. Through the empirical results, this study helped us understand why students choose to engage in ICT applications for their learning context. Keywords: ICT readiness acceptance, Higher education,Teaching- Learning, Technology Acceptance Model
△ Less
Submitted 25 August, 2021;
originally announced August 2021.