Showing 1–36 of 36 results for author: Abid, A

DCSNet: A Lightweight Knowledge Distillation-Based Model with Explainable AI for Lung Cancer Diagnosis from Histopathological Images

Authors: Sadman Sakib Alif, Nasim Anzum Promise, Fiaz Al Abid, Aniqua Nusrat Zereen

Abstract: Lung cancer is a leading cause of cancer-related deaths globally, where early detection and accurate diagnosis are critical for improving survival rates. While deep learning, particularly convolutional neural networks (CNNs), has revolutionized medical image analysis by detecting subtle patterns indicative of early-stage lung cancer, its adoption faces challenges. These models are often computatio… ▽ More Lung cancer is a leading cause of cancer-related deaths globally, where early detection and accurate diagnosis are critical for improving survival rates. While deep learning, particularly convolutional neural networks (CNNs), has revolutionized medical image analysis by detecting subtle patterns indicative of early-stage lung cancer, its adoption faces challenges. These models are often computationally expensive and require significant resources, making them unsuitable for resource constrained environments. Additionally, their lack of transparency hinders trust and broader adoption in sensitive fields like healthcare. Knowledge distillation addresses these challenges by transferring knowledge from large, complex models (teachers) to smaller, lightweight models (students). We propose a knowledge distillation-based approach for lung cancer detection, incorporating explainable AI (XAI) techniques to enhance model transparency. Eight CNNs, including ResNet50, EfficientNetB0, EfficientNetB3, and VGG16, are evaluated as teacher models. We developed and trained a lightweight student model, Distilled Custom Student Network (DCSNet) using ResNet50 as the teacher. This approach not only ensures high diagnostic performance in resource-constrained settings but also addresses transparency concerns, facilitating the adoption of AI-driven diagnostic tools in healthcare. △ Less

Submitted 14 May, 2025; originally announced May 2025.

RCD-IoT: Enabling Industrial Monitoring and Control with Resource-Constrained Devices UnderHigh Packet Transmission Rates

Authors: Ayesha Abid, Muhammad Jazib, Muhammad Riaz

Abstract: This paper highlights the significance of resource-constrained Internet of Things (RCD-IoT) systems in addressing the challenges faced by industries with limited resources. This paper presents an energy-efficient solution for industries to monitor and control their utilities remotely. Integrating intelligent sensors and IoT technologies, the proposed RCD-IoT system aims to revolutionize industrial… ▽ More This paper highlights the significance of resource-constrained Internet of Things (RCD-IoT) systems in addressing the challenges faced by industries with limited resources. This paper presents an energy-efficient solution for industries to monitor and control their utilities remotely. Integrating intelligent sensors and IoT technologies, the proposed RCD-IoT system aims to revolutionize industrial monitoring and control processes, enabling efficient utilization of resources.The proposed system utilized the IEEE 802.15.4 WiFi Protocol for seamless data exchange between Sensor Nodes. This seamless exchange of information was analyzed through Packet Tracer. The system was equipped with a prototyped, depicting analytical chemical process to analyze the significant performance metrics. System achieved average Round trip time (RTT) of just 12ms outperforming the already existing solutions presented even with higher Quality of Service (QoS) under the transmission of 1500 packets/seconds under different line of sight (LOS) and Non line of sight (NLOS) fadings. △ Less

Submitted 14 January, 2025; originally announced January 2025.

Interatomic Coulombic decay in lithium-doped large helium nanodroplets induced by photoelectron impact excitation

Authors: L. Ben Ltaief, K. Sishodia, J. D. Asmussen, A. R. Abid, S. R. Krishnan, H. B. Pedersen, N. Sisourat, M. Mudrich

Abstract: Irradiation of condensed matter with ionizing radiation generally causes direct photoionization as well as secondary processes that often dominate the ionization dynamics. Here, large helium (He) nanodroplets with radius >40 nm doped with lithium (Li) atoms are irradiated with extreme ultraviolet (XUV) photons of energy >44.4 eV and indirect ionization of the Li dopants is observed in addition to… ▽ More Irradiation of condensed matter with ionizing radiation generally causes direct photoionization as well as secondary processes that often dominate the ionization dynamics. Here, large helium (He) nanodroplets with radius >40 nm doped with lithium (Li) atoms are irradiated with extreme ultraviolet (XUV) photons of energy >44.4 eV and indirect ionization of the Li dopants is observed in addition to direct photoionization of the He droplets. Specifically, Li ions are efficiently produced by an interatomic Coulombic decay (ICD) process involving metastable He atoms and He_2 excimers which are populated by elastic and inelastic scattering of photoelectrons in the nanodroplets as well as by electron-ion recombination. This type of indirect ICD, observed in large He nanodroplets in nearly the entire XUV range, turns out to be more efficient than Li dopant ionization by ICD following direct resonant photoexcitation at a photon energy of 21.6 eV and by charge-transfer ionization. Indirect ICD processes induced by scattering of photoelectrons likely play an important role in other condensed phase systems exposed to ionizing radiation as well, including biological matter. △ Less

Submitted 5 December, 2024; originally announced December 2024.

Fragmentation of Water Clusters Formed in Helium Nanodroplets by Charge Transfer and Penning Ionization

Authors: S. De, A. R. Abid, J. D. Asmussen, L. Ben Ltaief, K. Sishodia, A. Ulmer, H. B. Pedersen, S. R. Krishnan, M. Mudrich

Abstract: Helium nanodroplets ("HNDs") are widely used for forming tailor-made clusters and molecular complexes in a cold, transparent, and weakly-interacting matrix. Characterization of embedded species by mass spectrometry is often complicated by fragmentation and trapping of ions in the HNDs. Here, we systematically study fragment ion mass spectra of HND-aggregated water and oxygen clusters following the… ▽ More Helium nanodroplets ("HNDs") are widely used for forming tailor-made clusters and molecular complexes in a cold, transparent, and weakly-interacting matrix. Characterization of embedded species by mass spectrometry is often complicated by fragmentation and trapping of ions in the HNDs. Here, we systematically study fragment ion mass spectra of HND-aggregated water and oxygen clusters following their ionization by charge transfer ionization ("CTI") and Penning ionization ("PEI"). While the efficiency of PEI of embedded clusters is lower than for CTI by about factor 10, both the mean sizes of detected water clusters and the relative yields of unprotonated cluster ions are significantly larger, making PEI a ``soft ionization'' scheme. However, the tendency of ions to remain bound to HNDs leads to a reduced detection efficiency for large HNDs containing $>10^4$ helium atoms. These results are instrumental for determining optimal conditions for mass spectrometry and photoionization spectroscopy of molecular complexes and clusters aggregated in HNDs. △ Less

Submitted 12 January, 2024; originally announced January 2024.

Exploring Internet of Things Adoption Challenges in Manufacturing Firms: A Delphi Fuzzy Analytical Hierarchy Process Approach

Authors: Hasan Shahriar, Md. Saiful Islam, Md Abrar Jahin, Istiyaque Ahmed Ridoy, Raihan Rafi Prottoy, Adiba Abid, M. F. Mridha

Abstract: Innovation is crucial for sustainable success in today's fiercely competitive global manufacturing landscape. Bangladesh's manufacturing sector must embrace transformative technologies like the Internet of Things (IoT) to thrive in this environment. This article addresses the vital task of identifying and evaluating barriers to IoT adoption in Bangladesh's manufacturing industry. Through synthesiz… ▽ More Innovation is crucial for sustainable success in today's fiercely competitive global manufacturing landscape. Bangladesh's manufacturing sector must embrace transformative technologies like the Internet of Things (IoT) to thrive in this environment. This article addresses the vital task of identifying and evaluating barriers to IoT adoption in Bangladesh's manufacturing industry. Through synthesizing expert insights and carefully reviewing contemporary literature, we explore the intricate landscape of IoT adoption challenges. Our methodology combines the Delphi and Fuzzy Analytical Hierarchy Process, systematically analyzing and prioritizing these challenges. This approach harnesses expert knowledge and uses fuzzy logic to handle uncertainties. Our findings highlight key obstacles, with "Lack of top management commitment to new technology" (B10), "High initial implementation costs" (B9), and "Risks in adopting a new business model" (B7) standing out as significant challenges that demand immediate attention. These insights extend beyond academia, offering practical guidance to industry leaders. With the knowledge gained from this study, managers can develop tailored strategies, set informed priorities, and embark on a transformative journey toward leveraging IoT's potential in Bangladesh's industrial sector. This article provides a comprehensive understanding of IoT adoption challenges and equips industry leaders to navigate them effectively. This strategic navigation, in turn, enhances the competitiveness and sustainability of Bangladesh's manufacturing sector in the IoT era. △ Less

Submitted 9 October, 2024; v1 submitted 30 August, 2023; originally announced September 2023.

STG-MTL: Scalable Task Grouping for Multi-Task Learning Using Data Map

Authors: Ammar Sherif, Abubakar Abid, Mustafa Elattar, Mohamed ElHelw

Abstract: Multi-Task Learning (MTL) is a powerful technique that has gained popularity due to its performance improvement over traditional Single-Task Learning (STL). However, MTL is often challenging because there is an exponential number of possible task groupings, which can make it difficult to choose the best one because some groupings might produce performance degradation due to negative interference b… ▽ More Multi-Task Learning (MTL) is a powerful technique that has gained popularity due to its performance improvement over traditional Single-Task Learning (STL). However, MTL is often challenging because there is an exponential number of possible task groupings, which can make it difficult to choose the best one because some groupings might produce performance degradation due to negative interference between tasks. That is why existing solutions are severely suffering from scalability issues, limiting any practical application. In our paper, we propose a new data-driven method that addresses these challenges and provides a scalable and modular solution for classification task grouping based on a re-proposed data-driven features, Data Maps, which capture the training dynamics for each classification task during the MTL training. Through a theoretical comparison with other techniques, we manage to show that our approach has the superior scalability. Our experiments show a better performance and verify the method's effectiveness, even on an unprecedented number of tasks (up to 100 tasks on CIFAR100). Being the first to work on such number of tasks, our comparisons on the resulting grouping shows similar grouping to the mentioned in the dataset, CIFAR100. Finally, we provide a modular implementation for easier integration and testing, with examples from multiple datasets and tasks. △ Less

Submitted 26 May, 2024; v1 submitted 6 July, 2023; originally announced July 2023.

Comments: Accepted to DMLR workshop @ ICML 23

Secondary ionization of pyrimidine nucleobases and their microhydrated derivatives in helium nanodroplets

Authors: Jakob D. Asmussen, Abdul R. Abid, Akgash Sundaralingam, Björn Bastian, Keshav Sishodia, Subhendu De, Ltaief Ben Ltaief, Sivarama R. Krishnan, Henrik B. Pedersen, Marcel Mudrich

Abstract: Radiation damage in biological systems by ionizing radiation is predominantly caused by secondary processes such as charge and energy transfer leading to the breaking of bonds in DNA. Here, we study the fragmentation of cytosine (Cyt) and thymine (Thy) molecules, clusters and microhydrated derivatives induced by direct and indirect ionization initiated by extreme-ultraviolet (XUV) irradiation. Pho… ▽ More Radiation damage in biological systems by ionizing radiation is predominantly caused by secondary processes such as charge and energy transfer leading to the breaking of bonds in DNA. Here, we study the fragmentation of cytosine (Cyt) and thymine (Thy) molecules, clusters and microhydrated derivatives induced by direct and indirect ionization initiated by extreme-ultraviolet (XUV) irradiation. Photofragmentation mass spectra and photoelectron spectra of free Cyt and Thy molecules are compared with mass and electron spectra of Cyt/Thy clusters and microhydrated Cyt/Thy molecules formed by aggregation in superfluid helium (He) nanodroplets. Penning ionization after resonant excitation of the He droplets is generally found to cause less fragmentation compared to direct photoionization and charge-transfer ionization after photoionization of the He droplets. When Cyt/Thy molecules and oligomers are complexed with water molecules, their fragmentation is efficiently suppressed. However, a similar suppression of fragmentation is observed when homogeneous Cyt/Thy clusters are formed in He nanodroplets, indicating a general trend. Penning ionization electron spectra (PIES) of Cyt/Thy are broad and nearly featureless but PIES of their microhydrated derivatives point at a sequential ionization process ending in unfragmented microsolvated Cyt/Thy cations. △ Less

Submitted 21 June, 2023; originally announced June 2023.

Comments: 9 pages, 8 figures

Dopant ionization and efficiency of ion and electron ejection from helium nanodroplets

Authors: Jakob D. Asmussen, Ltaief Ben Ltaief, Keshav Sishodia, Abdul R. Abid, Björn Bastian, Sivarama Krishnan, Henrik B. Pedersen, Marcel Mudrich

Abstract: Photoionization spectroscopy and mass spectrometry of doped helium (He) nanodroplets rely on the ability to efficiently detect ions and/or electrons. Using a commercial quadrupole mass spectrometer and a photoelectron-photoion coincidence (PEPICO) spectrometer, we systematically measure yields of ions and electrons created in pure and doped He nanodroplets in a wide size range and in two ionizatio… ▽ More Photoionization spectroscopy and mass spectrometry of doped helium (He) nanodroplets rely on the ability to efficiently detect ions and/or electrons. Using a commercial quadrupole mass spectrometer and a photoelectron-photoion coincidence (PEPICO) spectrometer, we systematically measure yields of ions and electrons created in pure and doped He nanodroplets in a wide size range and in two ionization regimes -- direct ionization and secondary ionization after resonant photoexcitation of the droplets. For two different types of dopants (oxygen molecules, O$_2$, and lithium atoms, Li), we infer the optimal droplet size to maximize the yield of ejected ions. When dopants are ionized by charge-transfer to photoionized He nanodroplets, the highest yield of O$_2$ and Li ions is detected for a mean size of $\sim5\times10^4$ He atoms per nanodroplet. When dopants are Penning ionized via photoexcitation of the He droplets, the highest yield of O$_2$ and Li ions is detected for $\sim10^3$ and $\sim10^5$ He atoms per droplet, respectively. At optimum droplet sizes, the detection efficiency of dopant ions in proportion to the number of primary photoabsorption events is up to 20\,\% for charge-transfer ionization of O$_2$ and 2\,\% for Li, whereas for Penning ionization it is 1\,\% for O$_2$ and 4\,\% for Li. Our results are instrumental in determining optimal conditions for mass spectrometric studies and photoionization spectroscopy of molecules and complexes isolated in He nanodroplets. △ Less

Submitted 31 May, 2023; originally announced May 2023.

Electron energy loss and angular asymmetry induced by elastic scattering in helium droplets

Authors: Jakob D. Asmussen, Keshav Sishodia, Björn Bastian, Abdul R. Abid, Ltaief Ben Ltaief, Henrik B. Pedersen, Subhendu De, Christian Medina, Nitish Pal, Robert Richter, Thomas Fennel, Sivarama Krishnan, Marcel Mudrich

Abstract: Helium nanodroplets are ideal model systems to unravel the complex interaction of condensed matter with ionizing radiation. Here we study the effect of purely elastic electron scattering on angular and energy distributions of photoelectrons emitted from He nanodroplets of variable size ($10$-$10^9$ atoms per droplets). For large droplets, photoelectrons develop a pronounced anisotropy along the in… ▽ More Helium nanodroplets are ideal model systems to unravel the complex interaction of condensed matter with ionizing radiation. Here we study the effect of purely elastic electron scattering on angular and energy distributions of photoelectrons emitted from He nanodroplets of variable size ($10$-$10^9$ atoms per droplets). For large droplets, photoelectrons develop a pronounced anisotropy along the incident light beam due to a shadowing effect within the droplets. In contrast, the detected photoelectron spectra are only weakly perturbed. This opens up possibilities for photoelectron spectroscopy of dopants embedded in droplets provided they are smaller than the penetration depth of the light and the trapping range of emitted electrons. △ Less

Submitted 9 May, 2023; originally announced May 2023.

AfroDigits: A Community-Driven Spoken Digit Dataset for African Languages

Authors: Chris Chinenye Emezue, Sanchit Gandhi, Lewis Tunstall, Abubakar Abid, Josh Meyer, Quentin Lhoest, Pete Allen, Patrick Von Platen, Douwe Kiela, Yacine Jernite, Julien Chaumond, Merve Noyan, Omar Sanseviero

Abstract: The advancement of speech technologies has been remarkable, yet its integration with African languages remains limited due to the scarcity of African speech corpora. To address this issue, we present AfroDigits, a minimalist, community-driven dataset of spoken digits for African languages, currently covering 38 African languages. As a demonstration of the practical applications of AfroDigits, we c… ▽ More The advancement of speech technologies has been remarkable, yet its integration with African languages remains limited due to the scarcity of African speech corpora. To address this issue, we present AfroDigits, a minimalist, community-driven dataset of spoken digits for African languages, currently covering 38 African languages. As a demonstration of the practical applications of AfroDigits, we conduct audio digit classification experiments on six African languages [Igbo (ibo), Yoruba (yor), Rundi (run), Oshiwambo (kua), Shona (sna), and Oromo (gax)] using the Wav2Vec2.0-Large and XLS-R models. Our experiments reveal a useful insight on the effect of mixing African speech corpora during finetuning. AfroDigits is the first published audio digit dataset for African languages and we believe it will, among other things, pave the way for Afro-centric speech applications such as the recognition of telephone numbers, and street numbers. We release the dataset and platform publicly at https://huggingface.co/datasets/chrisjay/crowd-speech-africa and https://huggingface.co/spaces/chrisjay/afro-speech respectively. △ Less

Submitted 3 April, 2023; v1 submitted 22 March, 2023; originally announced March 2023.

Comments: Accepted to the AfricaNLP Workshop at ICLR 2023

Development and Clinical Evaluation of an AI Support Tool for Improving Telemedicine Photo Quality

Authors: Kailas Vodrahalli, Justin Ko, Albert S. Chiou, Roberto Novoa, Abubakar Abid, Michelle Phung, Kiana Yekrang, Paige Petrone, James Zou, Roxana Daneshjou

Abstract: Telemedicine utilization was accelerated during the COVID-19 pandemic, and skin conditions were a common use case. However, the quality of photographs sent by patients remains a major limitation. To address this issue, we developed TrueImage 2.0, an artificial intelligence (AI) model for assessing patient photo quality for telemedicine and providing real-time feedback to patients for photo quality… ▽ More Telemedicine utilization was accelerated during the COVID-19 pandemic, and skin conditions were a common use case. However, the quality of photographs sent by patients remains a major limitation. To address this issue, we developed TrueImage 2.0, an artificial intelligence (AI) model for assessing patient photo quality for telemedicine and providing real-time feedback to patients for photo quality improvement. TrueImage 2.0 was trained on 1700 telemedicine images annotated by clinicians for photo quality. On a retrospective dataset of 357 telemedicine images, TrueImage 2.0 effectively identified poor quality images (Receiver operator curve area under the curve (ROC-AUC) =0.78) and the reason for poor quality (Blurry ROC-AUC=0.84, Lighting issues ROC-AUC=0.70). The performance is consistent across age, gender, and skin tone. Next, we assessed whether patient-TrueImage 2.0 interaction led to an improvement in submitted photo quality through a prospective clinical pilot study with 98 patients. TrueImage 2.0 reduced the number of patients with a poor-quality image by 68.0%. △ Less

Submitted 12 September, 2022; originally announced September 2022.

Comments: 24 pages, 7 figures

Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models

Authors: Aarohi Srivastava, Abhinav Rastogi, Abhishek Rao, Abu Awal Md Shoeb, Abubakar Abid, Adam Fisch, Adam R. Brown, Adam Santoro, Aditya Gupta, Adrià Garriga-Alonso, Agnieszka Kluska, Aitor Lewkowycz, Akshat Agarwal, Alethea Power, Alex Ray, Alex Warstadt, Alexander W. Kocurek, Ali Safaya, Ali Tazarv, Alice Xiang, Alicia Parrish, Allen Nie, Aman Hussain, Amanda Askell, Amanda Dsouza , et al. (426 additional authors not shown)

Abstract: Language models demonstrate both quantitative improvement and new qualitative capabilities with increasing scale. Despite their potentially transformative impact, these new capabilities are as yet poorly characterized. In order to inform future research, prepare for disruptive new model capabilities, and ameliorate socially harmful effects, it is vital that we understand the present and near-futur… ▽ More Language models demonstrate both quantitative improvement and new qualitative capabilities with increasing scale. Despite their potentially transformative impact, these new capabilities are as yet poorly characterized. In order to inform future research, prepare for disruptive new model capabilities, and ameliorate socially harmful effects, it is vital that we understand the present and near-future capabilities and limitations of language models. To address this challenge, we introduce the Beyond the Imitation Game benchmark (BIG-bench). BIG-bench currently consists of 204 tasks, contributed by 450 authors across 132 institutions. Task topics are diverse, drawing problems from linguistics, childhood development, math, common-sense reasoning, biology, physics, social bias, software development, and beyond. BIG-bench focuses on tasks that are believed to be beyond the capabilities of current language models. We evaluate the behavior of OpenAI's GPT models, Google-internal dense transformer architectures, and Switch-style sparse transformers on BIG-bench, across model sizes spanning millions to hundreds of billions of parameters. In addition, a team of human expert raters performed all tasks in order to provide a strong baseline. Findings include: model performance and calibration both improve with scale, but are poor in absolute terms (and when compared with rater performance); performance is remarkably similar across model classes, though with benefits from sparsity; tasks that improve gradually and predictably commonly involve a large knowledge or memorization component, whereas tasks that exhibit "breakthrough" behavior at a critical scale often involve multiple steps or components, or brittle metrics; social bias typically increases with scale in settings with ambiguous context, but this can be improved with prompting. △ Less

Submitted 12 June, 2023; v1 submitted 9 June, 2022; originally announced June 2022.

Comments: 27 pages, 17 figures + references and appendices, repo: https://github.com/google/BIG-bench

Journal ref: Transactions on Machine Learning Research, May/2022, https://openreview.net/forum?id=uyTL5Bvosj

Clustering Plotted Data by Image Segmentation

Authors: Tarek Naous, Srinjay Sarkar, Abubakar Abid, James Zou

Abstract: Clustering algorithms are one of the main analytical methods to detect patterns in unlabeled data. Existing clustering methods typically treat samples in a dataset as points in a metric space and compute distances to group together similar points. In this paper, we present a wholly different way of clustering points in 2-dimensional space, inspired by how humans cluster data: by training neural ne… ▽ More Clustering algorithms are one of the main analytical methods to detect patterns in unlabeled data. Existing clustering methods typically treat samples in a dataset as points in a metric space and compute distances to group together similar points. In this paper, we present a wholly different way of clustering points in 2-dimensional space, inspired by how humans cluster data: by training neural networks to perform instance segmentation on plotted data. Our approach, Visual Clustering, has several advantages over traditional clustering algorithms: it is much faster than most existing clustering algorithms (making it suitable for very large datasets), it agrees strongly with human intuition for clusters, and it is by default hyperparameter free (although additional steps with hyperparameters can be introduced for more control of the algorithm). We describe the method and compare it to ten other clustering methods on synthetic data to illustrate its advantages and disadvantages. We then demonstrate how our approach can be extended to higher dimensional data and illustrate its performance on real-world data. The implementation of Visual Clustering is publicly available and can be applied to any dataset in a few lines of code. △ Less

Submitted 6 October, 2021; originally announced October 2021.

Image-to-Image Translation with Low Resolution Conditioning

Authors: Mohamed Abderrahmen Abid, Ihsen Hedhli, Jean-François Lalonde, Christian Gagne

Abstract: Most image-to-image translation methods focus on learning mappings across domains with the assumption that images share content (e.g., pose) but have their own domain-specific information known as style. When conditioned on a target image, such methods aim to extract the style of the target and combine it with the content of the source image. In this work, we consider the scenario where the target… ▽ More Most image-to-image translation methods focus on learning mappings across domains with the assumption that images share content (e.g., pose) but have their own domain-specific information known as style. When conditioned on a target image, such methods aim to extract the style of the target and combine it with the content of the source image. In this work, we consider the scenario where the target image has a very low resolution. More specifically, our approach aims at transferring fine details from a high resolution (HR) source image to fit a coarse, low resolution (LR) image representation of the target. We therefore generate HR images that share features from both HR and LR inputs. This differs from previous methods that focus on translating a given image style into a target content, our translation approach being able to simultaneously imitate the style and merge the structural information of the LR target. Our approach relies on training the generative model to produce HR target images that both 1) share distinctive information of the associated source image; 2) correctly match the LR target image when downscaled. We validate our method on the CelebA-HQ and AFHQ datasets by demonstrating improvements in terms of visual quality, diversity and coverage. Qualitative and quantitative results show that when dealing with intra-domain image translation, our method generates more realistic samples compared to state-of-the-art methods such as Stargan-v2 △ Less

Submitted 23 July, 2021; originally announced July 2021.

Realistic Inflation in No-Scale $U(1)_R$ Symmetric Flipped $SU(5)$

Authors: Mian Muhammad Azeem Abid, Maria Mehmood, Mansoor Ur Rehman, Qaisar Shafi

Abstract: We have realized non-minimal Higgs inflation and standard hybrid inflation in the supersymmetric flipped $SU(5)$ model with $U(1)_R$ symmetry using the no-scale form of the Kähler potential. In non-minimal Higgs inflation the waterfall Higgs field plays the role of inflaton, and in standard hybrid inflation the gauge singlet field $S$ is employed as an inflaton. The predictions of both models are… ▽ More We have realized non-minimal Higgs inflation and standard hybrid inflation in the supersymmetric flipped $SU(5)$ model with $U(1)_R$ symmetry using the no-scale form of the Kähler potential. In non-minimal Higgs inflation the waterfall Higgs field plays the role of inflaton, and in standard hybrid inflation the gauge singlet field $S$ is employed as an inflaton. The predictions of both models are in good agreement with the Planck 2018 data. For numerical calculations we have fixed the gauge symmetry breaking scale, $M$, around $2\times 10^{16}$ GeV. In both models the inflaton field values are constrained below $m_P$. The tensor to scalar ratio $r$ in non-minimal inflation is of the order of $10^{-3}$ and for standard hybrid inflation $r$ is tiny, of order $10^{-15} - 10^{-4}$. The scalar spectral index in both cases lie within the Planck 1-$σ$ bounds, and the running of the scalar spectral index lies in the range, $-dn_s/d\ln k \sim 6\times 10^{-4}$ for non-minimal model and $10^{-9} - 10^{-3}$ for the standard hybrid model. A realistic scenario of reheating and non-thermal leptogenesis is employed with reheat temperature $T_r \sim 10^9$ GeV for non-minimal model and $10^{6} - 10^{10}$~GeV for standard hybrid model. The $R$-symmetry plays a vital role in forbidding rapid proton decay, but at the same time it also suppresses terms responsible for generating right handed neutrino masses. A realistic scenario of right handed neutrino masses is obtained by considering effective $R$ symmetry breaking at the nonrenormalizable level with adequate suppression of rapid proton decay. △ Less

Submitted 11 October, 2021; v1 submitted 12 July, 2021; originally announced July 2021.

Comments: 26 pages, 10 figures, matches with the published version

Journal ref: JCAP 10(2021)015

Meaningfully Debugging Model Mistakes using Conceptual Counterfactual Explanations

Authors: Abubakar Abid, Mert Yuksekgonul, James Zou

Abstract: Understanding and explaining the mistakes made by trained models is critical to many machine learning objectives, such as improving robustness, addressing concept drift, and mitigating biases. However, this is often an ad hoc process that involves manually looking at the model's mistakes on many test samples and guessing at the underlying reasons for those incorrect predictions. In this paper, we… ▽ More Understanding and explaining the mistakes made by trained models is critical to many machine learning objectives, such as improving robustness, addressing concept drift, and mitigating biases. However, this is often an ad hoc process that involves manually looking at the model's mistakes on many test samples and guessing at the underlying reasons for those incorrect predictions. In this paper, we propose a systematic approach, conceptual counterfactual explanations (CCE), that explains why a classifier makes a mistake on a particular test sample(s) in terms of human-understandable concepts (e.g. this zebra is misclassified as a dog because of faint stripes). We base CCE on two prior ideas: counterfactual explanations and concept activation vectors, and validate our approach on well-known pretrained models, showing that it explains the models' mistakes meaningfully. In addition, for new models trained on data with spurious correlations, CCE accurately identifies the spurious correlation as the cause of model mistakes from a single misclassified test sample. On two challenging medical applications, CCE generated useful insights, confirmed by clinicians, into biases and mistakes the model makes in real-world settings. △ Less

Submitted 14 June, 2022; v1 submitted 23 June, 2021; originally announced June 2021.

Comments: ICML 2022

A Generative Model for Hallucinating Diverse Versions of Super Resolution Images

Authors: Mohamed Abderrahmen Abid, Ihsen Hedhli, Christian Gagné

Abstract: Traditionally, the main focus of image super-resolution techniques is on recovering the most likely high-quality images from low-quality images, using a one-to-one low- to high-resolution mapping. Proceeding that way, we ignore the fact that there are generally many valid versions of high-resolution images that map to a given low-resolution image. We are tackling in this work the problem of obtain… ▽ More Traditionally, the main focus of image super-resolution techniques is on recovering the most likely high-quality images from low-quality images, using a one-to-one low- to high-resolution mapping. Proceeding that way, we ignore the fact that there are generally many valid versions of high-resolution images that map to a given low-resolution image. We are tackling in this work the problem of obtaining different high-resolution versions from the same low-resolution image using Generative Adversarial Models. Our learning approach makes use of high frequencies available in the training high-resolution images for preserving and exploring in an unsupervised manner the structural information available within these images. Experimental results on the CelebA dataset confirm the effectiveness of the proposed method, which allows the generation of both realistic and diverse high-resolution images from low-resolution images. △ Less

Submitted 12 February, 2021; originally announced February 2021.

Persistent Anti-Muslim Bias in Large Language Models

Authors: Abubakar Abid, Maheen Farooqi, James Zou

Abstract: It has been observed that large-scale language models capture undesirable societal biases, e.g. relating to race and gender; yet religious bias has been relatively unexplored. We demonstrate that GPT-3, a state-of-the-art contextual language model, captures persistent Muslim-violence bias. We probe GPT-3 in various ways, including prompt completion, analogical reasoning, and story generation, to u… ▽ More It has been observed that large-scale language models capture undesirable societal biases, e.g. relating to race and gender; yet religious bias has been relatively unexplored. We demonstrate that GPT-3, a state-of-the-art contextual language model, captures persistent Muslim-violence bias. We probe GPT-3 in various ways, including prompt completion, analogical reasoning, and story generation, to understand this anti-Muslim bias, demonstrating that it appears consistently and creatively in different uses of the model and that it is severe even compared to biases about other religious groups. For instance, "Muslim" is analogized to "terrorist" in 23% of test cases, while "Jewish" is mapped to "money" in 5% of test cases. We quantify the positive distraction needed to overcome this bias with adversarial text prompts, and find that use of the most positive 6 adjectives reduces violent completions for "Muslims" from 66% to 20%, but which is still higher than for other religious groups. △ Less

Submitted 18 January, 2021; v1 submitted 14 January, 2021; originally announced January 2021.

Deep Learning Based Classification of Unsegmented Phonocardiogram Spectrograms Leveraging Transfer Learning

Authors: Kaleem Nawaz Khan, Faiq Ahmad Khan, Anam Abid, Tamer Olmez, Zumray Dokur, Amith Khandakar, Muhammad E. H. Chowdhury, Muhammad Salman Khan

Abstract: Cardiovascular diseases (CVDs) are the main cause of deaths all over the world. Heart murmurs are the most common abnormalities detected during the auscultation process. The two widely used publicly available phonocardiogram (PCG) datasets are from the PhysioNet/CinC (2016) and PASCAL (2011) challenges. The datasets are significantly different in terms of the tools used for data acquisition, clini… ▽ More Cardiovascular diseases (CVDs) are the main cause of deaths all over the world. Heart murmurs are the most common abnormalities detected during the auscultation process. The two widely used publicly available phonocardiogram (PCG) datasets are from the PhysioNet/CinC (2016) and PASCAL (2011) challenges. The datasets are significantly different in terms of the tools used for data acquisition, clinical protocols, digital storages and signal qualities, making it challenging to process and analyze. In this work, we have used short-time Fourier transform (STFT) based spectrograms to learn the representative patterns of the normal and abnormal PCG signals. Spectrograms generated from both the datasets are utilized to perform three different studies: (i) train, validate and test different variants of convolutional neural network (CNN) models with PhysioNet dataset, (ii) train, validate and test the best performing CNN structure on combined PhysioNet-PASCAL dataset and (iii) finally, transfer learning technique is employed to train the best performing pre-trained network from the first study with PASCAL dataset. We propose a novel, less complex and relatively light custom CNN model for the classification of PhysioNet, combined and PASCAL datasets. The first study achieves an accuracy, sensitivity, specificity, precision and F1 score of 95.4%, 96.3%, 92.4%, 97.6% and 96.98% respectively while the second study shows accuracy, sensitivity, specificity, precision and F1 score of 94.2%, 95.5%, 90.3%, 96.8% and 96.1% respectively. Finally, the third study shows a precision of 98.29% on the noisy PASCAL dataset with transfer learning approach. All the three proposed approaches outperform most of the recent competing studies by achieving comparatively high classification accuracy and precision, which make them suitable for screening CVDs using PCG signals. △ Less

Submitted 19 April, 2021; v1 submitted 15 December, 2020; originally announced December 2020.

MolDesigner: Interactive Design of Efficacious Drugs with Deep Learning

Authors: Kexin Huang, Tianfan Fu, Dawood Khan, Ali Abid, Ali Abdalla, Abubakar Abid, Lucas M. Glass, Marinka Zitnik, Cao Xiao, Jimeng Sun

Abstract: The efficacy of a drug depends on its binding affinity to the therapeutic target and pharmacokinetics. Deep learning (DL) has demonstrated remarkable progress in predicting drug efficacy. We develop MolDesigner, a human-in-the-loop web user-interface (UI), to assist drug developers leverage DL predictions to design more effective drugs. A developer can draw a drug molecule in the interface. In the… ▽ More The efficacy of a drug depends on its binding affinity to the therapeutic target and pharmacokinetics. Deep learning (DL) has demonstrated remarkable progress in predicting drug efficacy. We develop MolDesigner, a human-in-the-loop web user-interface (UI), to assist drug developers leverage DL predictions to design more effective drugs. A developer can draw a drug molecule in the interface. In the backend, more than 17 state-of-the-art DL models generate predictions on important indices that are crucial for a drug's efficacy. Based on these predictions, drug developers can edit the drug molecule and reiterate until satisfaction. MolDesigner can make predictions in real-time with a latency of less than a second. △ Less

Submitted 5 October, 2020; originally announced October 2020.

Comments: NeurIPS 2020 Demonstration Track

Creating topological polar structure in a nonpolar matter

Authors: Adeel Y. Abid, Yuanwei Sun, Xu Hou, Xiangli Zhong, Congbing Tan, Ruixue Zhu, Haoyun Chen, Ke Qu, Yuehui Li, Mei Wu, Jingmin Zhang, Jinbin Wang, Kaihui Liu, Xuedong Bai, Dapeng Yu, Jie Wang, Jiangyu Li, Peng Gao

Abstract: Nontrivial topological structures offer rich playground in condensed matter physics including fluid dynamics, superconductivity, and ferromagnetism, and they promise alternative device configurations for post-Moore spintronics and electronics. Indeed, magnetic skyrmions are actively pursued for high-density data storage, while polar vortices with exotic negative capacitance may enable ultralow pow… ▽ More Nontrivial topological structures offer rich playground in condensed matter physics including fluid dynamics, superconductivity, and ferromagnetism, and they promise alternative device configurations for post-Moore spintronics and electronics. Indeed, magnetic skyrmions are actively pursued for high-density data storage, while polar vortices with exotic negative capacitance may enable ultralow power consumption in microelectronics. Following extensive investigations on a variety of magnetic textures including vortices, domain walls and skyrmions in the past decades, studies on polar topologies have taken off in recent years, resulting in discoveries of closure domains, vortices, and skyrmions in ferroelectric materials. Nevertheless, the atomic-scale creation of topological polar structures is largely confined in a single ferroelectric system, PbTiO3 (PTO) with large polarization, casting doubt on the generality of polar topologies and limiting their potential applications. In this work, we successfully create previously unrealized atomic-scale polar antivortices in the nominally nonpolar SrTiO3 (STO), expanding the reaches of topological structures and completing an important missing link in polar topologies. The work shed considerable new insight into the formation of topological polar structures, and offers guidance in searching for new polar textures. △ Less

Submitted 30 July, 2020; originally announced July 2020.

Improving Training on Noisy Stuctured Labels

Authors: Abubakar Abid, James Zou

Abstract: Fine-grained annotations---e.g. dense image labels, image segmentation and text tagging---are useful in many ML applications but they are labor-intensive to generate. Moreover there are often systematic, structured errors in these fine-grained annotations. For example, a car might be entirely unannotated in the image, or the boundary between a car and street might only be coarsely annotated. Stand… ▽ More Fine-grained annotations---e.g. dense image labels, image segmentation and text tagging---are useful in many ML applications but they are labor-intensive to generate. Moreover there are often systematic, structured errors in these fine-grained annotations. For example, a car might be entirely unannotated in the image, or the boundary between a car and street might only be coarsely annotated. Standard ML training on data with such structured errors produces models with biases and poor performance. In this work, we propose a novel framework of Error-Correcting Networks (ECN) to address the challenge of learning in the presence structured error in fine-grained annotations. Given a large noisy dataset with commonly occurring structured errors, and a much smaller dataset with more accurate annotations, ECN is able to substantially improve the prediction of fine-grained annotations compared to standard approaches for training on noisy data. It does so by learning to leverage the structures in the annotations and in the noisy labels. Systematic experiments on image segmentation and text tagging demonstrate the strong performance of ECN in improving training on noisy structured labels. △ Less

Submitted 8 March, 2020; originally announced March 2020.

Comments: 8 pages main text, 13 pages total

Nonminimal Inflation in Supersymmetric GUTs with $U(1)_R \times Z_n$ Symmetry

Authors: Muhammad Atif Masoud, Mansoor Ur Rehman, Mian Muhammad Azeem Abid

Abstract: A supersymmetric hybrid inflation framework is employed to realize a class of non-minimal inflation models with $U(1)_R \times Z_n$ global symmetry. This framework naturally incorporates models based on grand unified theories by avoiding the most commonly faced monopole problem. The predictions of inflationary observables, the scalar spectral index $n_s = 0.960-0.966$ and the tensor to scalar rati… ▽ More A supersymmetric hybrid inflation framework is employed to realize a class of non-minimal inflation models with $U(1)_R \times Z_n$ global symmetry. This framework naturally incorporates models based on grand unified theories by avoiding the most commonly faced monopole problem. The predictions of inflationary observables, the scalar spectral index $n_s = 0.960-0.966$ and the tensor to scalar ratio $r=0.0031-0.0045$, are in perfect agreement with the Planck 2018 data. For sub-Planckian values of the field the $Z_n$ symmetry is only allowed for $n\leq 4$. △ Less

Submitted 23 October, 2019; originally announced October 2019.

Comments: 9 pages, 4 figures, published version

Report number: Vol No.28, Iss. No.16

Journal ref: Int.J. Mod Physics D (Oct 2019)

Atomic Imaging of Mechanically Induced Topological Transition of Ferroelectric Vortices

Authors: Pan Chen, Xiangli Zhong, Jacob A. Zorn, Mingqiang Li, Yuanwei Sun, Adeel Y. Abid, Chuanlai Ren, Yuehui Li, Xiaomei Li, Xiumei Ma, Jinbin Wang, Kaihui Liu, Zhi Xu, Congbing Tan, Longqing Chen, Peng Gao, Xuedong Bai

Abstract: Ferroelectric vortices formed through complex lattice-charge interactions have great potential in applications for future nanoelectronics such as memories. For practical applications, it is crucial to manipulate these topological states under external stimuli. Here, we apply mechanical loads to locally manipulate the vortices in a PbTiO3-SrTiO3 superlattice via atomically resolved in situ scanning… ▽ More Ferroelectric vortices formed through complex lattice-charge interactions have great potential in applications for future nanoelectronics such as memories. For practical applications, it is crucial to manipulate these topological states under external stimuli. Here, we apply mechanical loads to locally manipulate the vortices in a PbTiO3-SrTiO3 superlattice via atomically resolved in situ scanning transmission electron microscopy. The vortices undergo a transition to the a-domain with in-plane polarization under external compressive stress and spontaneously recover after removal of the stress. We reveal the detailed transition process at the atomic scale and reproduce this numerically using phase-field simulations. These findings provide new pathways to control the exotic topological ferroelectric structures for future nanoelectronics and also valuable insights into understanding of lattice-charge interactions at nanoscale. △ Less

Submitted 30 September, 2019; originally announced October 2019.

Gradio: Hassle-Free Sharing and Testing of ML Models in the Wild

Authors: Abubakar Abid, Ali Abdalla, Ali Abid, Dawood Khan, Abdulrahman Alfozan, James Zou

Abstract: Accessibility is a major challenge of machine learning (ML). Typical ML models are built by specialists and require specialized hardware/software as well as ML experience to validate. This makes it challenging for non-technical collaborators and endpoint users (e.g. physicians) to easily provide feedback on model development and to gain trust in ML. The accessibility challenge also makes collabora… ▽ More Accessibility is a major challenge of machine learning (ML). Typical ML models are built by specialists and require specialized hardware/software as well as ML experience to validate. This makes it challenging for non-technical collaborators and endpoint users (e.g. physicians) to easily provide feedback on model development and to gain trust in ML. The accessibility challenge also makes collaboration more difficult and limits the ML researcher's exposure to realistic data and scenarios that occur in the wild. To improve accessibility and facilitate collaboration, we developed an open-source Python package, Gradio, which allows researchers to rapidly generate a visual interface for their ML models. Gradio makes accessing any ML model as easy as sharing a URL. Our development of Gradio is informed by interviews with a number of machine learning researchers who participate in interdisciplinary collaborations. Their feedback identified that Gradio should support a variety of interfaces and frameworks, allow for easy sharing of the interface, allow for input manipulation and interactive inference by the domain expert, as well as allow embedding the interface in iPython notebooks. We developed these features and carried out a case study to understand Gradio's usefulness and usability in the setting of a machine learning collaboration between a researcher and a cardiologist. △ Less

Submitted 6 June, 2019; originally announced June 2019.

Comments: Presented at 2019 ICML Workshop on Human in the Loop Learning (HILL 2019), Long Beach, USA

Contrastive Variational Autoencoder Enhances Salient Features

Authors: Abubakar Abid, James Zou

Abstract: Variational autoencoders are powerful algorithms for identifying dominant latent structure in a single dataset. In many applications, however, we are interested in modeling latent structure and variation that are enriched in a target dataset compared to some background---e.g. enriched in patients compared to the general population. Contrastive learning is a principled framework to capture such enr… ▽ More Variational autoencoders are powerful algorithms for identifying dominant latent structure in a single dataset. In many applications, however, we are interested in modeling latent structure and variation that are enriched in a target dataset compared to some background---e.g. enriched in patients compared to the general population. Contrastive learning is a principled framework to capture such enriched variation between the target and background, but state-of-the-art contrastive methods are limited to linear models. In this paper, we introduce the contrastive variational autoencoder (cVAE), which combines the benefits of contrastive learning with the power of deep generative models. The cVAE is designed to identify and enhance salient latent features. The cVAE is trained on two related but unpaired datasets, one of which has minimal contribution from the salient latent features. The cVAE explicitly models latent features that are shared between the datasets, as well as those that are enriched in one dataset relative to the other, which allows the algorithm to isolate and enhance the salient latent features. The algorithm is straightforward to implement, has a similar run-time to the standard VAE, and is robust to noise and dataset purity. We conduct experiments across diverse types of data, including gene expression and facial images, showing that the cVAE effectively uncovers latent structure that is salient in a particular analysis. △ Less

Submitted 12 February, 2019; originally announced February 2019.

Comments: Submitted to ICML 2019

Concrete Autoencoders for Differentiable Feature Selection and Reconstruction

Authors: Abubakar Abid, Muhammad Fatih Balin, James Zou

Abstract: We introduce the concrete autoencoder, an end-to-end differentiable method for global feature selection, which efficiently identifies a subset of the most informative features and simultaneously learns a neural network to reconstruct the input data from the selected features. Our method is unsupervised, and is based on using a concrete selector layer as the encoder and using a standard neural netw… ▽ More We introduce the concrete autoencoder, an end-to-end differentiable method for global feature selection, which efficiently identifies a subset of the most informative features and simultaneously learns a neural network to reconstruct the input data from the selected features. Our method is unsupervised, and is based on using a concrete selector layer as the encoder and using a standard neural network as the decoder. During the training phase, the temperature of the concrete selector layer is gradually decreased, which encourages a user-specified number of discrete features to be learned. During test time, the selected features can be used with the decoder network to reconstruct the remaining input features. We evaluate concrete autoencoders on a variety of datasets, where they significantly outperform state-of-the-art methods for feature selection and data reconstruction. In particular, on a large-scale gene expression dataset, the concrete autoencoder selects a small subset of genes whose expression levels can be use to impute the expression levels of the remaining genes. In doing so, it improves on the current widely-used expert-curated L1000 landmark genes, potentially reducing measurement costs by 20%. The concrete autoencoder can be implemented by adding just a few lines of code to a standard autoencoder. △ Less

Submitted 30 January, 2019; v1 submitted 27 January, 2019; originally announced January 2019.

Comments: Submitted to ICML 2019

Atomic Structure of Polar Surface in SrTiO3

Authors: Adeel Y Abid, Ning Li, Ayaz Arif, Peng Gao

Abstract: Rearrangement of atoms due to broken translational symmetries at the surface of SrTiO$_3$ is scarcely debatable in the present day scenario. Actual concern demands to unveil the true structure and precise mechanism responsible for atomic reconstructions at a unit cell level. Here, we reveal the atomic structure of SrTiO$_3$ surface by using annular bright field imaging in spherical aberration corr… ▽ More Rearrangement of atoms due to broken translational symmetries at the surface of SrTiO$_3$ is scarcely debatable in the present day scenario. Actual concern demands to unveil the true structure and precise mechanism responsible for atomic reconstructions at a unit cell level. Here, we reveal the atomic structure of SrTiO$_3$ surface by using annular bright field imaging in spherical aberration corrected scanning transmission electron microscope. We measure structural parameters such as lattice constant, bond length, atomic displacement and subsequently we find a polarization for the top five unit cells is ~10-20 uCcm$^{-2}$. Both Sr-O and Ti-O planes reconstruct thus contribute to net dipole moment that is towards surface. Elongation of the out of plane lattice for skin layers is also witnessed. The electron energy loss spectroscopy experiment illustrates the presence of oxygen vacancies at the surface which seems to be largely responsible for the stability of surface polarization. Our study provides a sound foundation into mechanistic understanding for structure and properties of surfaces for complex oxides. These outcomes can be considered as a pragmatic boost particularly for examining other insulator-like materials as well as in bridging gap for hitherto fewer experimental investigation along with various theoretical studies. △ Less

Submitted 7 November, 2018; originally announced November 2018.

Contrastive Multivariate Singular Spectrum Analysis

Authors: Abdi-Hakin Dirie, Abubakar Abid, James Zou

Abstract: We introduce Contrastive Multivariate Singular Spectrum Analysis, a novel unsupervised method for dimensionality reduction and signal decomposition of time series data. By utilizing an appropriate background dataset, the method transforms a target time series dataset in a way that evinces the sub-signals that are enhanced in the target dataset, as opposed to only those that account for the greates… ▽ More We introduce Contrastive Multivariate Singular Spectrum Analysis, a novel unsupervised method for dimensionality reduction and signal decomposition of time series data. By utilizing an appropriate background dataset, the method transforms a target time series dataset in a way that evinces the sub-signals that are enhanced in the target dataset, as opposed to only those that account for the greatest variance. This shifts the goal from finding signals that explain the most variance to signals that matter the most to the analyst. We demonstrate our method on an illustrative synthetic example, as well as show the utility of our method in the downstream clustering of electrocardiogram signals from the public MHEALTH dataset. △ Less

Submitted 31 October, 2018; originally announced October 2018.

Autowarp: Learning a Warping Distance from Unlabeled Time Series Using Sequence Autoencoders

Authors: Abubakar Abid, James Zou

Abstract: Measuring similarities between unlabeled time series trajectories is an important problem in domains as diverse as medicine, astronomy, finance, and computer vision. It is often unclear what is the appropriate metric to use because of the complex nature of noise in the trajectories (e.g. different sampling rates or outliers). Domain experts typically hand-craft or manually select a specific metric… ▽ More Measuring similarities between unlabeled time series trajectories is an important problem in domains as diverse as medicine, astronomy, finance, and computer vision. It is often unclear what is the appropriate metric to use because of the complex nature of noise in the trajectories (e.g. different sampling rates or outliers). Domain experts typically hand-craft or manually select a specific metric, such as dynamic time warping (DTW), to apply on their data. In this paper, we propose Autowarp, an end-to-end algorithm that optimizes and learns a good metric given unlabeled trajectories. We define a flexible and differentiable family of warping metrics, which encompasses common metrics such as DTW, Euclidean, and edit distance. Autowarp then leverages the representation power of sequence autoencoders to optimize for a member of this warping distance family. The output is a metric which is easy to interpret and can be robustly learned from relatively few trajectories. In systematic experiments across different domains, we show that Autowarp often outperforms hand-crafted trajectory similarity metrics. △ Less

Submitted 23 October, 2018; originally announced October 2018.

Comments: Accepted at NIPS 2018

New Inflation in Supersymmetric SU(5) and Flipped SU(5) GUT Models

Authors: Mansoor Ur Rehman, Mian Muhammad Azeem Abid, Amna Ejaz

Abstract: We study the feasibility of realizing supersymmetric new inflation model, introduced by Senoguz and Shafi in [1], for $SU(5)$ and flipped $SU(5)$ models of grand unified theories (GUTs). This realization requires an additional $U(1)_R \times Z_{n}$ symmetry for its successful implementation. The standard model (SM) gauge singlet scalar components of $24_H$ and $10_H$ GUT Higgs superfields are resp… ▽ More We study the feasibility of realizing supersymmetric new inflation model, introduced by Senoguz and Shafi in [1], for $SU(5)$ and flipped $SU(5)$ models of grand unified theories (GUTs). This realization requires an additional $U(1)_R \times Z_{n}$ symmetry for its successful implementation. The standard model (SM) gauge singlet scalar components of $24_H$ and $10_H$ GUT Higgs superfields are respectively employed to realize successful inflation in $SU(5)$ and flipped $SU(5)$ models. The predictions of the various inflationary observables lie within the recent Planck bounds on the scalar spectral index, $n_s$, for $n \geq 5$ in $SU(5)$ model and for $n \geq 6$ in flipped $SU(5)$ model. In particular, the tensor to scalar ratio $r$ and the running of spectral index $d n_s/ d\ln k$ are negligibly small and lie in the range, $10^{-12} \lesssim r \lesssim 10^{-8}$ and $10^{-9} \lesssim dn_s/d\ln k \lesssim 10^{-3}$, for realistic values of $n$. In numerical estimation of the various predictions, we fix the gauge symmetry breaking scale, $M$, around $2 \times 10^{16}$ GeV. The issue of gauge coupling unification in $R$-symmetric $SU(5)$ is evaded by adding vectorlike families with mass splitting within their multiplets. The dilution of monopoles beyond the observable limit is naturally achieved in the breaking of $SU(5)$ gauge symmetry during inflation. A realistic scenario of reheating with non-thermal leptogenesis is employed for both models. The predicted range of reheat temperature within Planck bounds, $3 \times 10^{7}\text{ GeV }\lesssim T_r \lesssim 2 \times 10^{9}$ GeV, is safe from the gravitino problem for the gravitino mass, $m_{3/2} \gtrsim 10$ TeV. Finally, the $U(1)_R \times Z_{n}$ symmetry is also observed to play a crucial role in suppressing the various fast proton decay operators. △ Less

Submitted 12 November, 2020; v1 submitted 20 April, 2018; originally announced April 2018.

Comments: 24 pages and 8 figures; published revision

Journal ref: JCAP 11 (2020)019

Stochastic EM for Shuffled Linear Regression

Authors: Abubakar Abid, James Zou

Abstract: We consider the problem of inference in a linear regression model in which the relative ordering of the input features and output labels is not known. Such datasets naturally arise from experiments in which the samples are shuffled or permuted during the protocol. In this work, we propose a framework that treats the unknown permutation as a latent variable. We maximize the likelihood of observatio… ▽ More We consider the problem of inference in a linear regression model in which the relative ordering of the input features and output labels is not known. Such datasets naturally arise from experiments in which the samples are shuffled or permuted during the protocol. In this work, we propose a framework that treats the unknown permutation as a latent variable. We maximize the likelihood of observations using a stochastic expectation-maximization (EM) approach. We compare this to the dominant approach in the literature, which corresponds to hard EM in our framework. We show on synthetic data that the stochastic EM algorithm we develop has several advantages, including lower parameter error, less sensitivity to the choice of initialization, and significantly better performance on datasets that are only partially shuffled. We conclude by performing two experiments on real datasets that have been partially shuffled, in which we show that the stochastic EM algorithm can recover the weights with modest error. △ Less

Submitted 2 April, 2018; originally announced April 2018.

Comments: 11 pages, 5 figures

Interpretation of Neural Networks is Fragile

Authors: Amirata Ghorbani, Abubakar Abid, James Zou

Abstract: In order for machine learning to be deployed and trusted in many applications, it is crucial to be able to reliably explain why the machine learning algorithm makes certain predictions. For example, if an algorithm classifies a given pathology image to be a malignant tumor, then the doctor may need to know which parts of the image led the algorithm to this classification. How to interpret black-bo… ▽ More In order for machine learning to be deployed and trusted in many applications, it is crucial to be able to reliably explain why the machine learning algorithm makes certain predictions. For example, if an algorithm classifies a given pathology image to be a malignant tumor, then the doctor may need to know which parts of the image led the algorithm to this classification. How to interpret black-box predictors is thus an important and active area of research. A fundamental question is: how much can we trust the interpretation itself? In this paper, we show that interpretation of deep learning predictions is extremely fragile in the following sense: two perceptively indistinguishable inputs with the same predicted label can be assigned very different interpretations. We systematically characterize the fragility of several widely-used feature-importance interpretation methods (saliency maps, relevance propagation, and DeepLIFT) on ImageNet and CIFAR-10. Our experiments show that even small random perturbation can change the feature importance and new systematic perturbations can lead to dramatically different interpretations without changing the label. We extend these results to show that interpretations based on exemplars (e.g. influence functions) are similarly fragile. Our analysis of the geometry of the Hessian matrix gives insight on why fragility could be a fundamental challenge to the current interpretation approaches. △ Less

Submitted 6 November, 2018; v1 submitted 28 October, 2017; originally announced October 2017.

Comments: Published as a conference paper at AAAI 2019

Contrastive Principal Component Analysis

Authors: Abubakar Abid, Martin J. Zhang, Vivek K. Bagaria, James Zou

Abstract: We present a new technique called contrastive principal component analysis (cPCA) that is designed to discover low-dimensional structure that is unique to a dataset, or enriched in one dataset relative to other data. The technique is a generalization of standard PCA, for the setting where multiple datasets are available -- e.g. a treatment and a control group, or a mixed versus a homogeneous popul… ▽ More We present a new technique called contrastive principal component analysis (cPCA) that is designed to discover low-dimensional structure that is unique to a dataset, or enriched in one dataset relative to other data. The technique is a generalization of standard PCA, for the setting where multiple datasets are available -- e.g. a treatment and a control group, or a mixed versus a homogeneous population -- and the goal is to explore patterns that are specific to one of the datasets. We conduct a wide variety of experiments in which cPCA identifies important dataset-specific patterns that are missed by PCA, demonstrating that it is useful for many applications: subgroup discovery, visualizing trends, feature selection, denoising, and data-dependent standardization. We provide geometrical interpretations of cPCA and show that it satisfies desirable theoretical guarantees. We also extend cPCA to nonlinear settings in the form of kernel cPCA. We have released our code as a python package and documentation is on Github. △ Less

Submitted 21 November, 2017; v1 submitted 19 September, 2017; originally announced September 2017.

Comments: main body is 10 pages, 9 figures

Linear Regression with Shuffled Labels

Authors: Abubakar Abid, Ada Poon, James Zou

Abstract: Is it possible to perform linear regression on datasets whose labels are shuffled with respect to the inputs? We explore this question by proposing several estimators that recover the weights of a noisy linear model from labels that are shuffled by an unknown permutation. We show that the analog of the classical least-squares estimator produces inconsistent estimates in this setting, and introduce… ▽ More Is it possible to perform linear regression on datasets whose labels are shuffled with respect to the inputs? We explore this question by proposing several estimators that recover the weights of a noisy linear model from labels that are shuffled by an unknown permutation. We show that the analog of the classical least-squares estimator produces inconsistent estimates in this setting, and introduce an estimator based on the self-moments of the input features and labels. We study the regimes in which each estimator excels, and generalize the estimators to the setting where partial ordering information is available in the form of experiments replicated independently. The result is a framework that enables robust inference, as we demonstrate by experiments on both synthetic and standard datasets, where we are able to recover approximate weights using only shuffled labels. Our work demonstrates that linear regression in the absence of complete ordering information is possible and can be of practical interest, particularly in experiments that characterize populations of particles, such as flow cytometry. △ Less

Submitted 4 May, 2017; v1 submitted 3 May, 2017; originally announced May 2017.

Decreasing defect rate of test cases by designing and analysis for recursive modules of a program structure: Improvement in test cases

Authors: Muhammad Javed, Bashir Ahmad, Zaffar Abbas, Allah Nawaz, Muhammad Ali Abid, Ihsan Ullah

Abstract: Designing and analysis of test cases is a challenging tasks for tester roles especially those who are related to test the structure of program. Recently, Programmers are showing valuable trend towards the implementation of recursive modules in a program structure. In testing phase of software development life cycle, test cases help the tester to test the structure and flow of program. The implemen… ▽ More Designing and analysis of test cases is a challenging tasks for tester roles especially those who are related to test the structure of program. Recently, Programmers are showing valuable trend towards the implementation of recursive modules in a program structure. In testing phase of software development life cycle, test cases help the tester to test the structure and flow of program. The implementation of well designed test cases for a program leads to reduce the defect rate and efforts needed for corrective maintenance. In this paper, author proposed a strategy to design and analyze the test cases for a program structure of recursive modules. This strategy will definitely leads to validation of program structure besides reducing the defect rate and corrective maintenance efforts. △ Less

Submitted 26 August, 2012; originally announced August 2012.

Comments: 4 pages

Journal ref: IJCSIS August 2012, Vol. 10 No. 8