-
From ChatGPT to ThreatGPT: Impact of Generative AI in Cybersecurity and Privacy
Authors:
Maanak Gupta,
CharanKumar Akiri,
Kshitiz Aryal,
Eli Parker,
Lopamudra Praharaj
Abstract:
Undoubtedly, the evolution of Generative AI (GenAI) models has been the highlight of digital transformation in the year 2022. As the different GenAI models like ChatGPT and Google Bard continue to foster their complexity and capability, it's critical to understand its consequences from a cybersecurity perspective. Several instances recently have demonstrated the use of GenAI tools in both the defe…
▽ More
Undoubtedly, the evolution of Generative AI (GenAI) models has been the highlight of digital transformation in the year 2022. As the different GenAI models like ChatGPT and Google Bard continue to foster their complexity and capability, it's critical to understand its consequences from a cybersecurity perspective. Several instances recently have demonstrated the use of GenAI tools in both the defensive and offensive side of cybersecurity, and focusing on the social, ethical and privacy implications this technology possesses. This research paper highlights the limitations, challenges, potential risks, and opportunities of GenAI in the domain of cybersecurity and privacy. The work presents the vulnerabilities of ChatGPT, which can be exploited by malicious users to exfiltrate malicious information bypassing the ethical constraints on the model. This paper demonstrates successful example attacks like Jailbreaks, reverse psychology, and prompt injection attacks on the ChatGPT. The paper also investigates how cyber offenders can use the GenAI tools in developing cyber attacks, and explore the scenarios where ChatGPT can be used by adversaries to create social engineering attacks, phishing attacks, automated hacking, attack payload generation, malware creation, and polymorphic malware. This paper then examines defense techniques and uses GenAI tools to improve security measures, including cyber defense automation, reporting, threat intelligence, secure code generation and detection, attack identification, developing ethical guidelines, incidence response plans, and malware detection. We will also discuss the social, legal, and ethical implications of ChatGPT. In conclusion, the paper highlights open challenges and future directions to make this GenAI secure, safe, trustworthy, and ethical as the community understands its cybersecurity impacts.
△ Less
Submitted 2 July, 2023;
originally announced July 2023.
-
The Lack of Convexity of the Relevance-Compression Function
Authors:
Albert E Parker,
Tomas Gedeon,
Alexander Dimitrov
Abstract:
In this paper we investigate the convexity of the relevance-compression function for the Information Bottleneck and the Information Distortion problems. This curve is an analog of the rate-distortion curve, which is convex. In the problems we discuss in this paper, the distortion function is not a linear function of the quantizer, and the relevance-compression function is not necessarily convex (c…
▽ More
In this paper we investigate the convexity of the relevance-compression function for the Information Bottleneck and the Information Distortion problems. This curve is an analog of the rate-distortion curve, which is convex. In the problems we discuss in this paper, the distortion function is not a linear function of the quantizer, and the relevance-compression function is not necessarily convex (concave), but can change its convexity. We relate this phenomena with existence of first order phase transitions in the corresponding Lagrangian as a function of the annealing parameter.
△ Less
Submitted 22 April, 2022;
originally announced April 2022.
-
Modeling the Impact of Social Distancing and Targeted Vaccination on the Spread of COVID-19 through a Real City-Scale Contact Network
Authors:
Gavin S. Hartnett,
Edward Parker,
Timothy R. Gulden,
Raffaele Vardavas,
David Kravitz
Abstract:
We use mobile device data to construct empirical interpersonal physical contact networks in the city of Portland, Oregon, both before and after social distancing measures were enacted during the COVID-19 pandemic. These networks reveal how social distancing measures and the public's reaction to the incipient pandemic affected the connectivity patterns within the city. We find that as the pandemic…
▽ More
We use mobile device data to construct empirical interpersonal physical contact networks in the city of Portland, Oregon, both before and after social distancing measures were enacted during the COVID-19 pandemic. These networks reveal how social distancing measures and the public's reaction to the incipient pandemic affected the connectivity patterns within the city. We find that as the pandemic developed there was a substantial decrease in the number of individuals with many contacts. We further study the impact of these different network topologies on the spread of COVID-19 by simulating an SEIR epidemic model over these networks, and find that the reduced connectivity greatly suppressed the epidemic. We then investigate how the epidemic responds when part of the population is vaccinated, and we compare two vaccination distribution strategies, both with and without social distancing. Our main result is that the heavy-tailed degree distribution of the contact networks causes a targeted vaccination strategy that prioritizes high-contact individuals to reduce the number of cases far more effectively than a strategy that vaccinates individuals at random. Combining both targeted vaccination and social distancing leads to the greatest reduction in cases, and we also find that the marginal benefit of a targeted strategy as compared to a random strategy exceeds the marginal benefit of social distancing for reducing the number of cases. These results have important implications for ongoing vaccine distribution efforts worldwide.
△ Less
Submitted 13 July, 2021;
originally announced July 2021.
-
Replica Symmetry Breaking in Bipartite Spin Glasses and Neural Networks
Authors:
Gavin Hartnett,
Edward Parker,
Edward Geist
Abstract:
Some interesting recent advances in the theoretical understanding of neural networks have been informed by results from the physics of disordered many-body systems. Motivated by these findings, this work uses the replica technique to study the mathematically tractable bipartite Sherrington-Kirkpatrick (SK) spin glass model, which is formally similar to a Restricted Boltzmann Machine (RBM) neural n…
▽ More
Some interesting recent advances in the theoretical understanding of neural networks have been informed by results from the physics of disordered many-body systems. Motivated by these findings, this work uses the replica technique to study the mathematically tractable bipartite Sherrington-Kirkpatrick (SK) spin glass model, which is formally similar to a Restricted Boltzmann Machine (RBM) neural network. The bipartite SK model has been previously studied assuming replica symmetry; here this assumption is relaxed and a replica symmetry breaking analysis is performed. The bipartite SK model is found to have many features in common with Parisi's solution of the original, unipartite SK model, including the existence of a multitude of pure states which are related in a hierarchical, ultrametric fashion. As an application of this analysis, the optimal cost for a graph partitioning problem is shown to be simply related to the ground state energy of the bipartite SK model. As a second application, empirical investigations reveal that the Gibbs sampled outputs of an RBM trained on the MNIST data set are more ultrametrically distributed than the input data itself.
△ Less
Submitted 15 August, 2018; v1 submitted 16 March, 2018;
originally announced March 2018.
-
Self-Reflective Risk-Aware Artificial Cognitive Modeling for Robot Response to Human Behaviors
Authors:
Fei Han,
Christopher Reardon,
Lynne E. Parker,
Hao Zhang
Abstract:
In order for cooperative robots ("co-robots") to respond to human behaviors accurately and efficiently in human-robot collaboration, interpretation of human actions, awareness of new situations, and appropriate decision making are all crucial abilities for co-robots. For this purpose, the human behaviors should be interpreted by co-robots in the same manner as human peers. To address this issue, a…
▽ More
In order for cooperative robots ("co-robots") to respond to human behaviors accurately and efficiently in human-robot collaboration, interpretation of human actions, awareness of new situations, and appropriate decision making are all crucial abilities for co-robots. For this purpose, the human behaviors should be interpreted by co-robots in the same manner as human peers. To address this issue, a novel interpretability indicator is introduced so that robot actions are appropriate to the current human behaviors. In addition, the complete consideration of all potential situations of a robot's environment is nearly impossible in real-world applications, making it difficult for the co-robot to act appropriately and safely in new scenarios. This is true even when the pretrained model is highly accurate in a known situation. For effective and safe teaming with humans, we introduce a new generalizability indicator that allows a co-robot to self-reflect and reason about when an observation falls outside the co-robot's learned model. Based on topic modeling and two novel indicators, we propose a new Self-reflective Risk-aware Artificial Cognitive (SRAC) model. The co-robots are able to consider action risks and identify new situations so that better decisions can be made. Experiments both using real-world datasets and on physical robots suggest that our SRAC model significantly outperforms the traditional methodology and enables better decision making in response to human activities.
△ Less
Submitted 16 May, 2016;
originally announced May 2016.
