A System for Automated Open-Source Threat Intelligence Gathering and Management
Authors:
Peng Gao,
Xiaoyuan Liu,
Edward Choi,
Bhavna Soman,
Chinmaya Mishra,
Kate Farris,
Dawn Song
Abstract:
To remain aware of the fast-evolving cyber threat landscape, open-source Cyber Threat Intelligence (OSCTI) has received growing attention from the community. Commonly, knowledge about threats is presented in a vast number of OSCTI reports. Despite the pressing need for high-quality OSCTI, existing OSCTI gathering and management platforms, however, have primarily focused on isolated, low-level Indi…
▽ More
To remain aware of the fast-evolving cyber threat landscape, open-source Cyber Threat Intelligence (OSCTI) has received growing attention from the community. Commonly, knowledge about threats is presented in a vast number of OSCTI reports. Despite the pressing need for high-quality OSCTI, existing OSCTI gathering and management platforms, however, have primarily focused on isolated, low-level Indicators of Compromise. On the other hand, higher-level concepts (e.g., adversary tactics, techniques, and procedures) and their relationships have been overlooked, which contain essential knowledge about threat behaviors that is critical to uncovering the complete threat scenario. To bridge the gap, we propose SecurityKG, a system for automated OSCTI gathering and management. SecurityKG collects OSCTI reports from various sources, uses a combination of AI and NLP techniques to extract high-fidelity knowledge about threat behaviors, and constructs a security knowledge graph. SecurityKG also provides a UI that supports various types of interactivity to facilitate knowledge graph exploration.
△ Less
Submitted 26 February, 2021; v1 submitted 19 January, 2021;
originally announced January 2021.
Histogram-Free Multicanonical Monte Carlo Sampling to Calculate the Density of States
Authors:
Alfred C. K. Farris,
Ying Wai Li,
Markus Eisenbach
Abstract:
We report a new multicanonical Monte Carlo algorithm to obtain the density of states for physical systems with continuous state variables in statistical mechanics. Our algorithm is able to obtain a closed-form expression for the density of states expressed in a chosen basis set, instead of a numerical array of finite resolution as in previous variants of this class of MC methods such as the multic…
▽ More
We report a new multicanonical Monte Carlo algorithm to obtain the density of states for physical systems with continuous state variables in statistical mechanics. Our algorithm is able to obtain a closed-form expression for the density of states expressed in a chosen basis set, instead of a numerical array of finite resolution as in previous variants of this class of MC methods such as the multicanonical sampling and Wang-Landau sampling. This is enabled by storing the visited states directly and avoiding the explicit collection of a histogram. This practice also has the advantage of avoiding undesirable artificial errors caused by the discretization and binning of continuous state variables. Our results show that this scheme is capable of obtaining converged results with a much reduced number of Monte Carlo steps, leading to a significant speedup over existing algorithms.
△ Less
Submitted 15 November, 2018;
originally announced November 2018.
Renormalization Group Solution of the Chutes&Ladder Model
Authors:
Lauren A. Ball,
Alfred C. K. Farris,
Stefan Boettcher
Abstract:
We analyze a semi-infinite one-dimensional random walk process with a biased motion that is incremental in one direction and long-range in the other. On a network with a fixed hierarchy of long-range jumps, we find with exact renormalization group calculations that there is a dynamical transition between a localized adsorption phase and an anomalous diffusion phase in which the mean-square displac…
▽ More
We analyze a semi-infinite one-dimensional random walk process with a biased motion that is incremental in one direction and long-range in the other. On a network with a fixed hierarchy of long-range jumps, we find with exact renormalization group calculations that there is a dynamical transition between a localized adsorption phase and an anomalous diffusion phase in which the mean-square displacement exponent depends non-universally on the Bernoulli coin. We relate these results to similar findings of unconventional phase behavior in hierarchical networks.
△ Less
Submitted 8 October, 2014;
originally announced October 2014.