-
Scalable Compression of a Weighted Graph
Authors:
Kifayat Ullah Khan,
Waqas Nawaz,
Young-Koo Lee
Abstract:
Graph is a useful data structure to model various real life aspects like email communications, co-authorship among researchers, interactions among chemical compounds, and so on. Supporting such real life interactions produce a knowledge rich massive repository of data. However, efficiently understanding underlying trends and patterns is hard due to large size of the graph. Therefore, this paper pr…
▽ More
Graph is a useful data structure to model various real life aspects like email communications, co-authorship among researchers, interactions among chemical compounds, and so on. Supporting such real life interactions produce a knowledge rich massive repository of data. However, efficiently understanding underlying trends and patterns is hard due to large size of the graph. Therefore, this paper presents a scalable compression solution to compute summary of a weighted graph. All the aforementioned interactions from various domains are represented as edge weights in a graph. Therefore, creating a summary graph while considering this vital aspect is necessary to learn insights of different communication patterns. By experimenting the proposed method on two real world and publically available datasets against a state of the art technique, we obtain order of magnitude performance gain and better summarization accuracy.
△ Less
Submitted 9 November, 2016;
originally announced November 2016.
-
Shortest Path Analysis in Social Graphs
Authors:
Waqas Nawaz,
Kifayat Ullah Khan,
Young-Koo Lee
Abstract:
The shortest path problem is among the most fundamental combinatorial optimization problems to answer reachability queries. It is hard to deter-mine which vertices or edges are visited during shortest path traversals. In this paper, we provide an empirical analysis on how traversal algorithms behave on social networks. First, we compute the shortest paths between set of vertices. Each shortest pat…
▽ More
The shortest path problem is among the most fundamental combinatorial optimization problems to answer reachability queries. It is hard to deter-mine which vertices or edges are visited during shortest path traversals. In this paper, we provide an empirical analysis on how traversal algorithms behave on social networks. First, we compute the shortest paths between set of vertices. Each shortest path is considered as one transaction. Second, we utilize the pat-tern mining approach to identify the frequency of occurrence of the vertices. We evaluate the results in terms of network properties, i.e. degree distribution, clustering coefficient.
△ Less
Submitted 24 December, 2014;
originally announced December 2014.
-
OLAP on Structurally Significant Data in Graphs
Authors:
Kifayat Ullah Khan,
Kamran Najeebullah,
Waqas Nawaz,
Young-Koo Lee
Abstract:
Summarized data analysis of graphs using OLAP (Online Analytical Processing) is very popular these days. However due to high dimensionality and large size, it is not easy to decide which data should be aggregated for OLAP analysis. Though iceberg cubing is useful, but it is unaware of the significance of dimensional values with respect to the structure of the graph. In this paper, we propose a Str…
▽ More
Summarized data analysis of graphs using OLAP (Online Analytical Processing) is very popular these days. However due to high dimensionality and large size, it is not easy to decide which data should be aggregated for OLAP analysis. Though iceberg cubing is useful, but it is unaware of the significance of dimensional values with respect to the structure of the graph. In this paper, we propose a Structural Significance, SS, measure to identify the structurally significant dimensional values in each dimension. This leads to structure aware pruning. We then propose an algorithm, iGraphCubing, to compute the graph cube to analyze the structurally significant data using the proposed measure. We evaluated the proposed ideas on real and synthetic data sets and observed very encouraging results.
△ Less
Submitted 27 January, 2014;
originally announced January 2014.
-
BPP: Large Graph Storage for Efficient Disk Based Processing
Authors:
Kamran Najeebullah,
Kifayat Ullah Khan,
Waqas Nawaz,
Young-Koo Lee
Abstract:
Processing very large graphs like social networks, biological and chemical compounds is a challenging task. Distributed graph processing systems process the billion-scale graphs efficiently but incur overheads of efficient partitioning and distribution of the graph over a cluster of nodes. Distributed processing also requires cluster management and fault tolerance. In order to overcome these probl…
▽ More
Processing very large graphs like social networks, biological and chemical compounds is a challenging task. Distributed graph processing systems process the billion-scale graphs efficiently but incur overheads of efficient partitioning and distribution of the graph over a cluster of nodes. Distributed processing also requires cluster management and fault tolerance. In order to overcome these problems GraphChi was proposed recently. GraphChi significantly outperformed all the representative distributed processing frameworks. Still, we observe that GraphChi incurs some serious degradation in performance due to 1) high number of non-sequential I/Os for processing every chunk of graph; and 2) lack of true parallelism to process the graph. In this paper we propose a simple yet powerful engine BiShard Parallel Processor (BPP) to efficiently process billions-scale graphs on a single PC. We extend the storage structure proposed by GraphChi and introduce a new processing model called BiShard Parallel (BP). BP enables full CPU parallelism for processing the graph and significantly reduces the number of non-sequential I/Os required to process every chunk of the graph. Our experiments on real large graphs show that our solution significantly outperforms GraphChi.
△ Less
Submitted 10 January, 2014;
originally announced January 2014.
