Fred Hohman

Scalable K-Core Decomposition for Static Graphs Using a Dynamic Graph Data Structure

IEEE International Conference on Big Data (Big Data), 2018

Abstract

The k-core of a graph is a metric used in a wide range of applications, including social networks analytics, visualization, and graph coloring. Finding the maximal k-core of a graph can be be done in near linear time. The low computational requirements for finding the maximal k-core makes effective parallelization challenging, especially for the iterative algorithms that prune vertices and edges that no longer meet the requirements of the maximal k-core and require rebuilding the graph every iteration. In this paper, we present a new parallel and scalable algorithm for finding the maximal k-core. Similar to past algorithms, our algorithm also prunes vertices and edges. Unlike past approaches, our new algorithm does not rebuild the graph in every iteration-rather, it uses a dynamic graph data structure and avoids one of the largest performance penalties of k-core. We also show how to extend our algorithm to support k-core edge decomposition for different size k-cores found in the graph. This can be used for visualization and community analysis. While our new algorithms are architecture independent, our implementations target NVIDIA GPUs. When comparing our algorithms against several highly optimized algorithms, including the sequential igraph implementation and the multi-thread ParK implementation, our new algorithms are significantly faster. For finding the maximal k-core in the graph, our new algorithm can be up-to 58× faster the igraph and up-to 4x faster than ParK executed on a 36 core (72 thread) system. For the k-core decomposition algorithm, we saw even greater and more consistent speedups for our algorithm where it was up-to 130x faster than igraph and up-to 8x faster than ParK. Our algorithms were executed on an NVIDIA P100 GPU.

Materials

Project
PDF
DOI

BibTeX

			
@inproceedings{tripathy2018scalable,
    title={Scalable K-Core Decomposition for Static Graphs Using a Dynamic Graph Data Structure},
    author={Tripathy, Alok and Hohman, Fred and Chau, Duen Horng, and Green, Oded},
    booktitle={IEEE International Conference on Big Data (Big Data)},
    year={2018},
    publisher={IEEE},
    doi={10.1109/BigData.2018.8622056}
}