RealGraph: A graph engine leveraging the power-law distribution of real-world graphs

Yong Yeon Jo, Sang Wook Kim, Myung Hwan Jang, Sunju Park

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

As the size of real-world graphs has drastically increased in recent years, a wide variety of graph engines have been developed to deal with such big graphs efficiently. However, the majority of graph engines have been designed without considering the power-law degree distribution of real-world graphs seriously. Two problems have been observed when existing graph engines process real-world graphs: inefficient scanning of the sparse indicator and the delay in iteration progress due to uneven workload distribution. In this paper, we propose RealGraph, a single-machine based graph engine equipped with the hierarchical indicator and the block-based workload allocation. Experimental results on real-world datasets show that RealGraph significantly outperforms existing graph engines in terms of both speed and scalability.

Original languageEnglish
Title of host publicationThe Web Conference 2019 - Proceedings of the World Wide Web Conference, WWW 2019
PublisherAssociation for Computing Machinery, Inc
Pages807-817
Number of pages11
ISBN (Electronic)9781450366748
DOIs
Publication statusPublished - 2019 May 13
Event2019 World Wide Web Conference, WWW 2019 - San Francisco, United States
Duration: 2019 May 132019 May 17

Publication series

NameThe Web Conference 2019 - Proceedings of the World Wide Web Conference, WWW 2019

Conference

Conference2019 World Wide Web Conference, WWW 2019
CountryUnited States
CitySan Francisco
Period19/5/1319/5/17

Fingerprint

Engines
Scalability
Scanning

All Science Journal Classification (ASJC) codes

  • Computer Networks and Communications
  • Software

Cite this

Jo, Y. Y., Kim, S. W., Jang, M. H., & Park, S. (2019). RealGraph: A graph engine leveraging the power-law distribution of real-world graphs. In The Web Conference 2019 - Proceedings of the World Wide Web Conference, WWW 2019 (pp. 807-817). (The Web Conference 2019 - Proceedings of the World Wide Web Conference, WWW 2019). Association for Computing Machinery, Inc. https://doi.org/10.1145/3308558.3313434
Jo, Yong Yeon ; Kim, Sang Wook ; Jang, Myung Hwan ; Park, Sunju. / RealGraph : A graph engine leveraging the power-law distribution of real-world graphs. The Web Conference 2019 - Proceedings of the World Wide Web Conference, WWW 2019. Association for Computing Machinery, Inc, 2019. pp. 807-817 (The Web Conference 2019 - Proceedings of the World Wide Web Conference, WWW 2019).
@inproceedings{9b42d122bbef4c77b2a58357453d84d4,
title = "RealGraph: A graph engine leveraging the power-law distribution of real-world graphs",
abstract = "As the size of real-world graphs has drastically increased in recent years, a wide variety of graph engines have been developed to deal with such big graphs efficiently. However, the majority of graph engines have been designed without considering the power-law degree distribution of real-world graphs seriously. Two problems have been observed when existing graph engines process real-world graphs: inefficient scanning of the sparse indicator and the delay in iteration progress due to uneven workload distribution. In this paper, we propose RealGraph, a single-machine based graph engine equipped with the hierarchical indicator and the block-based workload allocation. Experimental results on real-world datasets show that RealGraph significantly outperforms existing graph engines in terms of both speed and scalability.",
author = "Jo, {Yong Yeon} and Kim, {Sang Wook} and Jang, {Myung Hwan} and Sunju Park",
year = "2019",
month = "5",
day = "13",
doi = "10.1145/3308558.3313434",
language = "English",
series = "The Web Conference 2019 - Proceedings of the World Wide Web Conference, WWW 2019",
publisher = "Association for Computing Machinery, Inc",
pages = "807--817",
booktitle = "The Web Conference 2019 - Proceedings of the World Wide Web Conference, WWW 2019",

}

Jo, YY, Kim, SW, Jang, MH & Park, S 2019, RealGraph: A graph engine leveraging the power-law distribution of real-world graphs. in The Web Conference 2019 - Proceedings of the World Wide Web Conference, WWW 2019. The Web Conference 2019 - Proceedings of the World Wide Web Conference, WWW 2019, Association for Computing Machinery, Inc, pp. 807-817, 2019 World Wide Web Conference, WWW 2019, San Francisco, United States, 19/5/13. https://doi.org/10.1145/3308558.3313434

RealGraph : A graph engine leveraging the power-law distribution of real-world graphs. / Jo, Yong Yeon; Kim, Sang Wook; Jang, Myung Hwan; Park, Sunju.

The Web Conference 2019 - Proceedings of the World Wide Web Conference, WWW 2019. Association for Computing Machinery, Inc, 2019. p. 807-817 (The Web Conference 2019 - Proceedings of the World Wide Web Conference, WWW 2019).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

TY - GEN

T1 - RealGraph

T2 - A graph engine leveraging the power-law distribution of real-world graphs

AU - Jo, Yong Yeon

AU - Kim, Sang Wook

AU - Jang, Myung Hwan

AU - Park, Sunju

PY - 2019/5/13

Y1 - 2019/5/13

N2 - As the size of real-world graphs has drastically increased in recent years, a wide variety of graph engines have been developed to deal with such big graphs efficiently. However, the majority of graph engines have been designed without considering the power-law degree distribution of real-world graphs seriously. Two problems have been observed when existing graph engines process real-world graphs: inefficient scanning of the sparse indicator and the delay in iteration progress due to uneven workload distribution. In this paper, we propose RealGraph, a single-machine based graph engine equipped with the hierarchical indicator and the block-based workload allocation. Experimental results on real-world datasets show that RealGraph significantly outperforms existing graph engines in terms of both speed and scalability.

AB - As the size of real-world graphs has drastically increased in recent years, a wide variety of graph engines have been developed to deal with such big graphs efficiently. However, the majority of graph engines have been designed without considering the power-law degree distribution of real-world graphs seriously. Two problems have been observed when existing graph engines process real-world graphs: inefficient scanning of the sparse indicator and the delay in iteration progress due to uneven workload distribution. In this paper, we propose RealGraph, a single-machine based graph engine equipped with the hierarchical indicator and the block-based workload allocation. Experimental results on real-world datasets show that RealGraph significantly outperforms existing graph engines in terms of both speed and scalability.

UR - http://www.scopus.com/inward/record.url?scp=85066901739&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85066901739&partnerID=8YFLogxK

U2 - 10.1145/3308558.3313434

DO - 10.1145/3308558.3313434

M3 - Conference contribution

AN - SCOPUS:85066901739

T3 - The Web Conference 2019 - Proceedings of the World Wide Web Conference, WWW 2019

SP - 807

EP - 817

BT - The Web Conference 2019 - Proceedings of the World Wide Web Conference, WWW 2019

PB - Association for Computing Machinery, Inc

ER -

Jo YY, Kim SW, Jang MH, Park S. RealGraph: A graph engine leveraging the power-law distribution of real-world graphs. In The Web Conference 2019 - Proceedings of the World Wide Web Conference, WWW 2019. Association for Computing Machinery, Inc. 2019. p. 807-817. (The Web Conference 2019 - Proceedings of the World Wide Web Conference, WWW 2019). https://doi.org/10.1145/3308558.3313434