Planning operators of concurrent RDF stream processing queries

Sejin Chun, Seungjun Yoon, Jooik Jung, Kyong Ho Lee

Research output: Contribution to journalArticle

Abstract

RDF stream processing (RSP), which aims to query data streams and linked datasets using common data model and query languages extended from RDF and SPARQL, is gaining popularity. However, most of the existing RSP engines do not provide any optimisation techniques for shared join operators among query plans from concurrent queries. Many number of shared join operators can incur the waste of a lot of CPU resources like a processing memory. Moreover, queries on shared operators cause a slow response time because they must be re-evaluated without reusing intermediate results. To solve these problems, we propose an efficient method of optimising query plans on multiple queries. First, the proposed method evicts some data that get notified from the streams in order to maintain an efficient memory usage. Second, the proposed method optimises query plans to maximise the reuse of shared join results. Experimental results show that the proposed method has significant improvements in terms of memory consumption and latency, compared to the state-the-of-art methods.

Original languageEnglish
Pages (from-to)93-117
Number of pages25
JournalInternational Journal of Web and Grid Services
Volume15
Issue number1
DOIs
Publication statusPublished - 2019 Jan 1

Fingerprint

Query processing
Data storage equipment
Planning
Processing
Query languages
Program processors
Data structures
Mathematical operators
Engines

All Science Journal Classification (ASJC) codes

  • Software
  • Computer Networks and Communications

Cite this

Chun, Sejin ; Yoon, Seungjun ; Jung, Jooik ; Lee, Kyong Ho. / Planning operators of concurrent RDF stream processing queries. In: International Journal of Web and Grid Services. 2019 ; Vol. 15, No. 1. pp. 93-117.
@article{afb9752638bc4a458e938297595f9492,
title = "Planning operators of concurrent RDF stream processing queries",
abstract = "RDF stream processing (RSP), which aims to query data streams and linked datasets using common data model and query languages extended from RDF and SPARQL, is gaining popularity. However, most of the existing RSP engines do not provide any optimisation techniques for shared join operators among query plans from concurrent queries. Many number of shared join operators can incur the waste of a lot of CPU resources like a processing memory. Moreover, queries on shared operators cause a slow response time because they must be re-evaluated without reusing intermediate results. To solve these problems, we propose an efficient method of optimising query plans on multiple queries. First, the proposed method evicts some data that get notified from the streams in order to maintain an efficient memory usage. Second, the proposed method optimises query plans to maximise the reuse of shared join results. Experimental results show that the proposed method has significant improvements in terms of memory consumption and latency, compared to the state-the-of-art methods.",
author = "Sejin Chun and Seungjun Yoon and Jooik Jung and Lee, {Kyong Ho}",
year = "2019",
month = "1",
day = "1",
doi = "10.1504/IJWGS.2019.096555",
language = "English",
volume = "15",
pages = "93--117",
journal = "International Journal of Web and Grid Services",
issn = "1741-1106",
publisher = "Inderscience Enterprises Ltd",
number = "1",

}

Planning operators of concurrent RDF stream processing queries. / Chun, Sejin; Yoon, Seungjun; Jung, Jooik; Lee, Kyong Ho.

In: International Journal of Web and Grid Services, Vol. 15, No. 1, 01.01.2019, p. 93-117.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Planning operators of concurrent RDF stream processing queries

AU - Chun, Sejin

AU - Yoon, Seungjun

AU - Jung, Jooik

AU - Lee, Kyong Ho

PY - 2019/1/1

Y1 - 2019/1/1

N2 - RDF stream processing (RSP), which aims to query data streams and linked datasets using common data model and query languages extended from RDF and SPARQL, is gaining popularity. However, most of the existing RSP engines do not provide any optimisation techniques for shared join operators among query plans from concurrent queries. Many number of shared join operators can incur the waste of a lot of CPU resources like a processing memory. Moreover, queries on shared operators cause a slow response time because they must be re-evaluated without reusing intermediate results. To solve these problems, we propose an efficient method of optimising query plans on multiple queries. First, the proposed method evicts some data that get notified from the streams in order to maintain an efficient memory usage. Second, the proposed method optimises query plans to maximise the reuse of shared join results. Experimental results show that the proposed method has significant improvements in terms of memory consumption and latency, compared to the state-the-of-art methods.

AB - RDF stream processing (RSP), which aims to query data streams and linked datasets using common data model and query languages extended from RDF and SPARQL, is gaining popularity. However, most of the existing RSP engines do not provide any optimisation techniques for shared join operators among query plans from concurrent queries. Many number of shared join operators can incur the waste of a lot of CPU resources like a processing memory. Moreover, queries on shared operators cause a slow response time because they must be re-evaluated without reusing intermediate results. To solve these problems, we propose an efficient method of optimising query plans on multiple queries. First, the proposed method evicts some data that get notified from the streams in order to maintain an efficient memory usage. Second, the proposed method optimises query plans to maximise the reuse of shared join results. Experimental results show that the proposed method has significant improvements in terms of memory consumption and latency, compared to the state-the-of-art methods.

UR - http://www.scopus.com/inward/record.url?scp=85058091701&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85058091701&partnerID=8YFLogxK

U2 - 10.1504/IJWGS.2019.096555

DO - 10.1504/IJWGS.2019.096555

M3 - Article

VL - 15

SP - 93

EP - 117

JO - International Journal of Web and Grid Services

JF - International Journal of Web and Grid Services

SN - 1741-1106

IS - 1

ER -