Effective data structure for smart big data systems applying an expectation-maximization algorithm

Younghwan Shin, Yunyeong Goh, Changsung Lee, Jong Moon Chung

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

In a general big data system there are two major factors that contribute to the processing delay. The total execution time consists of communication time and computation time. In most cases, modern big data systems offload to cloud computing systems to complete their job when too high of a computation load is being processed on the current task assigned systems. However, the adoption of cloud computing can cause the communication delay to increase. As big data analysis is used in more and more real-time systems, reducing the communication delay is one of the major challenges in big data research. This paper presents the application of an expectation-maximization algorithm for a big data system structure in order to reduce the communication time significantly. The fact that a decrease in the communication time in related to the gain of the information entropy is also revealed in this paper.

Original languageEnglish
Title of host publicationProceedings of the 3rd World Conference on Smart Trends in Systems, Security and Sustainability, WorldS4 2019
EditorsXin-She Yang, Nilanjan Dey, Amit Joshi
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages136-140
Number of pages5
ISBN (Electronic)9781728137803
DOIs
Publication statusPublished - 2019 Jul
Event3rd World Conference on Smart Trends in Systems, Security and Sustainability, WorldS4 2019 - London, United Kingdom
Duration: 2019 Jul 302019 Jul 31

Publication series

NameProceedings of the 3rd World Conference on Smart Trends in Systems, Security and Sustainability, WorldS4 2019

Conference

Conference3rd World Conference on Smart Trends in Systems, Security and Sustainability, WorldS4 2019
CountryUnited Kingdom
CityLondon
Period19/7/3019/7/31

    Fingerprint

All Science Journal Classification (ASJC) codes

  • Artificial Intelligence
  • Computer Networks and Communications
  • Information Systems and Management
  • Renewable Energy, Sustainability and the Environment
  • Safety, Risk, Reliability and Quality
  • Education

Cite this

Shin, Y., Goh, Y., Lee, C., & Chung, J. M. (2019). Effective data structure for smart big data systems applying an expectation-maximization algorithm. In X-S. Yang, N. Dey, & A. Joshi (Eds.), Proceedings of the 3rd World Conference on Smart Trends in Systems, Security and Sustainability, WorldS4 2019 (pp. 136-140). [8903976] (Proceedings of the 3rd World Conference on Smart Trends in Systems, Security and Sustainability, WorldS4 2019). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/WorldS4.2019.8903976