Adaptive Frame Skipping with Screen Dynamics for Mobile Screen Sharing Applications

Keun Woo Lim, Jisu Ha, Puleum Bae, Jeonggil Ko, Young Bae Ko

Research output: Contribution to journalArticle

4 Citations (Scopus)

Abstract

The improvement in hardware capabilities of mobile devices has led to the active use of processor-heavy contents, such as multimedia files, on resource-limited platforms. In addition to simply enjoying such contents on mobile devices, recently commercialized protocols allow the real-time sharing of multimedia (or a mobile device's screen contents) with neighboring devices via wireless connection. However, unlike PC-scale computing platforms, use-case expansions on mobile devices face an additional technical challenge. Specifically, while the improved computation power is capable of handling processor-hungry applications, battery limitations hold back their full utilization. This paper acknowledges the fact that screen sharing on mobile devices can be attractive, but empirically show that minimizing the energy consumption is crutial, and introduces enhancements to the widely used H.264 encoder on mobile devices. Specifically, our enhancements target to minimize the transmission size of multimedia contents by analyzing the screen's dynamics. For contents with high dynamics, our scheme tries to maintain the video quality, while aggressively skipping frames for regions with minimal motion intensity. Our empirical evaluations show that the proposed light-weight enhancements reduce the size of a typical multimedia file by ∼42%, while maintaining a high user-perceived quality (e.g., Structural SIMilarity measure) of 0.925. Wirelessly sharing this video results in ∼31% lower frame transmission rate and up to ∼21% power savings in less dynamic regions.

Original languageEnglish
Pages (from-to)1577-1588
Number of pages12
JournalIEEE Systems Journal
Volume12
Issue number2
DOIs
Publication statusPublished - 2018 Jun

Fingerprint

Mobile devices
Energy utilization
Hardware

All Science Journal Classification (ASJC) codes

  • Control and Systems Engineering
  • Electrical and Electronic Engineering

Cite this

Lim, Keun Woo ; Ha, Jisu ; Bae, Puleum ; Ko, Jeonggil ; Ko, Young Bae. / Adaptive Frame Skipping with Screen Dynamics for Mobile Screen Sharing Applications. In: IEEE Systems Journal. 2018 ; Vol. 12, No. 2. pp. 1577-1588.
@article{fa070007e1084968ba30d16e2961006a,
title = "Adaptive Frame Skipping with Screen Dynamics for Mobile Screen Sharing Applications",
abstract = "The improvement in hardware capabilities of mobile devices has led to the active use of processor-heavy contents, such as multimedia files, on resource-limited platforms. In addition to simply enjoying such contents on mobile devices, recently commercialized protocols allow the real-time sharing of multimedia (or a mobile device's screen contents) with neighboring devices via wireless connection. However, unlike PC-scale computing platforms, use-case expansions on mobile devices face an additional technical challenge. Specifically, while the improved computation power is capable of handling processor-hungry applications, battery limitations hold back their full utilization. This paper acknowledges the fact that screen sharing on mobile devices can be attractive, but empirically show that minimizing the energy consumption is crutial, and introduces enhancements to the widely used H.264 encoder on mobile devices. Specifically, our enhancements target to minimize the transmission size of multimedia contents by analyzing the screen's dynamics. For contents with high dynamics, our scheme tries to maintain the video quality, while aggressively skipping frames for regions with minimal motion intensity. Our empirical evaluations show that the proposed light-weight enhancements reduce the size of a typical multimedia file by ∼42{\%}, while maintaining a high user-perceived quality (e.g., Structural SIMilarity measure) of 0.925. Wirelessly sharing this video results in ∼31{\%} lower frame transmission rate and up to ∼21{\%} power savings in less dynamic regions.",
author = "Lim, {Keun Woo} and Jisu Ha and Puleum Bae and Jeonggil Ko and Ko, {Young Bae}",
year = "2018",
month = "6",
doi = "10.1109/JSYST.2016.2589238",
language = "English",
volume = "12",
pages = "1577--1588",
journal = "IEEE Systems Journal",
issn = "1932-8184",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
number = "2",

}

Adaptive Frame Skipping with Screen Dynamics for Mobile Screen Sharing Applications. / Lim, Keun Woo; Ha, Jisu; Bae, Puleum; Ko, Jeonggil; Ko, Young Bae.

In: IEEE Systems Journal, Vol. 12, No. 2, 06.2018, p. 1577-1588.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Adaptive Frame Skipping with Screen Dynamics for Mobile Screen Sharing Applications

AU - Lim, Keun Woo

AU - Ha, Jisu

AU - Bae, Puleum

AU - Ko, Jeonggil

AU - Ko, Young Bae

PY - 2018/6

Y1 - 2018/6

N2 - The improvement in hardware capabilities of mobile devices has led to the active use of processor-heavy contents, such as multimedia files, on resource-limited platforms. In addition to simply enjoying such contents on mobile devices, recently commercialized protocols allow the real-time sharing of multimedia (or a mobile device's screen contents) with neighboring devices via wireless connection. However, unlike PC-scale computing platforms, use-case expansions on mobile devices face an additional technical challenge. Specifically, while the improved computation power is capable of handling processor-hungry applications, battery limitations hold back their full utilization. This paper acknowledges the fact that screen sharing on mobile devices can be attractive, but empirically show that minimizing the energy consumption is crutial, and introduces enhancements to the widely used H.264 encoder on mobile devices. Specifically, our enhancements target to minimize the transmission size of multimedia contents by analyzing the screen's dynamics. For contents with high dynamics, our scheme tries to maintain the video quality, while aggressively skipping frames for regions with minimal motion intensity. Our empirical evaluations show that the proposed light-weight enhancements reduce the size of a typical multimedia file by ∼42%, while maintaining a high user-perceived quality (e.g., Structural SIMilarity measure) of 0.925. Wirelessly sharing this video results in ∼31% lower frame transmission rate and up to ∼21% power savings in less dynamic regions.

AB - The improvement in hardware capabilities of mobile devices has led to the active use of processor-heavy contents, such as multimedia files, on resource-limited platforms. In addition to simply enjoying such contents on mobile devices, recently commercialized protocols allow the real-time sharing of multimedia (or a mobile device's screen contents) with neighboring devices via wireless connection. However, unlike PC-scale computing platforms, use-case expansions on mobile devices face an additional technical challenge. Specifically, while the improved computation power is capable of handling processor-hungry applications, battery limitations hold back their full utilization. This paper acknowledges the fact that screen sharing on mobile devices can be attractive, but empirically show that minimizing the energy consumption is crutial, and introduces enhancements to the widely used H.264 encoder on mobile devices. Specifically, our enhancements target to minimize the transmission size of multimedia contents by analyzing the screen's dynamics. For contents with high dynamics, our scheme tries to maintain the video quality, while aggressively skipping frames for regions with minimal motion intensity. Our empirical evaluations show that the proposed light-weight enhancements reduce the size of a typical multimedia file by ∼42%, while maintaining a high user-perceived quality (e.g., Structural SIMilarity measure) of 0.925. Wirelessly sharing this video results in ∼31% lower frame transmission rate and up to ∼21% power savings in less dynamic regions.

UR - http://www.scopus.com/inward/record.url?scp=84979785002&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84979785002&partnerID=8YFLogxK

U2 - 10.1109/JSYST.2016.2589238

DO - 10.1109/JSYST.2016.2589238

M3 - Article

AN - SCOPUS:84979785002

VL - 12

SP - 1577

EP - 1588

JO - IEEE Systems Journal

JF - IEEE Systems Journal

SN - 1932-8184

IS - 2

ER -