A Reinforcement Learning Approach to Dynamic Spectrum Access in Internet-of-Things Networks

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

To support wireless communication traffic of Internet-of-Things (IoT) systems in terms of massive connectivity, dynamic spectrum access (DSA) is important issue. This paper proposes spectrum sensor-aided DSA system based on a reinforcement learning (RL) algorithm that aims at efficient spectrum usage for IoT network over the incumbent network. Due to small-form-factor of IoT devices, they do not have spectrum sensing capability. To support DSA of IoT devices, we introduce sensor-aided DSA system that enhances spatial spectrum reusability by means of RL algorithm. With the RL algorithm, proposed DSA system provides self-organizing feature for massive number of IoT devices. We show that the performance of proposed RL based DSA system in various densities of IoT devices utilizing slotted ALOHA protocol that has spectrum access probability learned by proposed DSA system. We also present the performance of proposed RL based DSA system surpass that of distributed Carrier Sensing Multiple Access with Collision Avoidance (CSMA/CA) protocol for channel access coordination. We also present the consistent performance of incumbent user when the IoT devices access to the spectrum band with learned spectrum access probability.

Original languageEnglish
Title of host publication2019 IEEE International Conference on Communications, ICC 2019 - Proceedings
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781538680889
DOIs
Publication statusPublished - 2019 May
Event2019 IEEE International Conference on Communications, ICC 2019 - Shanghai, China
Duration: 2019 May 202019 May 24

Publication series

NameIEEE International Conference on Communications
Volume2019-May
ISSN (Print)1550-3607

Conference

Conference2019 IEEE International Conference on Communications, ICC 2019
CountryChina
CityShanghai
Period19/5/2019/5/24

Fingerprint

Reinforcement learning
Learning algorithms
Network protocols
Internet of things
Sensors
Reusability
Collision avoidance
Telecommunication traffic

All Science Journal Classification (ASJC) codes

  • Computer Networks and Communications
  • Electrical and Electronic Engineering

Cite this

Cha, H., & Kim, S. L. (2019). A Reinforcement Learning Approach to Dynamic Spectrum Access in Internet-of-Things Networks. In 2019 IEEE International Conference on Communications, ICC 2019 - Proceedings [8762091] (IEEE International Conference on Communications; Vol. 2019-May). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ICC.2019.8762091
Cha, Han ; Kim, Seong Lyun. / A Reinforcement Learning Approach to Dynamic Spectrum Access in Internet-of-Things Networks. 2019 IEEE International Conference on Communications, ICC 2019 - Proceedings. Institute of Electrical and Electronics Engineers Inc., 2019. (IEEE International Conference on Communications).
@inproceedings{508e6545e0194d9dbc44eac67d7862c3,
title = "A Reinforcement Learning Approach to Dynamic Spectrum Access in Internet-of-Things Networks",
abstract = "To support wireless communication traffic of Internet-of-Things (IoT) systems in terms of massive connectivity, dynamic spectrum access (DSA) is important issue. This paper proposes spectrum sensor-aided DSA system based on a reinforcement learning (RL) algorithm that aims at efficient spectrum usage for IoT network over the incumbent network. Due to small-form-factor of IoT devices, they do not have spectrum sensing capability. To support DSA of IoT devices, we introduce sensor-aided DSA system that enhances spatial spectrum reusability by means of RL algorithm. With the RL algorithm, proposed DSA system provides self-organizing feature for massive number of IoT devices. We show that the performance of proposed RL based DSA system in various densities of IoT devices utilizing slotted ALOHA protocol that has spectrum access probability learned by proposed DSA system. We also present the performance of proposed RL based DSA system surpass that of distributed Carrier Sensing Multiple Access with Collision Avoidance (CSMA/CA) protocol for channel access coordination. We also present the consistent performance of incumbent user when the IoT devices access to the spectrum band with learned spectrum access probability.",
author = "Han Cha and Kim, {Seong Lyun}",
year = "2019",
month = "5",
doi = "10.1109/ICC.2019.8762091",
language = "English",
series = "IEEE International Conference on Communications",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
booktitle = "2019 IEEE International Conference on Communications, ICC 2019 - Proceedings",
address = "United States",

}

Cha, H & Kim, SL 2019, A Reinforcement Learning Approach to Dynamic Spectrum Access in Internet-of-Things Networks. in 2019 IEEE International Conference on Communications, ICC 2019 - Proceedings., 8762091, IEEE International Conference on Communications, vol. 2019-May, Institute of Electrical and Electronics Engineers Inc., 2019 IEEE International Conference on Communications, ICC 2019, Shanghai, China, 19/5/20. https://doi.org/10.1109/ICC.2019.8762091

A Reinforcement Learning Approach to Dynamic Spectrum Access in Internet-of-Things Networks. / Cha, Han; Kim, Seong Lyun.

2019 IEEE International Conference on Communications, ICC 2019 - Proceedings. Institute of Electrical and Electronics Engineers Inc., 2019. 8762091 (IEEE International Conference on Communications; Vol. 2019-May).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

TY - GEN

T1 - A Reinforcement Learning Approach to Dynamic Spectrum Access in Internet-of-Things Networks

AU - Cha, Han

AU - Kim, Seong Lyun

PY - 2019/5

Y1 - 2019/5

N2 - To support wireless communication traffic of Internet-of-Things (IoT) systems in terms of massive connectivity, dynamic spectrum access (DSA) is important issue. This paper proposes spectrum sensor-aided DSA system based on a reinforcement learning (RL) algorithm that aims at efficient spectrum usage for IoT network over the incumbent network. Due to small-form-factor of IoT devices, they do not have spectrum sensing capability. To support DSA of IoT devices, we introduce sensor-aided DSA system that enhances spatial spectrum reusability by means of RL algorithm. With the RL algorithm, proposed DSA system provides self-organizing feature for massive number of IoT devices. We show that the performance of proposed RL based DSA system in various densities of IoT devices utilizing slotted ALOHA protocol that has spectrum access probability learned by proposed DSA system. We also present the performance of proposed RL based DSA system surpass that of distributed Carrier Sensing Multiple Access with Collision Avoidance (CSMA/CA) protocol for channel access coordination. We also present the consistent performance of incumbent user when the IoT devices access to the spectrum band with learned spectrum access probability.

AB - To support wireless communication traffic of Internet-of-Things (IoT) systems in terms of massive connectivity, dynamic spectrum access (DSA) is important issue. This paper proposes spectrum sensor-aided DSA system based on a reinforcement learning (RL) algorithm that aims at efficient spectrum usage for IoT network over the incumbent network. Due to small-form-factor of IoT devices, they do not have spectrum sensing capability. To support DSA of IoT devices, we introduce sensor-aided DSA system that enhances spatial spectrum reusability by means of RL algorithm. With the RL algorithm, proposed DSA system provides self-organizing feature for massive number of IoT devices. We show that the performance of proposed RL based DSA system in various densities of IoT devices utilizing slotted ALOHA protocol that has spectrum access probability learned by proposed DSA system. We also present the performance of proposed RL based DSA system surpass that of distributed Carrier Sensing Multiple Access with Collision Avoidance (CSMA/CA) protocol for channel access coordination. We also present the consistent performance of incumbent user when the IoT devices access to the spectrum band with learned spectrum access probability.

UR - http://www.scopus.com/inward/record.url?scp=85070187267&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85070187267&partnerID=8YFLogxK

U2 - 10.1109/ICC.2019.8762091

DO - 10.1109/ICC.2019.8762091

M3 - Conference contribution

AN - SCOPUS:85070187267

T3 - IEEE International Conference on Communications

BT - 2019 IEEE International Conference on Communications, ICC 2019 - Proceedings

PB - Institute of Electrical and Electronics Engineers Inc.

ER -

Cha H, Kim SL. A Reinforcement Learning Approach to Dynamic Spectrum Access in Internet-of-Things Networks. In 2019 IEEE International Conference on Communications, ICC 2019 - Proceedings. Institute of Electrical and Electronics Engineers Inc. 2019. 8762091. (IEEE International Conference on Communications). https://doi.org/10.1109/ICC.2019.8762091