Smart Packet Transmission Scheduling in Cognitive IoT Systems: DDQN Based Approach

Adeeb Salh, Lukman Audah, Mohammed A. Alhartomi, Kwang Soon Kim, Saeed Hamood Alsamhi, Faris A. Almalki, Qazwan Abdullah, Abdu Saif, Haneen Algethami

Research output: Contribution to journalArticlepeer-review

13 Citations (Scopus)


The convergence of Artificial Intelligence (AI) can overcome the complexity of network defects and support a sustainable and green system. AI has been used in the Cognitive Internet of Things (CIoT), improving a large volume of data, minimizing energy consumption, managing traffic, and storing data. However, improving smart packet transmission scheduling (TS) in CIoT is dependent on choosing an optimum channel with a minimum estimated Packet Error Rate (PER), packet delays caused by channel errors, and the subsequent retransmissions. Therefore, we propose a Generative Adversarial Network and Deep Distribution Q Network (GAN-DDQN) to enhance smart packet TS by reducing the distance between the estimated and target action-value particles. Furthermore, GAN-DDQN training based on reward clipping is used to evaluate the value of each action for certain states to avoid large variations in the target action value. The simulation results show that the proposed GAN-DDQN increases throughput and transmission packet while reducing power consumption and Transmission Delay (TD) when compared to fuzzy Radial Basis Function (fuzzy-RBF) and Distributional Q-Network (DQN). Furthermore, GAN-DDQN provides a high rate of 38 Mbps, compared to actor-critic fuzzy-RBF's rate of 30 Mbps and the DQN algorithm's rate of 19 Mbps.

Original languageEnglish
Pages (from-to)50023-50036
Number of pages14
JournalIEEE Access
Publication statusPublished - 2022

Bibliographical note

Publisher Copyright:
© 2013 IEEE.

All Science Journal Classification (ASJC) codes

  • Computer Science(all)
  • Materials Science(all)
  • Engineering(all)
  • Electrical and Electronic Engineering


Dive into the research topics of 'Smart Packet Transmission Scheduling in Cognitive IoT Systems: DDQN Based Approach'. Together they form a unique fingerprint.

Cite this