IDEAS home Printed from https://ideas.repec.org/a/spr/joinma/v32y2021i3d10.1007_s10845-020-01722-7.html
   My bibliography  Save this article

A dynamic clustering technique based on deep reinforcement learning for Internet of vehicles

Author

Listed:
  • Abida Sharif

    (University of Electronic Science and Technology)

  • Jian Ping Li

    (University of Electronic Science and Technology)

  • Muhammad Asim Saleem

    (University of Electronic Science and Technology)

  • Gunasekaran Manogran

    (University of California)

  • Seifedine Kadry

    (Beirut Arab University)

  • Abdul Basit

    (University of Engineering and Technology)

  • Muhammad Attique Khan

    (HITEC University Taxila)

Abstract

The Internet of Vehicles (IoV) is a communication paradigm that connects the vehicles to the Internet for transferring information between the networks. One of the key challenges in IoV is the management of a massive amount of traffic generated from a large number of connected IoT-based vehicles. Network clustering strategies have been proposed to solve the challenges of traffic management in IoV networks. Traditional optimization approaches have been proposed to manage the resources of the network efficiently. However, the nature of next-generation IoV environment is highly dynamic, and the existing optimization technique cannot precisely formulate the dynamic characteristic of IoV networks. Reinforcement learning is a model-free technique where an agent learns from its environment for learning the optimal policies. We propose an experience-driven approach based on an Actor-Critic based Deep Reinforcement learning framework (AC-DRL) for efficiently selecting the cluster head (CH) for managing the resources of the network considering the noisy nature of IoV environment. The agent in the proposed AC-DRL can efficiently approximate and learn the state-action value function of the actor and action function of the critic for selecting the CH considering the dynamic condition of the network.The experimental results show an improvement of 28% and 15% respectively, in terms of satisfying the SLA requirement and 35% and 14% improvement in throughput compared to the static and DQN approaches.

Suggested Citation

  • Abida Sharif & Jian Ping Li & Muhammad Asim Saleem & Gunasekaran Manogran & Seifedine Kadry & Abdul Basit & Muhammad Attique Khan, 2021. "A dynamic clustering technique based on deep reinforcement learning for Internet of vehicles," Journal of Intelligent Manufacturing, Springer, vol. 32(3), pages 757-768, March.
  • Handle: RePEc:spr:joinma:v:32:y:2021:i:3:d:10.1007_s10845-020-01722-7
    DOI: 10.1007/s10845-020-01722-7
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s10845-020-01722-7
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s10845-020-01722-7?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Sahar Ebadinezhad & Ziya Dereboylu & Enver Ever, 2019. "Clustering-Based Modified Ant Colony Optimizer for Internet of Vehicles (CACOIOV)," Sustainability, MDPI, vol. 11(9), pages 1-22, May.
    2. Farhan Aadil & Khalid Bashir Bajwa & Salabat Khan & Nadeem Majeed Chaudary & Adeel Akram, 2016. "CACONET: Ant Colony Optimization (ACO) Based Clustering Algorithm for VANET," PLOS ONE, Public Library of Science, vol. 11(5), pages 1-21, May.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Han, Kunlun & Yang, Kai & Yin, Linfei, 2022. "Lightweight actor-critic generative adversarial networks for real-time smart generation control of microgrids," Applied Energy, Elsevier, vol. 317(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ghassan Husnain & Shahzad Anwar & Gulbadan Sikander & Armughan Ali & Sangsoon Lim, 2023. "A Bio-Inspired Cluster Optimization Schema for Efficient Routing in Vehicular Ad Hoc Networks (VANETs)," Energies, MDPI, vol. 16(3), pages 1-20, February.
    2. Salil Bharany & Sandeep Sharma & Surbhi Bhatia & Mohammad Khalid Imam Rahmani & Mohammed Shuaib & Saima Anwar Lashari, 2022. "Energy Efficient Clustering Protocol for FANETS Using Moth Flame Optimization," Sustainability, MDPI, vol. 14(10), pages 1-22, May.
    3. Christy Jackson Joshua & Prassanna Jayachandran & Abdul Quadir Md & Arun Kumar Sivaraman & Kong Fah Tee, 2023. "Clustering, Routing, Scheduling, and Challenges in Bio-Inspired Parameter Tuning of Vehicular Ad Hoc Networks for Environmental Sustainability," Sustainability, MDPI, vol. 15(6), pages 1-19, March.
    4. Sahar Ebadinezhad & Ziya Dereboylu & Enver Ever, 2019. "Clustering-Based Modified Ant Colony Optimizer for Internet of Vehicles (CACOIOV)," Sustainability, MDPI, vol. 11(9), pages 1-22, May.
    5. Rejab Hajlaoui & Eesa Alsolami & Tarek Moulahi & Hervé Guyennet, 2019. "Construction of a stable vehicular ad hoc network based on hybrid genetic algorithm," Telecommunication Systems: Modelling, Analysis, Design and Management, Springer, vol. 71(3), pages 433-445, July.
    6. Rahim, Sahar & Wang, Zhen & Ju, Ping, 2022. "Overview and applications of Robust optimization in the avant-garde energy grid infrastructure: A systematic review," Applied Energy, Elsevier, vol. 319(C).
    7. Atif Ishtiaq & Sheeraz Ahmed & Muhammad Fahad Khan & Farhan Aadil & Muazzam Maqsood & Salabat Khan, 2019. "Intelligent clustering using moth flame optimizer for vehicular ad hoc networks," International Journal of Distributed Sensor Networks, , vol. 15(1), pages 15501477188, January.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:joinma:v:32:y:2021:i:3:d:10.1007_s10845-020-01722-7. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.