IDEAS home Printed from https://ideas.repec.org/a/gam/jeners/v16y2023i21p7296-d1268947.html
   My bibliography  Save this article

Deep Reinforcement Learning-Driven Mitigation of Adverse Effects of Cyber-Attacks on Electric Vehicle Charging Station

Author

Listed:
  • Manoj Basnet

    (FedEx Services, Collierville, TN 38017, USA)

  • Mohd. Hasan Ali

    (Department of Electrical and Computer Engineering, The University of Memphis, Memphis, TN 38152, USA)

Abstract

An electric vehicle charging station (EVCS) infrastructure is the backbone of transportation electrification; however, the EVCS has various vulnerabilities in software, hardware, supply chain, and incumbent legacy technologies such as network, communication, and control. These standalone or networked EVCSs open up large attack surfaces for local or state-funded adversaries. The state-of-the-art approaches are not agile and intelligent enough to defend against and mitigate advanced persistent threats (APT). We propose data-driven model-free digital clones based on multiple independent agents deep reinforcement learning (IADRL) that uses the Twin Delayed Deep Deterministic Policy Gradient (TD3) to efficiently learn the control policy to mitigate the cyberattacks on the controllers of EVCS. Also, the proposed digital clones trained with TD3 are compared against the benchmark Deep Deterministic Policy Gradient (DDPG) agent. The attack model considers the APT designed to malfunction the duty cycles of the EVCS controllers with Type-I low-frequency attacks and Type-II constant attacks. The proposed model restores the EVCS operation under threat incidence in any/all controllers by correcting the control signals generated by the legacy controllers. Our experiments verify the superior control policies and actions of TD3-based clones compared to the DDPG-based clones. Also, the TD3-based controller clones solve the problem of incremental bias, suboptimal policy, and hyperparameter sensitivity of the benchmark DDPG-based digital clones, enforcing the efficient mitigation of the impact of cyberattacks on EVCS controllers.

Suggested Citation

  • Manoj Basnet & Mohd. Hasan Ali, 2023. "Deep Reinforcement Learning-Driven Mitigation of Adverse Effects of Cyber-Attacks on Electric Vehicle Charging Station," Energies, MDPI, vol. 16(21), pages 1-20, October.
  • Handle: RePEc:gam:jeners:v:16:y:2023:i:21:p:7296-:d:1268947
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/1996-1073/16/21/7296/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/1996-1073/16/21/7296/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Jay Johnson & Timothy Berg & Benjamin Anderson & Brian Wright, 2022. "Review of Electric Vehicle Charger Cybersecurity Vulnerabilities, Potential Impacts, and Defenses," Energies, MDPI, vol. 15(11), pages 1-26, May.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Hou, Jiazuo & Hu, Chenxi & Lei, Shunbo & Hou, Yunhe, 2024. "Cyber resilience of power electronics-enabled power systems: A review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 189(PB).
    2. Nnaemeka V. Emodi & Udochukwu B. Akuru & Michael O. Dioha & Patrick Adoba & Remeredzai J. Kuhudzai & Olusola Bamisile, 2023. "The Role of Internet of Things on Electric Vehicle Charging Infrastructure and Consumer Experience," Energies, MDPI, vol. 16(10), pages 1-18, May.
    3. Farshid Javadnejad & Mohammad Jahanbakh & Cesar Ariel Pinto & Azita Saeidi, 2024. "Analyzing incentives and barriers to electric vehicle adoption in the United States," Environment Systems and Decisions, Springer, vol. 44(3), pages 575-606, September.
    4. Zia Muhammad & Zahid Anwar & Bilal Saleem & Jahanzeb Shahid, 2023. "Emerging Cybersecurity and Privacy Threats to Electric Vehicles and Their Impact on Human and Environmental Sustainability," Energies, MDPI, vol. 16(3), pages 1-30, January.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jeners:v:16:y:2023:i:21:p:7296-:d:1268947. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.