IDEAS home Printed from https://ideas.repec.org/a/gam/jsusta/v14y2022i19p12608-d933090.html
   My bibliography  Save this article

Smart Carbon Emission Scheduling for Electric Vehicles via Reinforcement Learning under Carbon Peak Target

Author

Listed:
  • Yongsheng Cao

    (Department of Intelligent Science and Information Law, East China University of Political Science and Law, Shanghai 200042, China
    School of Electronic Information and Electrical Engineering, China Institute for Smart Court, Shanghai Jiao Tong University, Shanghai 200240, China)

  • Yongquan Wang

    (Department of Intelligent Science and Information Law, East China University of Political Science and Law, Shanghai 200042, China)

Abstract

Electric vehicles (EVs) have become popular in daily life, which influences carbon dioxide emissions and reshapes the curves of community loads. It is crucial to study efficient carbon emission scheduling algorithms to lessen the influence of EVs’ charging demand on carbon dioxide emissions and reduce the carbon emission cost for EVs coming to the community. We study an electric vehicle (EV) carbon emission scheduling problem to shave the peak community load and reduce the carbon emission cost when we do not know future EV data. First, we investigate an offline carbon emission scheduling problem to minimize the carbon emission cost of the community by predicting future data with regard to incoming EVs. Then, we study the online carbon emission problem and propose an online carbon emission algorithm based on a heuristic rolling algorithm. Furthermore, we propose a reinforcement learning smart carbon emission algorithm (RLSCA) to achieve the dispatching plan of the charging carbon emission of EVs. Last but not least, simulation results show that our proposed algorithm can reduce the carbon emission cost by 21.26 % , 16.60 % , and 8.72 % compared with three benchmark algorithms.

Suggested Citation

  • Yongsheng Cao & Yongquan Wang, 2022. "Smart Carbon Emission Scheduling for Electric Vehicles via Reinforcement Learning under Carbon Peak Target," Sustainability, MDPI, vol. 14(19), pages 1-16, October.
    • Handle: RePEc:gam:jsusta:v:14:y:2022:i:19:p:12608-:d:933090
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2071-1050/14/19/12608/pdf
    Download Restriction: no
    File URL: https://www.mdpi.com/2071-1050/14/19/12608/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Luo, Lizi & Gu, Wei & Zhou, Suyang & Huang, He & Gao, Song & Han, Jun & Wu, Zhi & Dou, Xiaobo, 2018. "Optimal planning of electric vehicle charging stations comprising multi-types of charging facilities," Applied Energy, Elsevier, vol. 226(C), pages 1087-1099.
    2. Jieshuang Dong & Yiming Li & Wenxiang Li & Songze Liu, 2022. "CO 2 Emission Reduction Potential of Road Transport to Achieve Carbon Neutrality in China," Sustainability, MDPI, vol. 14(9), pages 1-24, May.
    3. Lu, Renzhi & Hong, Seung Ho, 2019. "Incentive-based demand response for smart grid with reinforcement learning and deep neural network," Applied Energy, Elsevier, vol. 236(C), pages 937-949.
    4. Jian, Linni & Zheng, Yanchong & Shao, Ziyun, 2017. "High efficient valley-filling strategy for centralized coordinated charging of large-scale electric vehicles," Applied Energy, Elsevier, vol. 186(P1), pages 46-55.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Junchi Ma & Yuan Zhang & Zongtao Duan & Lei Tang, 2023. "PROLIFIC: Deep Reinforcement Learning for Efficient EV Fleet Scheduling and Charging," Sustainability, MDPI, vol. 15(18), pages 1-22, September.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Li, Bin & Dong, Xujun & Wen, Jianghui, 2022. "Cooperative-driving control for mixed fleets at wireless charging sections for lane changing behaviour," Energy, Elsevier, vol. 243(C).
    2. Hassan S. Hayajneh & Xuewei Zhang, 2020. "Logistics Design for Mobile Battery Energy Storage Systems," Energies, MDPI, vol. 13(5), pages 1-14, March.
    3. Dominique Barth & Benjamin Cohen-Boulakia & Wilfried Ehounou, 2022. "Distributed Reinforcement Learning for the Management of a Smart Grid Interconnecting Independent Prosumers," Energies, MDPI, vol. 15(4), pages 1-19, February.
    4. Tsoumalis, Georgios I. & Bampos, Zafeirios N. & Biskas, Pandelis N. & Keranidis, Stratos D. & Symeonidis, Polychronis A. & Voulgarakis, Dimitrios K., 2022. "A novel system for providing explicit demand response from domestic natural gas boilers," Applied Energy, Elsevier, vol. 317(C).
    5. Duan, Ditao & Poursoleiman, Roza, 2021. "Modified teaching-learning-based optimization by orthogonal learning for optimal design of an electric vehicle charging station," Utilities Policy, Elsevier, vol. 72(C).
    6. Luo, Lizi & Wu, Zhi & Gu, Wei & Huang, He & Gao, Song & Han, Jun, 2020. "Coordinated allocation of distributed generation resources and electric vehicle charging stations in distribution systems with vehicle-to-grid interaction," Energy, Elsevier, vol. 192(C).
    7. Zhang, Yang & Yang, Qingyu & Li, Donghe & An, Dou, 2022. "A reinforcement and imitation learning method for pricing strategy of electricity retailer with customers’ flexibility," Applied Energy, Elsevier, vol. 323(C).
    8. Omar Al-Ani & Sanjoy Das, 2022. "Reinforcement Learning: Theory and Applications in HEMS," Energies, MDPI, vol. 15(17), pages 1-37, September.
    9. Soomin Woo & Zhe Fu & Elpiniki Apostolaki-Iosifidou & Timothy E. Lipman, 2021. "Economic and Environmental Benefits for Electricity Grids from Spatiotemporal Optimization of Electric Vehicle Charging," Energies, MDPI, vol. 14(24), pages 1-22, December.
    10. Correa-Jullian, Camila & López Droguett, Enrique & Cardemil, José Miguel, 2020. "Operation scheduling in a solar thermal system: A reinforcement learning-based framework," Applied Energy, Elsevier, vol. 268(C).
    11. Xie, Shiwei & Hu, Zhijian & Wang, Jueying & Chen, Yuwei, 2020. "The optimal planning of smart multi-energy systems incorporating transportation, natural gas and active distribution networks," Applied Energy, Elsevier, vol. 269(C).
    12. Julia Vopava & Christian Koczwara & Anna Traupmann & Thomas Kienberger, 2019. "Investigating the Impact of E-Mobility on the Electrical Power Grid Using a Simplified Grid Modelling Approach," Energies, MDPI, vol. 13(1), pages 1-23, December.
    13. Se Hoon Baik & Young Gyu Jin & Yong Tae Yoon, 2018. "Determining Equipment Capacity of Electric Vehicle Charging Station Operator for Profit Maximization," Energies, MDPI, vol. 11(9), pages 1-15, September.
    14. Xiao, Jucheng & He, Guangyu & Fan, Shuai & Zhang, Siyuan & Wu, Qing & Li, Zuyi, 2020. "Decentralized transfer of contingency reserve: Framework and methodology," Applied Energy, Elsevier, vol. 278(C).
    15. Ibrahim, Muhammad Sohail & Dong, Wei & Yang, Qiang, 2020. "Machine learning driven smart electric power systems: Current trends and new perspectives," Applied Energy, Elsevier, vol. 272(C).
    16. Lingling Hu & Junming Zhou & Feng Jiang & Guangming Xie & Jie Hu & Qinglie Mo, 2023. "Research on Optimization of Valley-Filling Charging for Vehicle Network System Based on Multi-Objective Optimization," Sustainability, MDPI, vol. 16(1), pages 1-25, December.
    17. Pinto, Giuseppe & Piscitelli, Marco Savino & Vázquez-Canteli, José Ramón & Nagy, Zoltán & Capozzoli, Alfonso, 2021. "Coordinated energy management for a cluster of buildings through deep reinforcement learning," Energy, Elsevier, vol. 229(C).
    18. Dingyi Lu & Yunqian Lu & Kexin Zhang & Chuyuan Zhang & Shao-Chao Ma, 2023. "An Application Designed for Guiding the Coordinated Charging of Electric Vehicles," Sustainability, MDPI, vol. 15(14), pages 1-16, July.
    19. Zhou, Guangyou & Zhu, Zhiwei & Luo, Sumei, 2022. "Location optimization of electric vehicle charging stations: Based on cost model and genetic algorithm," Energy, Elsevier, vol. 247(C).
    20. Ussama Assad & Muhammad Arshad Shehzad Hassan & Umar Farooq & Asif Kabir & Muhammad Zeeshan Khan & S. Sabahat H. Bukhari & Zain ul Abidin Jaffri & Judit Oláh & József Popp, 2022. "Smart Grid, Demand Response and Optimization: A Critical Review of Computational Methods," Energies, MDPI, vol. 15(6), pages 1-36, March.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jsusta:v:14:y:2022:i:19:p:12608-:d:933090. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.