IDEAS home Printed from https://ideas.repec.org/a/gam/jsusta/v16y2024i16p7180-d1460861.html
   My bibliography  Save this article

Optimal Electric Vehicle Battery Management Using Q-learning for Sustainability

Author

Listed:
  • Pannee Suanpang

    (Department of Information Technology, Faculty of Science & Technology, Suan Dusit University, Bangkok 10300, Thailand)

  • Pitchaya Jamjuntr

    (Department of Electronic and Telecommunication, Faculty of Engineering, King Mongkut’s University of Technology Thonburi, Bangkok 10140, Thailand)

Abstract

This paper presents a comprehensive study on the optimization of electric vehicle (EV) battery management using Q-learning, a powerful reinforcement learning technique. As the demand for electric vehicles continues to grow, there is an increasing need for efficient battery-management strategies to extend battery life, enhance performance, and minimize operating costs. The primary objective of this research is to develop and assess a Q-learning-based approach to address the intricate challenges associated with EV battery management. This paper starts by elucidating the key challenges inherent in EV battery management and discusses the potential advantages of incorporating Q-learning into the optimization process. Leveraging Q-learning’s capacity to make dynamic decisions based on past experiences, we introduce a framework that considers state-of-charge, state-of-health, charging infrastructure, and driving patterns as critical state variables. The methodology is detailed, encompassing the selection of state, action, reward, and policy, with the training process informed by real-world data. Our experimental results underscore the efficacy of the Q-learning approach in optimizing battery management. Through the utilization of Q-learning, we achieve substantial enhancements in battery performance, energy efficiency, and overall EV sustainability. A comparative analysis with traditional battery-management strategies is presented to highlight the superior performance of our approach. A comparative analysis with traditional battery-management strategies is presented to highlight the superior performance of our approach, demonstrating compelling results. Our Q-learning-based method achieves a significant 15% improvement in energy efficiency compared to conventional methods, translating into substantial savings in operational costs and reduced environmental impact. Moreover, we observe a remarkable 20% increase in battery lifespan, showcasing the effectiveness of our approach in enhancing long-term sustainability and user satisfaction. This paper significantly enriches the body of knowledge on EV battery management by introducing an innovative, data-driven approach. It provides a comprehensive comparative analysis and applies novel methodologies for practical implementation. The implications of this research extend beyond the academic sphere to practical applications, fostering the broader adoption of electric vehicles and contributing to a reduction in environmental impact while enhancing user satisfaction.

Suggested Citation

  • Pannee Suanpang & Pitchaya Jamjuntr, 2024. "Optimal Electric Vehicle Battery Management Using Q-learning for Sustainability," Sustainability, MDPI, vol. 16(16), pages 1-50, August.
  • Handle: RePEc:gam:jsusta:v:16:y:2024:i:16:p:7180-:d:1460861
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2071-1050/16/16/7180/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/2071-1050/16/16/7180/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Ioannis Vardopoulos & Maria Papoui-Evangelou & Bogdana Nosova & Luca Salvati, 2023. "Smart ‘Tourist Cities’ Revisited: Culture-Led Urban Sustainability and the Global Real Estate Market," Sustainability, MDPI, vol. 15(5), pages 1-26, February.
    2. Dokrak Insan & Wattanapong Rakwichian & Parichart Rachapradit & Prapita Thanarak, 2022. "The Business Analysis of Electric Vehicle Charging Stations to Power Environmentally Friendly Tourism: A Case Study of the Khao Kho Route in Thailand," International Journal of Energy Economics and Policy, Econjournals, vol. 12(6), pages 102-111, November.
    3. Al-Alawi, Baha M. & Bradley, Thomas H., 2013. "Total cost of ownership, payback, and consumer preference modeling of plug-in hybrid electric vehicles," Applied Energy, Elsevier, vol. 103(C), pages 488-506.
    4. Oussama Ouramdane & Elhoussin Elbouchikhi & Yassine Amirat & Franck Le Gall & Ehsan Sedgh Gooya, 2022. "Home Energy Management Considering Renewable Resources, Energy Storage, and an Electric Vehicle as a Backup," Energies, MDPI, vol. 15(8), pages 1-20, April.
    5. Kantapich Preedakorn & David Butler & Jörn Mehnen, 2023. "Challenges for the Adoption of Electric Vehicles in Thailand: Potential Impacts, Barriers, and Public Policy Recommendations," Sustainability, MDPI, vol. 15(12), pages 1-21, June.
    6. Chang Liu & Chuanchen Bi, 2022. "Current Situation and Trend of Electric Vehicle Battery Business - Take CATL as an example," Technium Social Sciences Journal, Technium Science, vol. 38(1), pages 324-336, December.
    7. Ruoran Xu, 2023. "Framework for Building Smart Tourism Big Data Mining Model for Sustainable Development," Sustainability, MDPI, vol. 15(6), pages 1-16, March.
    8. Carlo Corinaldesi & Georg Lettner & Daniel Schwabeneder & Amela Ajanovic & Hans Auer, 2020. "Impact of Different Charging Strategies for Electric Vehicles in an Austrian Office Site," Energies, MDPI, vol. 13(22), pages 1-17, November.
    9. Konstantina Dimitriadou & Nick Rigogiannis & Symeon Fountoukidis & Faidra Kotarela & Anastasios Kyritsis & Nick Papanikolaou, 2023. "Current Trends in Electric Vehicle Charging Infrastructure; Opportunities and Challenges in Wireless Charging Integration," Energies, MDPI, vol. 16(4), pages 1-28, February.
    10. Choon Kit Chan & Chi Hong Chung & Jeyagopi Raman, 2023. "Optimizing Thermal Management System in Electric Vehicle Battery Packs for Sustainable Transportation," Sustainability, MDPI, vol. 15(15), pages 1-14, August.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Anjie Lu & Jianguo Zhou & Minglei Qin & Danchen Liu, 2024. "Considering Carbon–Hydrogen Coupled Integrated Energy Systems: A Pathway to Sustainable Energy Transition in China Under Uncertainty," Sustainability, MDPI, vol. 16(21), pages 1-32, October.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Cordiner, Stefano & Galeotti, Matteo & Mulone, Vincenzo & Nobile, Matteo & Rocco, Vittorio, 2016. "Trip-based SOC management for a plugin hybrid electric vehicle," Applied Energy, Elsevier, vol. 164(C), pages 891-905.
    2. Anne Christine Lusk & Xin Li & Qiming Liu, 2023. "If the Government Pays for Full Home-Charger Installation, Would Affordable-Housing and Middle-Income Residents Buy Electric Vehicles?," Sustainability, MDPI, vol. 15(5), pages 1-26, March.
    3. Luiz Almeida & Ana Soares & Pedro Moura, 2023. "A Systematic Review of Optimization Approaches for the Integration of Electric Vehicles in Public Buildings," Energies, MDPI, vol. 16(13), pages 1-26, June.
    4. Al-Alawi, Baha M. & Coker, Alexander D., 2018. "Multi-criteria decision support system with negotiation process for vehicle technology selection," Energy, Elsevier, vol. 157(C), pages 278-296.
    5. Green, Erin H. & Skerlos, Steven J. & Winebrake, James J., 2014. "Increasing electric vehicle policy efficiency and effectiveness by reducing mainstream market bias," Energy Policy, Elsevier, vol. 65(C), pages 562-566.
    6. Dumortier, Jerome & Zhang, Fengxiu & Marron, John, 2017. "State and federal fuel taxes: The road ahead for U.S. infrastructure funding," Transport Policy, Elsevier, vol. 53(C), pages 39-49.
    7. Huseynov, Samir & Palma, Marco A., 2018. "Does California’s LCFS Reduce CO2 Emissions?," 2018 Annual Meeting, August 5-7, Washington, D.C. 274200, Agricultural and Applied Economics Association.
    8. Hutchinson, Tim & Burgess, Stuart & Herrmann, Guido, 2014. "Current hybrid-electric powertrain architectures: Applying empirical design data to life cycle assessment and whole-life cost analysis," Applied Energy, Elsevier, vol. 119(C), pages 314-329.
    9. Zhiwen Zhang & Jie Tang & Jiyuan Zhang & Tianci Zhang, 2024. "Research on Energy Hierarchical Management and Optimal Control of Compound Power Electric Vehicle," Energies, MDPI, vol. 17(6), pages 1-22, March.
    10. Li, Ke & Chen, Jixin & Sun, Xiaodong & Lei, Gang & Cai, Yingfeng & Chen, Long, 2023. "Application of wireless energy transmission technology in electric vehicles," Renewable and Sustainable Energy Reviews, Elsevier, vol. 184(C).
    11. Alya AlHammadi & Nasser Al-Saif & Ameena Saad Al-Sumaiti & Mousa Marzband & Tareefa Alsumaiti & Ehsan Heydarian-Forushani, 2022. "Techno-Economic Analysis of Hybrid Renewable Energy Systems Designed for Electric Vehicle Charging: A Case Study from the United Arab Emirates," Energies, MDPI, vol. 15(18), pages 1-20, September.
    12. Christian Montaleza & Paul Arévalo & Jimmy Gallegos & Francisco Jurado, 2024. "Enhancing Energy Management Strategies for Extended-Range Electric Vehicles through Deep Q-Learning and Continuous State Representation," Energies, MDPI, vol. 17(2), pages 1-21, January.
    13. Subhojit Dawn & Gummadi Srinivasa Rao & M. L. N. Vital & K. Dhananjay Rao & Faisal Alsaif & Mohammed H. Alsharif, 2023. "Profit Extension of a Wind-Integrated Competitive Power System by Vehicle-to-Grid Integration and UPFC Placement," Energies, MDPI, vol. 16(18), pages 1-24, September.
    14. Nuno Rego & Rui Castro & Carlos Santos Silva, 2023. "Assessment of Current Smart House Solutions: The Case of Portugal," Energies, MDPI, vol. 16(22), pages 1-23, November.
    15. Ibrahim Mutambik, 2024. "Culturally Informed Technology: Assessing Its Importance in the Transition to Smart Sustainable Cities," Sustainability, MDPI, vol. 16(10), pages 1-20, May.
    16. Yuzhu Zhang & Hao Xu, 2024. "Reconfigurable-Intelligent-Surface-Enhanced Dynamic Resource Allocation for the Social Internet of Electric Vehicle Charging Networks with Causal-Structure-Based Reinforcement Learning," Future Internet, MDPI, vol. 16(5), pages 1-20, May.
    17. Ioannis Vardopoulos & Sophia Ioannides & Marios Georgiou & Irene Voukkali & Luca Salvati & Yannis E. Doukas, 2023. "Shaping Sustainable Cities: A Long-Term GIS-Emanated Spatial Analysis of Settlement Growth and Planning in a Coastal Mediterranean European City," Sustainability, MDPI, vol. 15(14), pages 1-24, July.
    18. Makena Coffman & Paul Bernstein & Sherilyn Wee, 2017. "Electric vehicles revisited: a review of factors that affect adoption," Transport Reviews, Taylor & Francis Journals, vol. 37(1), pages 79-93, January.
    19. Jakov Topić & Jure Soldo & Filip Maletić & Branimir Škugor & Joško Deur, 2020. "Virtual Simulation of Electric Bus Fleets for City Bus Transport Electrification Planning," Energies, MDPI, vol. 13(13), pages 1-24, July.
    20. Wee, Sherilyn & Coffman, Makena & Allen, Scott, 2020. "EV driver characteristics: Evidence from Hawaii," Transport Policy, Elsevier, vol. 87(C), pages 33-40.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jsusta:v:16:y:2024:i:16:p:7180-:d:1460861. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.