IDEAS home Printed from https://ideas.repec.org/a/gam/jeners/v15y2022i12p4504-d843510.html
   My bibliography  Save this article

Carbon-Neutral Cellular Network Operation Based on Deep Reinforcement Learning

Author

Listed:
  • Hojin Kim

    (Department of Electronic Engineering, Sogang University, Seoul 04107, Korea)

  • Jaewoo So

    (Department of Electronic Engineering, Sogang University, Seoul 04107, Korea)

  • Hongseok Kim

    (Department of Electronic Engineering, Sogang University, Seoul 04107, Korea)

Abstract

With the exponential growth of traffic demand, ultra-dense networks have been proposed to cope with such demand. However, the increase of the network density causes more power use, and carbon neutrality becomes an important concept to decrease the emission and production of carbon. In cellular networks, emission and production can be directly related to power consumption. In this paper, we aim to achieve carbon neutrality, as well as maximize network capacity with given power constraints. We assume that base stations have their own renewable energy sources to generate power. For carbon neutrality, we control the power consumption for base stations by adjusting the transmission power and switching off base stations to balance the generated power. Given such power constraints, our goal is to maximize the network capacity or the rate achievable for the users. To this end, we carefully design the objective function and then propose an efficient Deep Deterministic Policy Gradient (DDPG) algorithm to maximize the objective. A simulation is conducted to validate the benefits of the proposed method. Extensive simulations show that the proposed method can achieve carbon neutrality and provide a better rate than other baseline schemes. Specifically, up to a 63% gain in the reward value was observed in the DDPG algorithm compared to other baseline schemes.

Suggested Citation

  • Hojin Kim & Jaewoo So & Hongseok Kim, 2022. "Carbon-Neutral Cellular Network Operation Based on Deep Reinforcement Learning," Energies, MDPI, vol. 15(12), pages 1-13, June.
  • Handle: RePEc:gam:jeners:v:15:y:2022:i:12:p:4504-:d:843510
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/1996-1073/15/12/4504/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/1996-1073/15/12/4504/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Yohwan Choi & Hongseok Kim, 2016. "Optimal Scheduling of Energy Storage System for Self-Sustainable Base Station Operation Considering Battery Wear-Out Cost," Energies, MDPI, vol. 9(6), pages 1-19, June.
    2. Jaeik Jeong & Hongseok Kim, 2016. "On Optimal Cell Flashing for Reducing Delay and Saving Energy in Wireless Networks," Energies, MDPI, vol. 9(10), pages 1-13, September.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Kim, Minsoo & Park, Taeseop & Jeong, Jaeik & Kim, Hongseok, 2023. "Stochastic optimization of home energy management system using clustered quantile scenario reduction," Applied Energy, Elsevier, vol. 349(C).
    2. Jungsub Sim & Minsoo Kim & Dongjoo Kim & Hongseok Kim, 2021. "Cloud Energy Storage System Operation with Capacity P2P Transaction," Energies, MDPI, vol. 14(2), pages 1-13, January.
    3. Bhatraj, Anudeep & Salomons, Elad & Housh, Mashor, 2024. "An optimization model for simultaneous design and operation of renewable energy microgrids integrated with water supply systems," Applied Energy, Elsevier, vol. 361(C).
    4. Boram Kim & Sunghwan Bae & Hongseok Kim, 2017. "Optimal Energy Scheduling and Transaction Mechanism for Multiple Microgrids," Energies, MDPI, vol. 10(4), pages 1-17, April.
    5. Seung-Ju Lee & Yourim Yoon, 2020. "Electricity Cost Optimization in Energy Storage Systems by Combining a Genetic Algorithm with Dynamic Programming," Mathematics, MDPI, vol. 8(9), pages 1-20, September.
    6. Luis Galván & Juan M. Navarro & Eduardo Galván & Juan M. Carrasco & Andrés Alcántara, 2019. "Optimal Scheduling of Energy Storage Using A New Priority-Based Smart Grid Control Method," Energies, MDPI, vol. 12(4), pages 1-17, February.
    7. Ding, Yi & Shao, Changzheng & Yan, Jinyue & Song, Yonghua & Zhang, Chi & Guo, Chuangxin, 2018. "Economical flexibility options for integrating fluctuating wind energy in power systems: The case of China," Applied Energy, Elsevier, vol. 228(C), pages 426-436.
    8. Hong-Chao Gao & Joon-Ho Choi & Sang-Yun Yun & Hak-Ju Lee & Seon-Ju Ahn, 2018. "Optimal Scheduling and Real-Time Control Schemes of Battery Energy Storage System for Microgrids Considering Contract Demand and Forecast Uncertainty," Energies, MDPI, vol. 11(6), pages 1-15, May.
    9. Chong Chen & Xuan Zhou & Xiaowei Yang & Zhiheng He & Zhuo Li & Zhengtian Li & Xiangning Lin & Ting Wen & Yixin Zhuo & Ning Tong, 2018. "Collaborative Optimal Pricing and Day-Ahead and Intra-Day Integrative Dispatch of the Active Distribution Network with Multi-Type Active Loads," Energies, MDPI, vol. 11(4), pages 1-22, April.
    10. Yong-Rae Lee & Hyung-Joon Kim & Mun-Kyeom Kim, 2021. "Optimal Operation Scheduling Considering Cycle Aging of Battery Energy Storage Systems on Stochastic Unit Commitments in Microgrids," Energies, MDPI, vol. 14(2), pages 1-21, January.
    11. Byung Moo Lee & Youngok Kim, 2016. "Design of an Energy Efficient Future Base Station with Large-Scale Antenna System," Energies, MDPI, vol. 9(12), pages 1-17, December.
    12. Byuk-Keun Jo & Seungmin Jung & Gilsoo Jang, 2019. "Feasibility Analysis of Behind-the-Meter Energy Storage System According to Public Policy on an Electricity Charge Discount Program," Sustainability, MDPI, vol. 11(1), pages 1-17, January.
    13. Ahmed Belila & Mohamed Benbouzid & El-Madjid Berkouk & Yassine Amirat, 2018. "On Energy Management Control of a PV-Diesel-ESS Based Microgrid in a Stand-Alone Context," Energies, MDPI, vol. 11(8), pages 1-23, August.
    14. Nadya Noorfatima & Yejin Yang & Jaesung Jung & Jun-Sung Kim, 2021. "Congestion Management by Allocating Network Use Cost for the Small-Scale DER Aggregator Market in South Korea," Energies, MDPI, vol. 14(12), pages 1-18, June.
    15. Byeongkwan Kang & Kyuhee Jang & Sounghoan Park & Myeong-in Choi & Sehyun Park, 2018. "Energy Storage System Control Algorithm by Operating Target Power to Improve Energy Sustainability of Smart Home," Sustainability, MDPI, vol. 10(1), pages 1-16, January.
    16. Khorasany, Mohsen & Razzaghi, Reza & Shokri Gazafroudi, Amin, 2021. "Two-stage mechanism design for energy trading of strategic agents in energy communities," Applied Energy, Elsevier, vol. 295(C).
    17. Jangkyum Kim & Yohwan Choi & Seunghyoung Ryu & Hongseok Kim, 2017. "Robust Operation of Energy Storage System with Uncertain Load Profiles," Energies, MDPI, vol. 10(4), pages 1-15, March.
    18. Byung Moo Lee & Youngok Kim, 2017. "Interference-Aware PAPR Reduction Scheme to Increase the Energy Efficiency of Large-Scale MIMO-OFDM Systems," Energies, MDPI, vol. 10(8), pages 1-16, August.
    19. Minsoo Kim & Kangsan Kim & Hyungeun Choi & Seonjeong Lee & Hongseok Kim, 2019. "Practical Operation Strategies for Energy Storage System under Uncertainty," Energies, MDPI, vol. 12(6), pages 1-14, March.
    20. Jeong, Jaeik & Kim, Hongseok, 2021. "DeepComp: Deep reinforcement learning based renewable energy error compensable forecasting," Applied Energy, Elsevier, vol. 294(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jeners:v:15:y:2022:i:12:p:4504-:d:843510. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.