IDEAS home Printed from https://ideas.repec.org/a/eee/reensy/v199y2020ics0951832019302753.html
   My bibliography  Save this article

Partially observable Markov decision processes for optimal operations of gas transmission networks

Author

Listed:
  • Compare, Michele
  • Baraldi, Piero
  • Marelli, Paolo
  • Zio, Enrico

Abstract

We develop a decision-support framework based on Partially Observable Markov Decision Processes (POMDPs) for the management of Gas Transmission Networks (GTNs) operations, encoding realistic degradation state estimations provided by Prognostics and Health Management (PHM) systems, while considering demand variations and the effects of the management decisions on the GTN degradation evolution. This Operation and Maintenance (O&M) framework allows optimally operating a GTN. Furthermore, the economic impact of using PHM systems with different accuracy levels can be estimated. The approach is shown with reference to a GTN of the literature.

Suggested Citation

  • Compare, Michele & Baraldi, Piero & Marelli, Paolo & Zio, Enrico, 2020. "Partially observable Markov decision processes for optimal operations of gas transmission networks," Reliability Engineering and System Safety, Elsevier, vol. 199(C).
    • Handle: RePEc:eee:reensy:v:199:y:2020:i:c:s0951832019302753
    DOI: 10.1016/j.ress.2020.106893
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0951832019302753
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.ress.2020.106893?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. William S. Lovejoy, 1991. "Computationally Feasible Bounds for Partially Observed Markov Decision Processes," Operations Research, INFORMS, vol. 39(1), pages 162-175, February.
    2. Compare, Michele & Bellani, Luca & Zio, Enrico, 2017. "Reliability model of a component equipped with PHM capabilities," Reliability Engineering and System Safety, Elsevier, vol. 168(C), pages 4-11.
    3. Edward J. Sondik, 1978. "The Optimal Control of Partially Observable Markov Processes over the Infinite Horizon: Discounted Costs," Operations Research, INFORMS, vol. 26(2), pages 282-304, April.
    4. Moghaddass, Ramin & Zuo, Ming J., 2014. "An integrated framework for online diagnostic and prognostic health monitoring using a multistate deterioration process," Reliability Engineering and System Safety, Elsevier, vol. 124(C), pages 92-104.
    5. Bianco, Vincenzo & Scarpa, Federico & Tagliafico, Luca A., 2014. "Scenario analysis of nonresidential natural gas consumption in Italy," Applied Energy, Elsevier, vol. 113(C), pages 392-403.
    6. Pham, Hoang & Wang, Hongzhou, 1996. "Imperfect maintenance," European Journal of Operational Research, Elsevier, vol. 94(3), pages 425-438, November.
    7. Vilkkumaa, Eeva & Liesiö, Juuso & Salo, Ahti, 2014. "Optimal strategies for selecting project portfolios using uncertain value estimates," European Journal of Operational Research, Elsevier, vol. 233(3), pages 772-783.
    8. Praks, Pavel & Kopustinskas, Vytis & Masera, Marcelo, 2015. "Probabilistic modelling of security of supply in gas networks and evaluation of new infrastructure," Reliability Engineering and System Safety, Elsevier, vol. 144(C), pages 254-264.
    9. Kabirian, Alireza & Hemmati, Mohammad Reza, 2007. "A strategic planning model for natural gas transmission networks," Energy Policy, Elsevier, vol. 35(11), pages 5656-5670, November.
    10. Su, Huai & Zhang, Jinjun & Zio, Enrico & Yang, Nan & Li, Xueyi & Zhang, Zongjie, 2018. "An integrated systemic method for supply reliability assessment of natural gas pipeline networks," Applied Energy, Elsevier, vol. 209(C), pages 489-501.
    11. Ding, Fangfang & Tian, Zhigang & Zhao, Fuqiong & Xu, Hao, 2018. "An integrated approach for wind turbine gearbox fatigue life prediction considering instantaneously varying load conditions," Renewable Energy, Elsevier, vol. 129(PA), pages 260-270.
    12. Peretti, A. & Toth, P., 1982. "Optimization of a pipe-line for the natural gas transportation," European Journal of Operational Research, Elsevier, vol. 11(3), pages 247-254, November.
    13. Memarzadeh, Milad & Pozzi, Matteo, 2016. "Value of information in sequential decision making: Component inspection, permanent monitoring and system-level scheduling," Reliability Engineering and System Safety, Elsevier, vol. 154(C), pages 137-151.
    14. Michele Compare & Luca Bellani & Enrico Zio, 2017. "Availability Model of a PHM-Equipped Component," Post-Print hal-01652232, HAL.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Chen, Qian & Zuo, Lili & Wu, Changchun & Li, Yun & Hua, Kaixun & Mehrtash, Mahdi & Cao, Yankai, 2022. "Optimization of compressor standby schemes for gas transmission pipeline systems based on gas delivery reliability," Reliability Engineering and System Safety, Elsevier, vol. 221(C).
    2. Song, Chaolin & Zhang, Chi & Shafieezadeh, Abdollah & Xiao, Rucheng, 2022. "Value of information analysis in non-stationary stochastic decision environments: A reliability-assisted POMDP approach," Reliability Engineering and System Safety, Elsevier, vol. 217(C).
    3. Fan, Lin & Su, Huai & Wang, Wei & Zio, Enrico & Zhang, Li & Yang, Zhaoming & Peng, Shiliang & Yu, Weichao & Zuo, Lili & Zhang, Jinjun, 2022. "A systematic method for the optimization of gas supply reliability in natural gas pipeline network based on Bayesian networks and deep reinforcement learning," Reliability Engineering and System Safety, Elsevier, vol. 225(C).
    4. Guo, Chunhui & Liang, Zhenglin, 2022. "A predictive Markov decision process for optimizing inspection and maintenance strategies of partially observable multi-state systems," Reliability Engineering and System Safety, Elsevier, vol. 226(C).
    5. Zhang, Aibo & Wu, Shengnan & Fan, Dongming & Xie, Min & Cai, Baoping & Liu, Yiliu, 2022. "Adaptive testing policy for multi-state systems with application to the degrading final elements in safety-instrumented systems," Reliability Engineering and System Safety, Elsevier, vol. 221(C).
    6. Wang, Siqi & Zhao, Xian & Wu, Congshan & Wang, Xiaoyue, 2023. "Joint optimization of multi-stage component reassignment and preventive maintenance for balanced systems considering imperfect maintenance," Reliability Engineering and System Safety, Elsevier, vol. 237(C).
    7. Arismendi, Renny & Barros, Anne & Grall, Antoine, 2021. "Piecewise deterministic Markov process for condition-based maintenance models — Application to critical infrastructures with discrete-state deterioration," Reliability Engineering and System Safety, Elsevier, vol. 212(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Mancuso, A. & Compare, M. & Salo, A. & Zio, E., 2021. "Optimal Prognostics and Health Management-driven inspection and maintenance strategies for industrial systems," Reliability Engineering and System Safety, Elsevier, vol. 210(C).
    2. Fan, Lin & Su, Huai & Wang, Wei & Zio, Enrico & Zhang, Li & Yang, Zhaoming & Peng, Shiliang & Yu, Weichao & Zuo, Lili & Zhang, Jinjun, 2022. "A systematic method for the optimization of gas supply reliability in natural gas pipeline network based on Bayesian networks and deep reinforcement learning," Reliability Engineering and System Safety, Elsevier, vol. 225(C).
    3. Zhu, Jianhua & Peng, Yan & Gong, Zhuping & Sun, Yanming & Lai, Chaoan & Wang, Qing & Zhu, Xiaojun & Gan, Zhongxue, 2019. "Dynamic analysis of SNG and PNG supply: The stability and robustness view #," Energy, Elsevier, vol. 185(C), pages 717-729.
    4. Beyza, Jesus & Ruiz-Paredes, Hector F. & Garcia-Paricio, Eduardo & Yusta, Jose M., 2020. "Assessing the criticality of interdependent power and gas systems using complex networks and load flow techniques," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 540(C).
    5. Xuejie Li & Yuan Xue & Yuxing Li & Qingshan Feng, 2022. "An Optimization Method for a Compressor Standby Scheme Based on Reliability Analysis," Energies, MDPI, vol. 15(21), pages 1-16, November.
    6. Üster, Halit & Dilaveroğlu, Şebnem, 2014. "Optimization for design and operation of natural gas transmission networks," Applied Energy, Elsevier, vol. 133(C), pages 56-69.
    7. Yu, Weichao & Song, Shangfei & Li, Yichen & Min, Yuan & Huang, Weihe & Wen, Kai & Gong, Jing, 2018. "Gas supply reliability assessment of natural gas transmission pipeline systems," Energy, Elsevier, vol. 162(C), pages 853-870.
    8. Hao Zhang, 2010. "Partially Observable Markov Decision Processes: A Geometric Technique and Analysis," Operations Research, INFORMS, vol. 58(1), pages 214-228, February.
    9. Compare, Michele & Antonello, Federico & Pinciroli, Luca & Zio, Enrico, 2022. "A general model for life-cycle cost analysis of Condition-Based Maintenance enabled by PHM capabilities," Reliability Engineering and System Safety, Elsevier, vol. 224(C).
    10. Compare, Michele & Bellani, Luca & Zio, Enrico, 2019. "Optimal allocation of prognostics and health management capabilities to improve the reliability of a power transmission network," Reliability Engineering and System Safety, Elsevier, vol. 184(C), pages 164-180.
    11. Emenike, Scholastica N. & Falcone, Gioia, 2020. "A review on energy supply chain resilience through optimization," Renewable and Sustainable Energy Reviews, Elsevier, vol. 134(C).
    12. Williams, Byron K., 2011. "Resolving structural uncertainty in natural resources management using POMDP approaches," Ecological Modelling, Elsevier, vol. 222(5), pages 1092-1102.
    13. Peter Lustenberger & Felix Schumacher & Matteo Spada & Peter Burgherr & Bozidar Stojadinovic, 2019. "Assessing the Performance of the European Natural Gas Network for Selected Supply Disruption Scenarios Using Open-Source Information," Energies, MDPI, vol. 12(24), pages 1-28, December.
    14. Cabrales, Sergio & Valencia, Carlos & Ramírez, Carlos & Ramírez, Andrés & Herrera, Juan & Cadena, Angela, 2022. "Stochastic cost-benefit analysis to assess new infrastructure to improve the reliability of the natural gas supply," Energy, Elsevier, vol. 246(C).
    15. Deep, Akash & Zhou, Shiyu & Veeramani, Dharmaraj & Chen, Yong, 2023. "Partially observable Markov decision process-based optimal maintenance planning with time-dependent observations," European Journal of Operational Research, Elsevier, vol. 311(2), pages 533-544.
    16. Yu, Weichao & Huang, Weihe & Wen, Yunhao & Li, Yichen & Liu, Hongfei & Wen, Kai & Gong, Jing & Lu, Yanan, 2021. "An integrated gas supply reliability evaluation method of the large-scale and complex natural gas pipeline network based on demand-side analysis," Reliability Engineering and System Safety, Elsevier, vol. 212(C).
    17. Zhou, Xingyuan & van Gelder, P.H.A.J.M. & Liang, Yongtu & Zhang, Haoran, 2020. "An integrated methodology for the supply reliability analysis of multi-product pipeline systems under pumps failure," Reliability Engineering and System Safety, Elsevier, vol. 204(C).
    18. Chen, Qian & Zuo, Lili & Wu, Changchun & Cao, Yankai & Bu, Yaran & Chen, Feng & Sadiq, Rehan, 2021. "Supply reliability assessment of a gas pipeline network under stochastic demands," Reliability Engineering and System Safety, Elsevier, vol. 209(C).
    19. Piotr Kosowski & Katarzyna Kosowska, 2021. "Valuation of Energy Security for Natural Gas—European Example," Energies, MDPI, vol. 14(9), pages 1-19, May.
    20. Yu, Weichao & Gong, Jing & Song, Shangfei & Huang, Weihe & Li, Yichen & Zhang, Jie & Hong, Bingyuan & Zhang, Ye & Wen, Kai & Duan, Xu, 2019. "Gas supply reliability analysis of a natural gas pipeline system considering the effects of underground gas storages," Applied Energy, Elsevier, vol. 252(C), pages 1-1.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:reensy:v:199:y:2020:i:c:s0951832019302753. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: https://www.journals.elsevier.com/reliability-engineering-and-system-safety .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.