IDEAS home Printed from https://ideas.repec.org/a/eee/reensy/v103y2012icp110-119.html
   My bibliography  Save this article

Road maintenance optimization through a discrete-time semi-Markov decision process

Author

Listed:
  • Zhang, Xueqing
  • Gao, Hui

Abstract

Optimization models are necessary for efficient and cost-effective maintenance of a road network. In this regard, road deterioration is commonly modeled as a discrete-time Markov process such that an optimal maintenance policy can be obtained based on the Markov decision process, or as a renewal process such that an optimal maintenance policy can be obtained based on the renewal theory. However, the discrete-time Markov process cannot capture the real time at which the state transits while the renewal process considers only one state and one maintenance action. In this paper, road deterioration is modeled as a semi-Markov process in which the state transition has the Markov property and the holding time in each state is assumed to follow a discrete Weibull distribution. Based on this semi-Markov process, linear programming models are formulated for both infinite and finite planning horizons in order to derive optimal maintenance policies to minimize the life-cycle cost of a road network. A hypothetical road network is used to illustrate the application of the proposed optimization models. The results indicate that these linear programming models are practical for the maintenance of a road network having a large number of road segments and that they are convenient to incorporate various constraints on the decision process, for example, performance requirements and available budgets. Although the optimal maintenance policies obtained for the road network are randomized stationary policies, the extent of this randomness in decision making is limited. The maintenance actions are deterministic for most states and the randomness in selecting actions occurs only for a few states.

Suggested Citation

  • Zhang, Xueqing & Gao, Hui, 2012. "Road maintenance optimization through a discrete-time semi-Markov decision process," Reliability Engineering and System Safety, Elsevier, vol. 103(C), pages 110-119.
    • Handle: RePEc:eee:reensy:v:103:y:2012:i:c:p:110-119
    DOI: 10.1016/j.ress.2012.03.011
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0951832012000452
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.ress.2012.03.011?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Li, Yuwei & Madanat, Samer, 2002. "A steady-state solution for the optimal pavement resurfacing problem," Transportation Research Part A: Policy and Practice, Elsevier, vol. 36(6), pages 525-535, July.
    2. Samer Madanat & Moshe Ben-Akiva, 1994. "Optimal Inspection and Repair Policies for Infrastructure Facilities," Transportation Science, INFORMS, vol. 28(1), pages 55-62, February.
    3. Love, C. E. & Zhang, Z. G. & Zitron, M. A. & Guo, R., 2000. "A discrete semi-Markov decision model to determine the optimal repair/replacement policy under general repairs," European Journal of Operational Research, Elsevier, vol. 125(2), pages 398-409, September.
    4. William S. Jewell, 1963. "Markov-Renewal Programming. I: Formulation, Finite Return Models," Operations Research, INFORMS, vol. 11(6), pages 938-948, December.
    5. Chen, Dongyan & Trivedi, Kishor S., 2005. "Optimization for condition-based maintenance with semi-Markov decision process," Reliability Engineering and System Safety, Elsevier, vol. 90(1), pages 25-29.
    6. Barker, C.T. & Newby, M.J., 2009. "Optimal non-periodic inspection for a multivariate degradation model," Reliability Engineering and System Safety, Elsevier, vol. 94(1), pages 33-43.
    7. John W. Mamer, 1986. "Successive Approximations for Finite Horizon, Semi-Markov Decision Processes with Application to Asset Liquidation," Operations Research, INFORMS, vol. 34(4), pages 638-644, August.
    8. Dieulle, L. & Berenguer, C. & Grall, A. & Roussignol, M., 2003. "Sequential condition-based maintenance scheduling for a deteriorating system," European Journal of Operational Research, Elsevier, vol. 150(2), pages 451-461, October.
    9. Kamal Golabi & Ram B. Kulkarni & George B. Way, 1982. "A Statewide Pavement Management System," Interfaces, INFORMS, vol. 12(6), pages 5-21, December.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Bian, Zheyong & Bai, Yun & Douglas, W. Scott & Maher, Ali & Liu, Xiang, 2022. "Multi-year planning for optimal navigation channel dredging and dredged material management," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 159(C).
    2. Sánchez-Herguedas, Antonio & Mena-Nieto, Angel & Rodrigo-Muñoz, Francisco, 2021. "A new analytical method to optimise the preventive maintenance interval by using a semi-Markov process and z-transform with an application to marine diesel engines," Reliability Engineering and System Safety, Elsevier, vol. 207(C).
    3. Ossai, Chinedu I. & Boswell, Brian & Davies, Ian J., 2016. "A Markovian approach for modelling the effects of maintenance on downtime and failure risk of wind turbine components," Renewable Energy, Elsevier, vol. 96(PA), pages 775-783.
    4. Nguyen, Hung & Abdel-Mottaleb, Noha & Uddin, Shihab & Zhang, Qiong & Lu, Qing & Zhang, He & Li, Mingyang, 2022. "Joint maintenance planning of deteriorating co-located road and water infrastructures with interdependencies," Reliability Engineering and System Safety, Elsevier, vol. 226(C).
    5. Mizutani, Daijiro & Nakazato, Yuto & Ikushima, Rie & Satsukawa, Koki & Kawasaki, Yosuke & Kuwahara, Masao, 2024. "Optimal intervention policy of emergency storage batteries for expressway transportation systems considering deterioration risk during lead time of replacement," Reliability Engineering and System Safety, Elsevier, vol. 242(C).
    6. Vega, Manuel A. & Hu, Zhen & Fillmore, Travis B. & Smith, Matthew D. & Todd, Michael D., 2021. "A Novel Framework for Integration of Abstracted Inspection Data and Structural Health Monitoring for Damage Prognosis of Miter Gates," Reliability Engineering and System Safety, Elsevier, vol. 211(C).
    7. Shih-Hsien Tseng & Jia-Chen Yu, 2019. "Data-Driven Iron and Steel Inventory Control Policies," Mathematics, MDPI, vol. 7(8), pages 1-15, August.
    8. Li, Yan & Cui, Lirong & Lin, Cong, 2017. "Modeling and analysis for multi-state systems with discrete-time Markov regime-switching," Reliability Engineering and System Safety, Elsevier, vol. 166(C), pages 41-49.
    9. D׳Amico, Guglielmo & Petroni, Filippo & Prattico, Flavio, 2015. "Reliability measures for indexed semi-Markov chains applied to wind energy production," Reliability Engineering and System Safety, Elsevier, vol. 144(C), pages 170-177.
    10. Memarzadeh, Milad & Pozzi, Matteo & Kolter, J. Zico, 2016. "Hierarchical modeling of systems with similar components: A framework for adaptive monitoring and control," Reliability Engineering and System Safety, Elsevier, vol. 153(C), pages 159-169.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Durango-Cohen, Pablo L. & Madanat, Samer M., 2008. "Optimization of inspection and maintenance decisions for infrastructure facilities under performance model uncertainty: A quasi-Bayes approach," Transportation Research Part A: Policy and Practice, Elsevier, vol. 42(8), pages 1074-1085, October.
    2. Lee, Jinwoo & Madanat, Samer, 2015. "A joint bottom-up solution methodology for system-level pavement rehabilitation and reconstruction," Transportation Research Part B: Methodological, Elsevier, vol. 78(C), pages 106-122.
    3. Zhang, Le & Fu, Liangliang & Gu, Weihua & Ouyang, Yanfeng & Hu, Yaohua, 2017. "A general iterative approach for the system-level joint optimization of pavement maintenance, rehabilitation, and reconstruction planning," Transportation Research Part B: Methodological, Elsevier, vol. 105(C), pages 378-400.
    4. Zhao, Yunfei & Huang, Linan & Smidts, Carol & Zhu, Quanyan, 2020. "Finite-horizon semi-Markov game for time-sensitive attack response and probabilistic risk assessment in nuclear power plants," Reliability Engineering and System Safety, Elsevier, vol. 201(C).
    5. Alaswad, Suzan & Xiang, Yisha, 2017. "A review on condition-based maintenance optimization models for stochastically deteriorating system," Reliability Engineering and System Safety, Elsevier, vol. 157(C), pages 54-63.
    6. Sathaye, Nakul & Madanat, Samer, 2012. "A bottom-up optimal pavement resurfacing solution approach for large-scale networks," Transportation Research Part B: Methodological, Elsevier, vol. 46(4), pages 520-528.
    7. Sathaye, Nakul & Madanat, Samer, 2011. "A bottom-up solution for the multi-facility optimal pavement resurfacing problem," Transportation Research Part B: Methodological, Elsevier, vol. 45(7), pages 1004-1017, August.
    8. Yonghui Huang & Xianping Guo & Xinyuan Song, 2011. "Performance Analysis for Controlled Semi-Markov Systems with Application to Maintenance," Journal of Optimization Theory and Applications, Springer, vol. 150(2), pages 395-415, August.
    9. Durango, Pablo L. & Madanat, Samer M., 2002. "Optimal maintenance and repair policies in infrastructure management under uncertain facility deterioration rates: an adaptive control approach," Transportation Research Part A: Policy and Practice, Elsevier, vol. 36(9), pages 763-778, November.
    10. Zhi-Chun Li & Dian Sheng, 2014. "Pavement rehabilitation scheduling and toll pricing under different regulatory regimes," Annals of Operations Research, Springer, vol. 217(1), pages 337-355, June.
    11. Lam, Ji Ye Janet & Banjevic, Dragan, 2015. "A myopic policy for optimal inspection scheduling for condition based maintenance," Reliability Engineering and System Safety, Elsevier, vol. 144(C), pages 1-11.
    12. Sayyideh Mehri Mousavi & Hesam Shams & Shahrzad Ahmadi, 2017. "Simultaneous optimization of repair and control-limit policy in condition-based maintenance," Journal of Intelligent Manufacturing, Springer, vol. 28(1), pages 245-254, January.
    13. Zhao, Xuejing & Fouladirad, Mitra & Bérenguer, Christophe & Bordes, Laurent, 2010. "Condition-based inspection/replacement policies for non-monotone deteriorating systems with environmental covariates," Reliability Engineering and System Safety, Elsevier, vol. 95(8), pages 921-934.
    14. Prasenjit Mondal, 2020. "Computing semi-stationary optimal policies for multichain semi-Markov decision processes," Annals of Operations Research, Springer, vol. 287(2), pages 843-865, April.
    15. P Vaidya & M Rausand, 2011. "Remaining useful life, technical health, and life extension," Journal of Risk and Reliability, , vol. 225(2), pages 219-231, June.
    16. Zengqiang Jiang & Dragan Banjevic & Mingcheng E & Bing Li, 2017. "Optimizing the re-profiling policy regarding metropolitan train wheels based on a semi-Markov decision process," Journal of Risk and Reliability, , vol. 231(5), pages 495-507, October.
    17. de Jonge, Bram & Scarf, Philip A., 2020. "A review on maintenance optimization," European Journal of Operational Research, Elsevier, vol. 285(3), pages 805-824.
    18. Seyedshohadaie, S. Reza & Damnjanovic, Ivan & Butenko, Sergiy, 2010. "Risk-based maintenance and rehabilitation decisions for transportation infrastructure networks," Transportation Research Part A: Policy and Practice, Elsevier, vol. 44(4), pages 236-248, May.
    19. Seites-Rundlett, William & Bashar, Mohammad Z. & Torres-Machi, Cristina & Corotis, Ross B., 2022. "Combined evidence model to enhance pavement condition prediction from highly uncertain sensor data," Reliability Engineering and System Safety, Elsevier, vol. 217(C).
    20. Xinhua Mao & Changwei Yuan & Jiahua Gan, 2019. "Incorporating Dynamic Traffic Distribution into Pavement Maintenance Optimization Model," Sustainability, MDPI, vol. 11(9), pages 1-15, April.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:reensy:v:103:y:2012:i:c:p:110-119. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: https://www.journals.elsevier.com/reliability-engineering-and-system-safety .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.