IDEAS home Printed from https://ideas.repec.org/a/eee/ejores/v284y2020i1p227-239.html
   My bibliography  Save this article

On the dynamic allocation of assets subject to failure

Author

Listed:
  • Ford, Stephen
  • Atkinson, Michael P.
  • Glazebrook, Kevin
  • Jacko, Peter

Abstract

Motivated by situations arising in surveillance, search and monitoring, in this paper we study dynamic allocation of assets which tend to fail, requiring replenishment before once again being available for operation on one of the available tasks. We cast the problem as a closed-system continuous-time Markov decision process with impulsive controls, maximising the long-term time-average sum of per-task reward rates. We then formulate an open-system continuous-time approximative model, whose Lagrangian relaxation yields a decomposition (innovatively extending the restless bandits approach), from which we derive the corresponding Whittle index. We propose two ways of adapting the Whittle index derived from the open-system model to the original closed-system model, a naïve one and a cleverly modified one. We carry out extensive numerical performance evaluation of the original closed-system model, which indicates that the cleverly modified Whittle index rule is nearly optimal, being within 1.6% (0.4%, 0.0%) of the optimal reward rate 75% (50%, 25%) of the time, and significantly superior to uniformly random allocation which is within 22.0% (16.2%, 10.7%) of the optimal reward rate. Our numerical results also suggest that the Whittle index must be cleverly modified when adapting it from the open-system, as the naïve Whittle index rule is not superior to a myopic greedy policy.

Suggested Citation

  • Ford, Stephen & Atkinson, Michael P. & Glazebrook, Kevin & Jacko, Peter, 2020. "On the dynamic allocation of assets subject to failure," European Journal of Operational Research, Elsevier, vol. 284(1), pages 227-239.
  • Handle: RePEc:eee:ejores:v:284:y:2020:i:1:p:227-239
    DOI: 10.1016/j.ejor.2019.12.018
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0377221719310379
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ejor.2019.12.018?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Kyle Y. Lin & Michael P. Atkinson & Kevin D. Glazebrook, 2014. "Optimal patrol to uncover threats in time when detection is imperfect," Naval Research Logistics (NRL), John Wiley & Sons, vol. 61(8), pages 557-576, December.
    2. Schuijbroek, J. & Hampshire, R.C. & van Hoeve, W.-J., 2017. "Inventory rebalancing and vehicle routing in bike sharing systems," European Journal of Operational Research, Elsevier, vol. 257(3), pages 992-1004.
    3. Boyacı, Burak & Zografos, Konstantinos G. & Geroliminis, Nikolas, 2015. "An optimization framework for the development of efficient one-way car-sharing systems," European Journal of Operational Research, Elsevier, vol. 240(3), pages 718-733.
    4. K. D. Glazebrook & C. Kirkbride & J. Ouenniche, 2009. "Index Policies for the Admission Control and Routing of Impatient Customers to Heterogeneous Service Stations," Operations Research, INFORMS, vol. 57(4), pages 975-989, August.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Rob Shone & Vincent A. Knight & Paul R. Harper, 2020. "A conservative index heuristic for routing problems with multiple heterogeneous service facilities," Mathematical Methods of Operations Research, Springer;Gesellschaft für Operations Research (GOR);Nederlands Genootschap voor Besliskunde (NGB), vol. 92(3), pages 511-543, December.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Alain Quilliot & Antoine Sarbinowski & Hélène Toussaint, 2021. "Vehicle driven approaches for non preemptive vehicle relocation with integrated quality criterion in a vehicle sharing system," Annals of Operations Research, Springer, vol. 298(1), pages 445-468, March.
    2. Robin Dee & Armin Fügenschuh & George Kaimakamis, 2021. "The Unit Re-Balancing Problem," Mathematics, MDPI, vol. 9(24), pages 1-19, December.
    3. Çelebi, Dilay & Yörüsün, Aslı & Işık, Hanife, 2018. "Bicycle sharing system design with capacity allocations," Transportation Research Part B: Methodological, Elsevier, vol. 114(C), pages 86-98.
    4. Haider, Zulqarnain & Nikolaev, Alexander & Kang, Jee Eun & Kwon, Changhyun, 2018. "Inventory rebalancing through pricing in public bike sharing systems," European Journal of Operational Research, Elsevier, vol. 270(1), pages 103-117.
    5. Lee, Gaeun & Lee, Jun Soo & Park, Kun Soo, 2024. "Battery swapping, vehicle rebalancing, and staff routing for electric scooter sharing systems," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 186(C).
    6. Fu, Chenyi & Zhu, Ning & Ma, Shoufeng & Liu, Ronghui, 2022. "A two-stage robust approach to integrated station location and rebalancing vehicle service design in bike-sharing systems," European Journal of Operational Research, Elsevier, vol. 298(3), pages 915-938.
    7. Ahmed Kheiri & Alina G. Dragomir & David Mueller & Joaquim Gromicho & Caroline Jagtenberg & Jelke J. Hoorn, 2019. "Tackling a VRP challenge to redistribute scarce equipment within time windows using metaheuristic algorithms," EURO Journal on Transportation and Logistics, Springer;EURO - The Association of European Operational Research Societies, vol. 8(5), pages 561-595, December.
    8. Shi, Ziyi & Xu, Meng & Song, Yancun & Zhu, Zheng, 2024. "Multi-Platform dynamic game and operation of hybrid Bike-Sharing systems based on reinforcement learning," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 181(C).
    9. Boyacı, Burak & Zografos, Konstantinos G., 2019. "Investigating the effect of temporal and spatial flexibility on the performance of one-way electric carsharing systems," Transportation Research Part B: Methodological, Elsevier, vol. 129(C), pages 244-272.
    10. Alessandro Avenali & Yuri Maria Chianese & Graziano Ciucciarelli & Giorgio Grani & Laura Palagi, 2019. "Profit optimization in one-way free float car sharing services: a user based relocation strategy relying on price differentiation and Urban Area Values," DIAG Technical Reports 2019-04, Department of Computer, Control and Management Engineering, Universita' degli Studi di Roma "La Sapienza".
    11. Shuang Liu & Kirsten Maclean & Cathy Robinson, 2019. "A cost-effective framework to prioritise stakeholder participation options," EURO Journal on Decision Processes, Springer;EURO - The Association of European Operational Research Societies, vol. 7(3), pages 221-241, November.
    12. Garrec, Tristan, 2019. "Continuous patrolling and hiding games," European Journal of Operational Research, Elsevier, vol. 277(1), pages 42-51.
    13. Sumitkumar, Rathor & Al-Sumaiti, Ameena Saad, 2024. "Shared autonomous electric vehicle: Towards social economy of energy and mobility from power-transportation nexus perspective," Renewable and Sustainable Energy Reviews, Elsevier, vol. 197(C).
    14. Yan, Pengyu & Yu, Kaize & Chao, Xiuli & Chen, Zhibin, 2023. "An online reinforcement learning approach to charging and order-dispatching optimization for an e-hailing electric vehicle fleet," European Journal of Operational Research, Elsevier, vol. 310(3), pages 1218-1233.
    15. Urtzi Ayesta & Manu K. Gupta & Ina Maria Verloop, 2021. "On the computation of Whittle’s index for Markovian restless bandits," Mathematical Methods of Operations Research, Springer;Gesellschaft für Operations Research (GOR);Nederlands Genootschap voor Besliskunde (NGB), vol. 93(1), pages 179-208, February.
    16. Wagner, Sebastian & Brandt, Tobias & Neumann, Dirk, 2016. "In free float: Developing Business Analytics support for carsharing providers," Omega, Elsevier, vol. 59(PA), pages 4-14.
    17. Zhang, J. & Meng, M. & Wang, David, Z.W., 2019. "A dynamic pricing scheme with negative prices in dockless bike sharing systems," Transportation Research Part B: Methodological, Elsevier, vol. 127(C), pages 201-224.
    18. Golalikhani, Masoud & Oliveira, Beatriz Brito & Carravilla, Maria Antónia & Oliveira, José Fernando & Antunes, António Pais, 2021. "Carsharing: A review of academic literature and business practices toward an integrated decision-support framework," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 149(C).
    19. Saif Benjaafar & Daniel Jiang & Xiang Li & Xiaobo Li, 2022. "Dynamic Inventory Repositioning in On-Demand Rental Networks," Management Science, INFORMS, vol. 68(11), pages 7861-7878, November.
    20. Huang, Kai & An, Kun & Rich, Jeppe & Ma, Wanjing, 2020. "Vehicle relocation in one-way station-based electric carsharing systems: A comparative study of operator-based and user-based methods," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 142(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:ejores:v:284:y:2020:i:1:p:227-239. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/eor .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.