IDEAS home Printed from https://ideas.repec.org/a/eee/ejores/v281y2020i2p286-298.html
   My bibliography  Save this article

An aggregation-based approximate dynamic programming approach for the periodic review model with random yield

Author

Listed:
  • Voelkel, Michael A.
  • Sachs, Anna-Lena
  • Thonemann, Ulrich W.

Abstract

A manufacturer places orders periodically for products that are shipped from a supplier. During transit, orders get damaged with some probability, that is, the order is subject to random yield. The manufacturer has the option to track orders to receive information on damages and to potentially place additional orders. Without tracking, the manufacturer identifies potential damages after the order has arrived. With tracking, the manufacturer is informed about the damage when it occurs and can respond to this information. We model the problem as a dynamic program with stochastic demand, tracking cost, and random yield. For small problem sizes, we provide an adjusted value iteration algorithm that finds the optimal solution. For moderate problem sizes, we propose a novel aggregation-based approximate dynamic programming (ADP) algorithm and provide solutions for instances for which it is not possible to obtain optimal solutions. For large problem sizes, we develop a heuristic that takes tracking costs into account. In a computational study, we analyze the performance of our approaches. We observe that our ADP algorithm achieves savings of up to 16% compared to existing heuristics. Our heuristic outperforms existing ones by up to 8.1%. We show that dynamic tracking reduces costs compared to tracking always or never and identify savings of up to 3.2%.

Suggested Citation

  • Voelkel, Michael A. & Sachs, Anna-Lena & Thonemann, Ulrich W., 2020. "An aggregation-based approximate dynamic programming approach for the periodic review model with random yield," European Journal of Operational Research, Elsevier, vol. 281(2), pages 286-298.
  • Handle: RePEc:eee:ejores:v:281:y:2020:i:2:p:286-298
    DOI: 10.1016/j.ejor.2019.08.035
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0377221719307052
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ejor.2019.08.035?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Hugo P. Simão & Jeff Day & Abraham P. George & Ted Gifford & John Nienow & Warren B. Powell, 2009. "An Approximate Dynamic Programming Algorithm for Large-Scale Fleet Management: A Case Application," Transportation Science, INFORMS, vol. 43(2), pages 178-197, May.
    2. Ketzenberg, Michael E. & Rosenzweig, Eve D. & Marucheck, Ann E. & Metters, Richard D., 2007. "A framework for the value of information in inventory replenishment," European Journal of Operational Research, Elsevier, vol. 182(3), pages 1230-1250, November.
    3. Abhijit Gosavi, 2009. "Reinforcement Learning: A Tutorial Survey and Recent Advances," INFORMS Journal on Computing, INFORMS, vol. 21(2), pages 178-192, May.
    4. White, Chelsea C. & Cheong, Taesu, 2012. "In-transit perishable product inspection," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 48(1), pages 310-330.
    5. Michael Ketzenberg & Jacqueline Bloemhof & Gary Gaukler, 2015. "Managing Perishables with Time and Temperature History," Production and Operations Management, Production and Operations Management Society, vol. 24(1), pages 54-70, January.
    6. Ketzenberg, Michael & Gaukler, Gary & Salin, Victoria, 2018. "Expiration dates and order quantities for perishables," European Journal of Operational Research, Elsevier, vol. 266(2), pages 569-584.
    7. Warren B. Powell, 2016. "Perspectives of approximate dynamic programming," Annals of Operations Research, Springer, vol. 241(1), pages 319-356, June.
    8. Richard Bellman, 1957. "On a Dynamic Programming Approach to the Caterer Problem--I," Management Science, INFORMS, vol. 3(3), pages 270-278, April.
    9. Inderfurth, K. & Kiesmüller, G.P., 2015. "Exact and heuristic linear-inflation policies for an inventory model with random yield and arbitrary lead times," European Journal of Operational Research, Elsevier, vol. 245(1), pages 109-120.
    10. Gaukler, Gary & Ketzenberg, Michael & Salin, Victoria, 2017. "Establishing dynamic expiration dates for perishables: An application of rfid and sensor technology," International Journal of Production Economics, Elsevier, vol. 193(C), pages 617-632.
    11. Woonghee Tim Huh & Mahesh Nagarajan, 2010. "Technical note ---Linear Inflation Rules for the Random Yield Problem: Analysis and Computations," Operations Research, INFORMS, vol. 58(1), pages 244-251, February.
    12. Candace Arai Yano & Hau L. Lee, 1995. "Lot Sizing with Random Yields: A Review," Operations Research, INFORMS, vol. 43(2), pages 311-334, April.
    13. Mordechai Henig & Yigal Gerchak, 1990. "The Structure of Periodic Review Policies in the Presence of Random Yield," Operations Research, INFORMS, vol. 38(4), pages 634-643, August.
    14. Andrei Sleptchenko & M. Eric Johnson, 2015. "Maintaining Secure and Reliable Distributed Control Systems," INFORMS Journal on Computing, INFORMS, vol. 27(1), pages 103-117, February.
    15. Ngai, E.W.T. & Moon, Karen K.L. & Riggins, Frederick J. & Yi, Candace Y., 2008. "RFID research: An academic literature review (1995-2005) and future research directions," International Journal of Production Economics, Elsevier, vol. 112(2), pages 510-520, April.
    16. Srinivas Bollapragada & Thomas E. Morton, 1999. "Myopic Heuristics for the Random Yield Problem," Operations Research, INFORMS, vol. 47(5), pages 713-722, October.
    17. G. P. Kiesmüller & K. Inderfurth, 2018. "Approaches for periodic inventory control under random production yield and fixed setup cost," OR Spectrum: Quantitative Approaches in Management, Springer;Gesellschaft für Operations Research e.V., vol. 40(2), pages 449-477, March.
    18. Sarac, Aysegul & Absi, Nabil & Dauzère-Pérès, Stéphane, 2010. "A literature review on the impact of RFID technologies on supply chain management," International Journal of Production Economics, Elsevier, vol. 128(1), pages 77-95, November.
    19. Dettenbach, Marcus & Thonemann, Ulrich W., 2015. "The value of real time yield information in multi-stage inventory systems – Exact and heuristic approaches," European Journal of Operational Research, Elsevier, vol. 240(1), pages 72-83.
    20. G. P. Kiesmüller & K. Inderfurth, 2018. "Publisher Correction: Approaches for periodic inventory control under random production yield and fixed setup cost," OR Spectrum: Quantitative Approaches in Management, Springer;Gesellschaft für Operations Research e.V., vol. 40(2), pages 479-479, March.
    21. Antoine Sauré & Jonathan Patrick & Martin L. Puterman, 2015. "Simulation-Based Approximate Policy Iteration with Generalized Logistic Functions," INFORMS Journal on Computing, INFORMS, vol. 27(3), pages 579-595, August.
    22. Danja Sonntag & Gudrun P. Kiesmüller, 2017. "The Influence of Quality Inspections on the Optimal Safety Stock Level," Production and Operations Management, Production and Operations Management Society, vol. 26(7), pages 1284-1298, July.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Jake Clarkson & Michael A. Voelkel & Anna‐Lena Sachs & Ulrich W. Thonemann, 2023. "The periodic review model with independent age‐dependent lifetimes," Production and Operations Management, Production and Operations Management Society, vol. 32(3), pages 813-828, March.
    2. B. C. Giri & J. K. Majhi & S. Bardhan & K. S. Chaudhuri, 2021. "Coordinating a three-level supply chain with effort and price dependent stochastic demand under random yield," Annals of Operations Research, Springer, vol. 307(1), pages 175-206, December.
    3. Gorria, Carlos & Lezaun, Mikel & López, F. Javier, 2022. "Performance measures of nonstationary inventory models for perishable products under the EWA policy," European Journal of Operational Research, Elsevier, vol. 303(3), pages 1137-1150.
    4. Cervellera, Cristiano, 2023. "Optimized ensemble value function approximation for dynamic programming," European Journal of Operational Research, Elsevier, vol. 309(2), pages 719-730.
    5. Pan, Wenting & So, Kut C. & Xiao, Guang, 2022. "Benefits of backup sourcing for components in assembly systems under supply uncertainty," European Journal of Operational Research, Elsevier, vol. 302(1), pages 158-171.
    6. Peter Berling & Danja R. Sonntag, 2022. "Inventory control in production–inventory systems with random yield and rework: The unit‐tracking approach," Production and Operations Management, Production and Operations Management Society, vol. 31(6), pages 2628-2645, June.
    7. Chen-Yang Cheng & Pourya Pourhejazy & Tzu-Li Chen, 2023. "Computationally efficient approximate dynamic programming for multi-site production capacity planning with uncertain demands," Flexible Services and Manufacturing Journal, Springer, vol. 35(3), pages 797-837, September.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Peter Berling & Danja R. Sonntag, 2022. "Inventory control in production–inventory systems with random yield and rework: The unit‐tracking approach," Production and Operations Management, Production and Operations Management Society, vol. 31(6), pages 2628-2645, June.
    2. Sonntag, Danja & Kiesmüller, Gudrun P., 2018. "Disposal versus rework – Inventory control in a production system with random yield," European Journal of Operational Research, Elsevier, vol. 267(1), pages 138-149.
    3. Dettenbach, Marcus & Thonemann, Ulrich W., 2015. "The value of real time yield information in multi-stage inventory systems – Exact and heuristic approaches," European Journal of Operational Research, Elsevier, vol. 240(1), pages 72-83.
    4. G. P. Kiesmüller & K. Inderfurth, 2018. "Approaches for periodic inventory control under random production yield and fixed setup cost," OR Spectrum: Quantitative Approaches in Management, Springer;Gesellschaft für Operations Research e.V., vol. 40(2), pages 449-477, March.
    5. Saurabh Bansal & Mahesh Nagarajan, 2017. "Product Portfolio Management with Production Flexibility in Agribusiness," Operations Research, INFORMS, vol. 65(4), pages 914-930, August.
    6. Danja Sonntag & Gudrun P. Kiesmüller, 2016. "The shape of the yield and its impact on inventory decisions," 4OR, Springer, vol. 14(4), pages 405-415, December.
    7. Jake Clarkson & Michael A. Voelkel & Anna‐Lena Sachs & Ulrich W. Thonemann, 2023. "The periodic review model with independent age‐dependent lifetimes," Production and Operations Management, Production and Operations Management Society, vol. 32(3), pages 813-828, March.
    8. Barιş Ata & Deishin Lee & Erkut Sönmez, 2019. "Dynamic Volunteer Staffing in Multicrop Gleaning Operations," Operations Research, INFORMS, vol. 67(2), pages 295-314, March.
    9. Jinzhi Bu & Xiting Gong & Dacheng Yao, 2019. "Technical Note—Constant-Order Policies for Lost-Sales Inventory Models with Random Supply Functions: Asymptotics and Heuristic," Operations Research, INFORMS, vol. 68(4), pages 1063-1073, July.
    10. Pan, Wenting & So, Kut C. & Xiao, Guang, 2022. "Benefits of backup sourcing for components in assembly systems under supply uncertainty," European Journal of Operational Research, Elsevier, vol. 302(1), pages 158-171.
    11. Song, Yuyue & Wang, Yunzeng, 2017. "Periodic review inventory systems with fixed order cost and uniform random yield," European Journal of Operational Research, Elsevier, vol. 257(1), pages 106-117.
    12. Gaukler, Gary M. & Zuidwijk, Rob A. & Ketzenberg, Michael E., 2023. "The value of time and temperature history information for the distribution of perishables," European Journal of Operational Research, Elsevier, vol. 310(2), pages 627-639.
    13. Kutzner, Sarah C. & Kiesmüller, Gudrun P., 2013. "Optimal control of an inventory-production system with state-dependent random yield," European Journal of Operational Research, Elsevier, vol. 227(3), pages 444-452.
    14. Alamri, Adel A. & Syntetos, Aris A., 2018. "Beyond LIFO and FIFO: Exploring an Allocation-In-Fraction-Out (AIFO) policy in a two-warehouse inventory model," International Journal of Production Economics, Elsevier, vol. 206(C), pages 33-45.
    15. Woonghee Tim Huh & Mahesh Nagarajan, 2010. "Technical note ---Linear Inflation Rules for the Random Yield Problem: Analysis and Computations," Operations Research, INFORMS, vol. 58(1), pages 244-251, February.
    16. Gel, Esma S. & Salman, F. Sibel, 2022. "Dynamic ordering decisions with approximate learning of supply yield uncertainty," International Journal of Production Economics, Elsevier, vol. 243(C).
    17. Burak Kazaz, 2004. "Production Planning Under Yield and Demand Uncertainty with Yield-Dependent Cost and Price," Manufacturing & Service Operations Management, INFORMS, vol. 6(3), pages 209-224, October.
    18. Mart, Turgut & Duran, Serhan & Bakal, İsmail Serdar, 2013. "Tactical inventory and backorder decisions for systems with predictable production yield," International Journal of Production Economics, Elsevier, vol. 143(2), pages 294-303.
    19. Yang, Ya & Chi, Huihui & Tang, Ou & Zhou, Wei & Fan, Tijun, 2019. "Cross perishable effect on optimal inventory preservation control," European Journal of Operational Research, Elsevier, vol. 276(3), pages 998-1012.
    20. Jain, Tarun & Hazra, Jishnu, 2017. "Sourcing strategies under agglomeration economies, capacity risks and retail competition," International Journal of Production Economics, Elsevier, vol. 191(C), pages 311-322.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:ejores:v:281:y:2020:i:2:p:286-298. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/eor .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.