IDEAS home Printed from https://ideas.repec.org/a/eee/ejores/v213y2011i1p124-133.html
   My bibliography  Save this article

The optimal control of just-in-time-based production and distribution systems and performance comparisons with optimized pull systems

Author

Listed:
  • Ohno, Katsuhisa

Abstract

In just-in-time (JIT) production systems, there is both input stock in the form of parts and output stock in the form of product at each stage. These activities are controlled by production-ordering and withdrawal kanbans. This paper discusses a discrete-time optimal control problem in a multistage JIT-based production and distribution system with stochastic demand and capacity, developed to minimize the expected total cost per unit of time. The problem can be formulated as an undiscounted Markov decision process (UMDP); however, the curse of dimensionality makes it very difficult to find an exact solution. The author proposes a new neuro-dynamic programming (NDP) algorithm, the simulation-based modified policy iteration method (SBMPIM), to solve the optimal control problem. The existing NDP algorithms and SBMPIM are numerically compared with a traditional UMDP algorithm for a single-stage JIT production system. It is shown that all NDP algorithms except the SBMPIM fail to converge to an optimal control. Additionally, a new algorithm for finding the optimal parameters of pull systems is proposed. Numerical comparisons between near-optimal controls computed using the SBMPIM and optimized pull systems are conducted for three-stage JIT-based production and distribution systems. UMDPs with 42 million states are solved using the SBMPIM. The pull systems discussed are the kanban, base stock, CONWIP, hybrid and extended kanban.

Suggested Citation

  • Ohno, Katsuhisa, 2011. "The optimal control of just-in-time-based production and distribution systems and performance comparisons with optimized pull systems," European Journal of Operational Research, Elsevier, vol. 213(1), pages 124-133, August.
    • Handle: RePEc:eee:ejores:v:213:y:2011:i:1:p:124-133
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0377-2217(11)00216-5
    Download Restriction: Full text for ScienceDirect subscribers only
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. C. Duri & Y. Frein & M. Di Mascolo, 2000. "Comparison among three pull control policies: kanban, base stock, and generalized kanban," Annals of Operations Research, Springer, vol. 93(1), pages 41-69, January.
    2. J.-M. Bollon & M. Di Mascolo & Y. Frein, 2004. "Unified Framework for Describing and Comparing the Dynamics of Pull Control Policies," Annals of Operations Research, Springer, vol. 125(1), pages 21-45, January.
    3. Katsuhisa Ohno & Kuniyoshi Ichiki, 1987. "Computing Optimal Policies for Controlled Tandem Queueing Systems," Operations Research, INFORMS, vol. 35(1), pages 121-126, February.
    4. Karaesmen, Fikri & Dallery, Yves, 2000. "A performance comparison of pull type control mechanisms for multi-stage manufacturing," International Journal of Production Economics, Elsevier, vol. 68(1), pages 59-71, October.
    5. Tapas K. Das & Abhijit Gosavi & Sridhar Mahadevan & Nicholas Marchalleck, 1999. "Solving Semi-Markov Decision Problems Using Average Reward Reinforcement Learning," Management Science, INFORMS, vol. 45(4), pages 560-574, April.
    6. C Alabas & F Altiparmak & B Dengiz, 2002. "A comparison of the performance of artificial intelligence techniques for optimizing the number of kanbans," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 53(8), pages 907-914, August.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Albrecht, Martin, 2014. "Determining near optimal base-stock levels in two-stage general inventory systems," European Journal of Operational Research, Elsevier, vol. 232(2), pages 342-349.
    2. Ohno, Katsuhisa & Boh, Toshitaka & Nakade, Koichi & Tamura, Takayoshi, 2016. "New approximate dynamic programming algorithms for large-scale undiscounted Markov decision processes and their application to optimize a production and distribution system," European Journal of Operational Research, Elsevier, vol. 249(1), pages 22-31.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Matta, Andrea & Dallery, Yves & Di Mascolo, Maria, 2005. "Analysis of assembly systems controlled with kanbans," European Journal of Operational Research, Elsevier, vol. 166(2), pages 310-336, October.
    2. Ohno, Katsuhisa & Boh, Toshitaka & Nakade, Koichi & Tamura, Takayoshi, 2016. "New approximate dynamic programming algorithms for large-scale undiscounted Markov decision processes and their application to optimize a production and distribution system," European Journal of Operational Research, Elsevier, vol. 249(1), pages 22-31.
    3. B Dengiz & C Alabas-Uslu & O Dengiz, 2009. "Optimization of manufacturing systems using a neural network metamodel with a new training approach," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 60(9), pages 1191-1197, September.
    4. Yang, Hongbing & Li, Wenchao & Wang, Bin, 2021. "Joint optimization of preventive maintenance and production scheduling for multi-state production systems based on reinforcement learning," Reliability Engineering and System Safety, Elsevier, vol. 214(C).
    5. Diana Sánchez-Partida & Rodolfo Rodríguez-Méndez & José Luis Martínez-Flores & Santiago-Omar Caballero-Morales, 2018. "Implementation of Continuous Flow in the Cabinet Process at the Schneider Electric Plant in Tlaxcala, Mexico," Interfaces, INFORMS, vol. 48(6), pages 566-577, November.
    6. Li, Xueping & Wang, Jiao & Sawhney, Rapinder, 2012. "Reinforcement learning for joint pricing, lead-time and scheduling decisions in make-to-order systems," European Journal of Operational Research, Elsevier, vol. 221(1), pages 99-109.
    7. Panagiotis D. Paraschos & Georgios K. Koulinas & Dimitrios E. Koulouriotis, 2024. "A reinforcement learning/ad-hoc planning and scheduling mechanism for flexible and sustainable manufacturing systems," Flexible Services and Manufacturing Journal, Springer, vol. 36(3), pages 714-736, September.
    8. Nha-Nghi Cruz & Hans Daduna, 2019. "Optimal capacity allocation in a production–inventory system with base stock," Annals of Operations Research, Springer, vol. 277(2), pages 329-344, June.
    9. Prasenjit Mondal, 2016. "On undiscounted semi-Markov decision processes with absorbing states," Mathematical Methods of Operations Research, Springer;Gesellschaft für Operations Research (GOR);Nederlands Genootschap voor Besliskunde (NGB), vol. 83(2), pages 161-177, April.
    10. Colledani, Marcello & Tolio, Tullio, 2009. "Performance evaluation of production systems monitored by statistical process control and off-line inspections," International Journal of Production Economics, Elsevier, vol. 120(2), pages 348-367, August.
    11. Peter Seele & Claus Dierksmeier & Reto Hofstetter & Mario D. Schultz, 2021. "Mapping the Ethicality of Algorithmic Pricing: A Review of Dynamic and Personalized Pricing," Journal of Business Ethics, Springer, vol. 170(4), pages 697-719, May.
    12. Liberopoulos, George & Koukoumialos, Stelios, 2005. "Tradeoffs between base stock levels, numbers of kanbans, and planned supply lead times in production/inventory systems with advance demand information," International Journal of Production Economics, Elsevier, vol. 96(2), pages 213-232, May.
    13. Lage Junior, Muris & Godinho Filho, Moacir, 2010. "Variations of the kanban system: Literature review and classification," International Journal of Production Economics, Elsevier, vol. 125(1), pages 13-21, May.
    14. Herzberg, Meir & Yechiali, Uri, 1996. "A K-step look-ahead analysis of value iteration algorithms for Markov decision processes," European Journal of Operational Research, Elsevier, vol. 88(3), pages 622-636, February.
    15. Giannoccaro, Ilaria & Pontrandolfo, Pierpaolo, 2002. "Inventory management in supply chains: a reinforcement learning approach," International Journal of Production Economics, Elsevier, vol. 78(2), pages 153-161, July.
    16. Barlow, E. & Bedford, T. & Revie, M. & Tan, J. & Walls, L., 2021. "A performance-centred approach to optimising maintenance of complex systems," European Journal of Operational Research, Elsevier, vol. 292(2), pages 579-595.
    17. Onyeocha, Chukwunonyelum Emmanuel & Wang, Jiayi & Khoury, Joseph & Geraghty, John, 2015. "A comparison of HK-CONWIP and BK-CONWIP control strategies in a multi-product manufacturing system," Operations Research Perspectives, Elsevier, vol. 2(C), pages 137-149.
    18. Manafzadeh Dizbin, Nima & Tan, Barış, 2020. "Optimal control of production-inventory systems with correlated demand inter-arrival and processing times," International Journal of Production Economics, Elsevier, vol. 228(C).
    19. Schütz, Hans-Jörg & Kolisch, Rainer, 2012. "Approximate dynamic programming for capacity allocation in the service industry," European Journal of Operational Research, Elsevier, vol. 218(1), pages 239-250.
    20. Andriotis, C.P. & Papakonstantinou, K.G., 2019. "Managing engineering systems with large state and action spaces through deep reinforcement learning," Reliability Engineering and System Safety, Elsevier, vol. 191(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:ejores:v:213:y:2011:i:1:p:124-133. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/eor .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.