IDEAS home Printed from https://ideas.repec.org/a/eee/ejores/v213y2011i1p124-133.html
   My bibliography  Save this article

The optimal control of just-in-time-based production and distribution systems and performance comparisons with optimized pull systems

Author

Listed:
  • Ohno, Katsuhisa

Abstract

In just-in-time (JIT) production systems, there is both input stock in the form of parts and output stock in the form of product at each stage. These activities are controlled by production-ordering and withdrawal kanbans. This paper discusses a discrete-time optimal control problem in a multistage JIT-based production and distribution system with stochastic demand and capacity, developed to minimize the expected total cost per unit of time. The problem can be formulated as an undiscounted Markov decision process (UMDP); however, the curse of dimensionality makes it very difficult to find an exact solution. The author proposes a new neuro-dynamic programming (NDP) algorithm, the simulation-based modified policy iteration method (SBMPIM), to solve the optimal control problem. The existing NDP algorithms and SBMPIM are numerically compared with a traditional UMDP algorithm for a single-stage JIT production system. It is shown that all NDP algorithms except the SBMPIM fail to converge to an optimal control. Additionally, a new algorithm for finding the optimal parameters of pull systems is proposed. Numerical comparisons between near-optimal controls computed using the SBMPIM and optimized pull systems are conducted for three-stage JIT-based production and distribution systems. UMDPs with 42 million states are solved using the SBMPIM. The pull systems discussed are the kanban, base stock, CONWIP, hybrid and extended kanban.

Suggested Citation

  • Ohno, Katsuhisa, 2011. "The optimal control of just-in-time-based production and distribution systems and performance comparisons with optimized pull systems," European Journal of Operational Research, Elsevier, vol. 213(1), pages 124-133, August.
    • Handle: RePEc:eee:ejores:v:213:y:2011:i:1:p:124-133
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0377-2217(11)00216-5
    Download Restriction: Full text for ScienceDirect subscribers only
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. C. Duri & Y. Frein & M. Di Mascolo, 2000. "Comparison among three pull control policies: kanban, base stock, and generalized kanban," Annals of Operations Research, Springer, vol. 93(1), pages 41-69, January.
    2. J.-M. Bollon & M. Di Mascolo & Y. Frein, 2004. "Unified Framework for Describing and Comparing the Dynamics of Pull Control Policies," Annals of Operations Research, Springer, vol. 125(1), pages 21-45, January.
    3. Katsuhisa Ohno & Kuniyoshi Ichiki, 1987. "Computing Optimal Policies for Controlled Tandem Queueing Systems," Operations Research, INFORMS, vol. 35(1), pages 121-126, February.
    4. Karaesmen, Fikri & Dallery, Yves, 2000. "A performance comparison of pull type control mechanisms for multi-stage manufacturing," International Journal of Production Economics, Elsevier, vol. 68(1), pages 59-71, October.
    5. Tapas K. Das & Abhijit Gosavi & Sridhar Mahadevan & Nicholas Marchalleck, 1999. "Solving Semi-Markov Decision Problems Using Average Reward Reinforcement Learning," Management Science, INFORMS, vol. 45(4), pages 560-574, April.
    6. C Alabas & F Altiparmak & B Dengiz, 2002. "A comparison of the performance of artificial intelligence techniques for optimizing the number of kanbans," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 53(8), pages 907-914, August.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Albrecht, Martin, 2014. "Determining near optimal base-stock levels in two-stage general inventory systems," European Journal of Operational Research, Elsevier, vol. 232(2), pages 342-349.
    2. Ohno, Katsuhisa & Boh, Toshitaka & Nakade, Koichi & Tamura, Takayoshi, 2016. "New approximate dynamic programming algorithms for large-scale undiscounted Markov decision processes and their application to optimize a production and distribution system," European Journal of Operational Research, Elsevier, vol. 249(1), pages 22-31.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Matta, Andrea & Dallery, Yves & Di Mascolo, Maria, 2005. "Analysis of assembly systems controlled with kanbans," European Journal of Operational Research, Elsevier, vol. 166(2), pages 310-336, October.
    2. Ohno, Katsuhisa & Boh, Toshitaka & Nakade, Koichi & Tamura, Takayoshi, 2016. "New approximate dynamic programming algorithms for large-scale undiscounted Markov decision processes and their application to optimize a production and distribution system," European Journal of Operational Research, Elsevier, vol. 249(1), pages 22-31.
    3. B Dengiz & C Alabas-Uslu & O Dengiz, 2009. "Optimization of manufacturing systems using a neural network metamodel with a new training approach," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 60(9), pages 1191-1197, September.
    4. Diana Sánchez-Partida & Rodolfo Rodríguez-Méndez & José Luis Martínez-Flores & Santiago-Omar Caballero-Morales, 2018. "Implementation of Continuous Flow in the Cabinet Process at the Schneider Electric Plant in Tlaxcala, Mexico," Interfaces, INFORMS, vol. 48(6), pages 566-577, November.
    5. Li, Xueping & Wang, Jiao & Sawhney, Rapinder, 2012. "Reinforcement learning for joint pricing, lead-time and scheduling decisions in make-to-order systems," European Journal of Operational Research, Elsevier, vol. 221(1), pages 99-109.
    6. Prasenjit Mondal, 2016. "On undiscounted semi-Markov decision processes with absorbing states," Mathematical Methods of Operations Research, Springer;Gesellschaft für Operations Research (GOR);Nederlands Genootschap voor Besliskunde (NGB), vol. 83(2), pages 161-177, April.
    7. Colledani, Marcello & Tolio, Tullio, 2009. "Performance evaluation of production systems monitored by statistical process control and off-line inspections," International Journal of Production Economics, Elsevier, vol. 120(2), pages 348-367, August.
    8. Liberopoulos, George & Koukoumialos, Stelios, 2005. "Tradeoffs between base stock levels, numbers of kanbans, and planned supply lead times in production/inventory systems with advance demand information," International Journal of Production Economics, Elsevier, vol. 96(2), pages 213-232, May.
    9. Barlow, E. & Bedford, T. & Revie, M. & Tan, J. & Walls, L., 2021. "A performance-centred approach to optimising maintenance of complex systems," European Journal of Operational Research, Elsevier, vol. 292(2), pages 579-595.
    10. Manafzadeh Dizbin, Nima & Tan, Barış, 2020. "Optimal control of production-inventory systems with correlated demand inter-arrival and processing times," International Journal of Production Economics, Elsevier, vol. 228(C).
    11. Behice Meltem Kayhan & Gokalp Yildiz, 2023. "Reinforcement learning applications to machine scheduling problems: a comprehensive literature review," Journal of Intelligent Manufacturing, Springer, vol. 34(3), pages 905-929, March.
    12. L. Jianyong & Z. Xiaobo, 2004. "On Average Reward Semi-Markov Decision Processes with a General Multichain Structure," Mathematics of Operations Research, INFORMS, vol. 29(2), pages 339-352, May.
    13. Zheng, Rui & Zhao, Xufeng & Hu, Chaoming & Ren, Xiangyun, 2023. "A repair-replacement policy for a system subject to missions of random types and random durations," Reliability Engineering and System Safety, Elsevier, vol. 232(C).
    14. Asefeh Hasani Goodarzi & Seyed Hessameddin Zegordi, 2020. "Vehicle routing problem in a kanban controlled supply chain system considering cross-docking strategy," Operational Research, Springer, vol. 20(4), pages 2397-2425, December.
    15. Yamamoto, Hidehiko & Abu Qudeiri, Jaber & Marui, Etsuo, 2008. "Definition of FTL with bypass lines and its simulator for buffer size decision," International Journal of Production Economics, Elsevier, vol. 112(1), pages 18-25, March.
    16. Subba Rao, S. & Gunasekaran, A. & Goyal, S. K. & Martikainen, T., 1998. "Waiting line model applications in manufacturing," International Journal of Production Economics, Elsevier, vol. 54(1), pages 1-28, January.
    17. Yang, Hongbing & Li, Wenchao & Wang, Bin, 2021. "Joint optimization of preventive maintenance and production scheduling for multi-state production systems based on reinforcement learning," Reliability Engineering and System Safety, Elsevier, vol. 214(C).
    18. Panagiotis D. Paraschos & Georgios K. Koulinas & Dimitrios E. Koulouriotis, 2024. "A reinforcement learning/ad-hoc planning and scheduling mechanism for flexible and sustainable manufacturing systems," Flexible Services and Manufacturing Journal, Springer, vol. 36(3), pages 714-736, September.
    19. Nha-Nghi Cruz & Hans Daduna, 2019. "Optimal capacity allocation in a production–inventory system with base stock," Annals of Operations Research, Springer, vol. 277(2), pages 329-344, June.
    20. Peter Seele & Claus Dierksmeier & Reto Hofstetter & Mario D. Schultz, 2021. "Mapping the Ethicality of Algorithmic Pricing: A Review of Dynamic and Personalized Pricing," Journal of Business Ethics, Springer, vol. 170(4), pages 697-719, May.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:ejores:v:213:y:2011:i:1:p:124-133. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/eor .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.