IDEAS home Printed from https://ideas.repec.org/p/tiu/tiutis/d8a325a9-82bf-4d23-839e-264c40acc7fd.html
   My bibliography  Save this paper

Improved design of queuing simulation experiments with highly heteroscedastic responses

Author

Listed:
  • Cheng, R.C.H.
  • Kleijnen, J.P.C.

    (Tilburg University, School of Economics and Management)

Abstract

Simulation experiments for analysing the steady-state behaviour of queueing systems over a range of traffic intensities are considered, and a procedure is presented for improving their design. In such simulations the mean and variance of the response output can increase dramatically with traffic intensity; the design has to be able to cope with this complication. A regression metamodel of the likely mean response is used consisting of two factors, namely, a low-degree polynomial and a factor accounting for the exploding mean as the traffic intensity approaches its saturation. The best choice of traffic intensities at which to make simulation runs depends on the variability of the simulation output, and this variability is estimated using analytical heavy traffic results. The optimal numbers of customers simulated at each traffic intensity are built up using a multistage procedure. The asymptotic properties of the procedure are investigated theoretically. The procedure is shown to be robust and to be more efficient than more naive procedures. A result of note is that even when the range of interest includes high traffic intensities, the highest traffic load simulated should remain well away from its upper limit; but the number of customers simulated should be concentrated at the higher traffic intensities used. Empirical results are included for simulations of a single server queue with different priority rules and for a complicated queueing network. These results support the theoretical results, demonstrating that the proposed procedure can increase the accuracy of the estimated metamodel significantly compared with more naive methods.
(This abstract was borrowed from another version of this item.)
(This abstract was borrowed from another version of this item.)
(This abstract was borrowed from another version of this item.)
(This abstract was borrowed from another version of this item.)
(This abstract was borrowed from another version of this item.)

Suggested Citation

  • Cheng, R.C.H. & Kleijnen, J.P.C., 1996. "Improved design of queuing simulation experiments with highly heteroscedastic responses," Other publications TiSEM d8a325a9-82bf-4d23-839e-2, Tilburg University, School of Economics and Management.
    • Handle: RePEc:tiu:tiutis:d8a325a9-82bf-4d23-839e-264c40acc7fd
    as

    Download full text from publisher

    File URL: https://pure.uvt.nl/ws/portalfiles/portal/1257015/CRCHKJPC5617340.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Martin I. Reiman & Burton Simon & J. Stanford Willie, 1992. "Simterpolation: A Simulation based Interpolation Approximation for Queueing Systems," Operations Research, INFORMS, vol. 40(4), pages 706-723, August.
    2. Kleijnen, J.P.C. & van Groenendaal, W.J.H., 1992. "Two-stage versus sequential sample-size determination in regression analysis of simulation experiments," Other publications TiSEM cac61c9f-0967-4f5a-aab1-9, Tilburg University, School of Economics and Management.
    3. Jack P. C. Kleijnen, 1992. "Regression Metamodels for Simulation with Common Random Numbers: Comparison of Validation Tests and Confidence Intervals," Management Science, INFORMS, vol. 38(8), pages 1164-1185, August.
    4. Ward Whitt, 1989. "Planning Queueing Simulations," Management Science, INFORMS, vol. 35(11), pages 1341-1366, November.
    5. Søren Asmussen, 1992. "Queueing Simulation in Heavy Traffic," Mathematics of Operations Research, INFORMS, vol. 17(1), pages 84-111, February.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Kleijnen, J.P.C. & Sanchez, S.M. & Lucas, T.W. & Cioppa, T.M., 2003. "A User's Guide to the Brave New World of Designing Simulation Experiments," Other publications TiSEM a6910d11-f9bc-4246-b1a7-2, Tilburg University, School of Economics and Management.
    2. Kleijnen, Jack P. C., 2005. "An overview of the design and analysis of simulation experiments for sensitivity analysis," European Journal of Operational Research, Elsevier, vol. 164(2), pages 287-300, July.
    3. Lucy E. Morgan & Luke Rhodes-Leader & Russell R. Barton, 2022. "Reducing and Calibrating for Input Model Bias in Computer Simulation," INFORMS Journal on Computing, INFORMS, vol. 34(4), pages 2368-2382, July.
    4. Feng Yang & Bruce Ankenman & Barry L. Nelson, 2007. "Efficient generation of cycle time‐throughput curves through simulation and metamodeling," Naval Research Logistics (NRL), John Wiley & Sons, vol. 54(1), pages 78-93, February.
    5. Yang, Feng & Liu, Jingang, 2012. "Simulation-based transfer function modeling for transient analysis of general queueing systems," European Journal of Operational Research, Elsevier, vol. 223(1), pages 150-166.
    6. Kleijnen, Jack P. C. & van Beers, Wim C. M., 2005. "Robustness of Kriging when interpolating in random simulation with heterogeneous variances: Some experiments," European Journal of Operational Research, Elsevier, vol. 165(3), pages 826-834, September.
    7. Sungmin Park & John W. Fowler & Gerald T. Mackulak & J. Bert Keats & W. Matthew Carlyle, 2002. "D-Optimal Sequential Experiments for Generating a Simulation-Based Cycle Time-Throughput Curve," Operations Research, INFORMS, vol. 50(6), pages 981-990, December.
    8. Sigal Levy & David Steinberg, 2010. "Computer experiments: a review," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 94(4), pages 311-324, December.
    9. Jack P. C. Kleijnen & Susan M. Sanchez & Thomas W. Lucas & Thomas M. Cioppa, 2005. "State-of-the-Art Review: A User’s Guide to the Brave New World of Designing Simulation Experiments," INFORMS Journal on Computing, INFORMS, vol. 17(3), pages 263-289, August.
    10. Reis dos Santos, Pedro M. & Isabel Reis dos Santos, M., 2009. "Using subsystem linear regression metamodels in stochastic simulation," European Journal of Operational Research, Elsevier, vol. 196(3), pages 1031-1040, August.
    11. Feng Yang & Bruce E. Ankenman & Barry L. Nelson, 2008. "Estimating Cycle Time Percentile Curves for Manufacturing Systems via Simulation," INFORMS Journal on Computing, INFORMS, vol. 20(4), pages 628-643, November.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Cheng, R.C.H. & Kleijnen, J.P.C., 1995. "Optimal design of simulation experiments with nearly saturated queues," Discussion Paper 1995-67, Tilburg University, Center for Economic Research.
    2. Kleijnen, J.P.C., 2007. "Simulation Experiments in Practice : Statistical Design and Regression Analysis," Discussion Paper 2007-30, Tilburg University, Center for Economic Research.
    3. Kleijnen, J.P.C., 2006. "White Noise Assumptions Revisited : Regression Models and Statistical Designs for Simulation Practice," Other publications TiSEM d8c37ad3-f9a5-4824-986d-2, Tilburg University, School of Economics and Management.
    4. Kleijnen, J.P.C., 1997. "Experimental Design for Sensitivity Analysis, Optimization and Validation of Simulation Models," Discussion Paper 1997-52, Tilburg University, Center for Economic Research.
    5. Peter W. Glynn & Rob J. Wang, 2018. "On the rate of convergence to equilibrium for reflected Brownian motion," Queueing Systems: Theory and Applications, Springer, vol. 89(1), pages 165-197, June.
    6. Song, Wheyming Tina, 1996. "On the estimation of optimal batch sizes in the analysis of simulation output," European Journal of Operational Research, Elsevier, vol. 88(2), pages 304-319, January.
    7. Kleijnen, Jack P. C., 2005. "An overview of the design and analysis of simulation experiments for sensitivity analysis," European Journal of Operational Research, Elsevier, vol. 164(2), pages 287-300, July.
    8. Ehsan Mehdad & Jack P.C. Kleijnen, 2018. "Stochastic intrinsic Kriging for simulation metamodeling," Applied Stochastic Models in Business and Industry, John Wiley & Sons, vol. 34(3), pages 322-337, May.
    9. W C M van Beers & J P C Kleijnen, 2003. "Kriging for interpolation in random simulation," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 54(3), pages 255-262, March.
    10. Kleijnen, J.P.C., 1995. "Sensitivity analysis and optimization of system dynamics models : Regression analysis and statistical design of experiments," Other publications TiSEM 87ee6ee0-592c-4204-ac50-6, Tilburg University, School of Economics and Management.
    11. Falkowski, Adrian & Słomiński, Leszek, 2017. "SDEs with constraints driven by semimartingales and processes with bounded p-variation," Stochastic Processes and their Applications, Elsevier, vol. 127(11), pages 3536-3557.
    12. Noah Gans & Garrett van Ryzin, 1999. "Dynamic Vehicle Dispatching: Optimal Heavy Traffic Performance and Practical Insights," Operations Research, INFORMS, vol. 47(5), pages 675-692, October.
    13. Ockerman, Daniel H. & Goldsman, David, 1999. "Student t-tests and compound tests to detect transients in simulated time series," European Journal of Operational Research, Elsevier, vol. 116(3), pages 681-691, August.
    14. Rayadurgam Srikant & Ward Whitt, 1999. "Variance Reduction in Simulations of Loss Models," Operations Research, INFORMS, vol. 47(4), pages 509-523, August.
    15. Kleijnen, Jack P. C. & Sargent, Robert G., 2000. "A methodology for fitting and validating metamodels in simulation," European Journal of Operational Research, Elsevier, vol. 120(1), pages 14-29, January.
    16. Shane G. Henderson & Peter W. Glynn, 2002. "Approximating Martingales for Variance Reduction in Markov Process Simulation," Mathematics of Operations Research, INFORMS, vol. 27(2), pages 253-271, May.
    17. Feng Yang & Bruce E. Ankenman & Barry L. Nelson, 2008. "Estimating Cycle Time Percentile Curves for Manufacturing Systems via Simulation," INFORMS Journal on Computing, INFORMS, vol. 20(4), pages 628-643, November.
    18. David Goldsman & Keebom Kang & Andrew F. Seila, 1999. "Cramér-von Mises Variance Estimators for Simulations," Operations Research, INFORMS, vol. 47(2), pages 299-309, April.
    19. Bruce Ankenman & Barry L. Nelson & Jeremy Staum, 2010. "Stochastic Kriging for Simulation Metamodeling," Operations Research, INFORMS, vol. 58(2), pages 371-382, April.
    20. Shi, Wen & Kleijnen, J.P.C., 2017. "Testing the Assumptions of Sequential Bifurcation for Factor Screening (revision of CentER DP 2015-034)," Other publications TiSEM 763fd6f8-b618-4b06-a284-5, Tilburg University, School of Economics and Management.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:tiu:tiutis:d8a325a9-82bf-4d23-839e-264c40acc7fd. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Richard Broekman (email available below). General contact details of provider: https://www.tilburguniversity.edu/about/schools/economics-and-management/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.