IDEAS home Printed from https://ideas.repec.org/a/eee/ejores/v170y2006i1p120-131.html
   My bibliography  Save this article

Validation of regression metamodels in simulation: Bootstrap approach

Author

Listed:
  • Kleijnen, Jack P.C.
  • Deflandre, David

Abstract

No abstract is available for this item.

Suggested Citation

  • Kleijnen, Jack P.C. & Deflandre, David, 2006. "Validation of regression metamodels in simulation: Bootstrap approach," European Journal of Operational Research, Elsevier, vol. 170(1), pages 120-131, April.
  • Handle: RePEc:eee:ejores:v:170:y:2006:i:1:p:120-131
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0377-2217(04)00457-6
    Download Restriction: Full text for ScienceDirect subscribers only
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Jack P. C. Kleijnen & Russell C. H. Cheng & Bert Bettonvil, 2001. "Validation of Trace-Driven Simulation Models: Bootstrap Tests," Management Science, INFORMS, vol. 47(11), pages 1533-1538, November.
    2. W C M van Beers & J P C Kleijnen, 2003. "Kriging for interpolation in random simulation," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 54(3), pages 255-262, March.
    3. O F Demirel & T R Willemain, 2002. "Generation of simulation input scenarios using bootstrap methods," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 53(1), pages 69-78, January.
    4. Jack P. C. Kleijnen, 1992. "Regression Metamodels for Simulation with Common Random Numbers: Comparison of Validation Tests and Confidence Intervals," Management Science, INFORMS, vol. 38(8), pages 1164-1185, August.
    5. Kleijnen, J.P.C. & Cheng, R.C.H. & Bettonvil, B.W.M., 2001. "Validation of trace-driven simulation models : Bootstrapped tests," Other publications TiSEM 13d22f9a-c1e2-45a7-b96a-9, Tilburg University, School of Economics and Management.
    6. Kleijnen, Jack P. C. & Sargent, Robert G., 2000. "A methodology for fitting and validating metamodels in simulation," European Journal of Operational Research, Elsevier, vol. 120(1), pages 14-29, January.
    7. Ohtani, Kazuhiro, 2000. "Bootstrapping R2 and adjusted R2 in regression analysis," Economic Modelling, Elsevier, vol. 17(4), pages 473-483, December.
    8. van der Genugten, B.B., 1982. "The asymptotic behaviour of the estimated generalized least squares method in the linear regression model," Research Memorandum FEW 111, Tilburg University, School of Economics and Management.
    9. van der Genugten, B.B., 1982. "The asymptotic behaviour of the estimated generalized least squares method in the linear regression model," Other publications TiSEM e481bca4-b12f-427b-bc8e-6, Tilburg University, School of Economics and Management.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Kleijnen, J.P.C., 2007. "Simulation Experiments in Practice : Statistical Design and Regression Analysis," Discussion Paper 2007-09, Tilburg University, Center for Economic Research.
    2. Kleijnen, J.P.C., 2006. "White Noise Assumptions Revisited : Regression Models and Statistical Designs for Simulation Practice," Discussion Paper 2006-50, Tilburg University, Center for Economic Research.
    3. Kleijnen, Jack P.C., 2013. "Simulation-Optimization via Kriging and Bootstrapping : A Survey (Revision of CentER DP 2011-064)," Other publications TiSEM 6ac4e049-ad86-447f-aeec-a, Tilburg University, School of Economics and Management.
    4. van Beers, Wim C.M. & Kleijnen, Jack P.C., 2008. "Customized sequential designs for random simulation experiments: Kriging metamodeling and bootstrapping," European Journal of Operational Research, Elsevier, vol. 186(3), pages 1099-1113, May.
    5. Poropudas, Jirka & Virtanen, Kai, 2011. "Simulation metamodeling with dynamic Bayesian networks," European Journal of Operational Research, Elsevier, vol. 214(3), pages 644-655, November.
    6. Scott L. Rosen & Christopher P. Saunders & Samar K Guharay, 2015. "A Structured Approach for Rapidly Mapping Multilevel System Measures via Simulation Metamodeling," Systems Engineering, John Wiley & Sons, vol. 18(1), pages 87-101, January.
    7. Kleijnen, J.P.C. & van Beers, W.C.M. & van Nieuwenhuyse, I., 2008. "Constrained Optimization in Simulation : A Novel Approach," Discussion Paper 2008-95, Tilburg University, Center for Economic Research.
    8. Ali Kokangul & Serap Akcan & Mufide Narli, 2017. "Optimizing nurse capacity in a teaching hospital neonatal intensive care unit," Health Care Management Science, Springer, vol. 20(2), pages 276-285, June.
    9. Kleijnen, Jack P.C. & van Schaik, Frans D.J., 2011. "Sealed-bid auction of Netherlands mussels: Statistical analysis," International Journal of Production Economics, Elsevier, vol. 132(1), pages 154-161, July.
    10. Hamad, Husam & Al-Hamdan, Sami, 2007. "Discovering metamodels' quality-of-fit for simulation via graphical techniques," European Journal of Operational Research, Elsevier, vol. 178(2), pages 543-559, April.
    11. Kleijnen, Jack P.C. & Pierreval, Henri & Zhang, Jin, 2011. "Methodology for determining the acceptability of system designs in uncertain environments," European Journal of Operational Research, Elsevier, vol. 209(2), pages 176-183, March.
    12. Kleijnen, Jack P.C., 2017. "Regression and Kriging metamodels with their experimental designs in simulation: A review," European Journal of Operational Research, Elsevier, vol. 256(1), pages 1-16.
    13. Shi, Wen & Liu, Zhixue & Shang, Jennifer & Cui, Yujia, 2013. "Multi-criteria robust design of a JIT-based cross-docking distribution center for an auto parts supply chain," European Journal of Operational Research, Elsevier, vol. 229(3), pages 695-706.
    14. Kleijnen, J.P.C., 2006. "Regression Models and Experimental Designs : A Tutorial for Simulation Analaysts," Other publications TiSEM 7b8ecddb-f49e-4b80-865b-a, Tilburg University, School of Economics and Management.
    15. Kleijnen, Jack P.C. & Pierreval, H. & Zhang, J., 2009. "When is the design of a manufacturing system acceptable in the presence of uncertainty?," Other publications TiSEM 58fba7c4-8fd2-44d4-8ec3-f, Tilburg University, School of Economics and Management.
    16. Mert Edali & Gönenç Yücel, 2020. "Analysis of an individual‐based influenza epidemic model using random forest metamodels and adaptive sequential sampling," Systems Research and Behavioral Science, Wiley Blackwell, vol. 37(6), pages 936-958, November.
    17. Radaideh, Majdi I. & Kozlowski, Tomasz, 2020. "Surrogate modeling of advanced computer simulations using deep Gaussian processes," Reliability Engineering and System Safety, Elsevier, vol. 195(C).
    18. Strang, Kenneth David, 2012. "Importance of verifying queue model assumptions before planning with simulation software," European Journal of Operational Research, Elsevier, vol. 218(2), pages 493-504.
    19. Plischke, Elmar & Borgonovo, Emanuele & Smith, Curtis L., 2013. "Global sensitivity measures from given data," European Journal of Operational Research, Elsevier, vol. 226(3), pages 536-550.
    20. Kleijnen, Jack P.C. & Beers, Wim van & Nieuwenhuyse, Inneke van, 2010. "Constrained optimization in expensive simulation: Novel approach," European Journal of Operational Research, Elsevier, vol. 202(1), pages 164-174, April.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Kleijnen, J.P.C., 2007. "Simulation Experiments in Practice : Statistical Design and Regression Analysis," Discussion Paper 2007-09, Tilburg University, Center for Economic Research.
    2. Deflandre, D. & Kleijnen, J.P.C., 2002. "Statistical Analysis of Random Simulations : Bootstrap Tutorial," Other publications TiSEM 351056e6-c63d-4fec-8c00-a, Tilburg University, School of Economics and Management.
    3. Jack P. C. Kleijnen & Susan M. Sanchez & Thomas W. Lucas & Thomas M. Cioppa, 2005. "State-of-the-Art Review: A User’s Guide to the Brave New World of Designing Simulation Experiments," INFORMS Journal on Computing, INFORMS, vol. 17(3), pages 263-289, August.
    4. Kleijnen, Jack P.C., 2009. "Kriging metamodeling in simulation: A review," European Journal of Operational Research, Elsevier, vol. 192(3), pages 707-716, February.
    5. J P C Kleijnen & W C M van Beers, 2004. "Application-driven sequential designs for simulation experiments: Kriging metamodelling," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 55(8), pages 876-883, August.
    6. Kleijnen, Jack P. C., 2005. "An overview of the design and analysis of simulation experiments for sensitivity analysis," European Journal of Operational Research, Elsevier, vol. 164(2), pages 287-300, July.
    7. Xuefei Lu & Alessandro Rudi & Emanuele Borgonovo & Lorenzo Rosasco, 2020. "Faster Kriging: Facing High-Dimensional Simulators," Operations Research, INFORMS, vol. 68(1), pages 233-249, January.
    8. Reis dos Santos, M. Isabel & Porta Nova, Acacio M.O., 2006. "Statistical fitting and validation of non-linear simulation metamodels: A case study," European Journal of Operational Research, Elsevier, vol. 171(1), pages 53-63, May.
    9. Kleijnen, Jack P.C., 2011. "Ethical issues in engineering models : An operations researcher's reflections," Other publications TiSEM 88caba9e-1d78-47d7-9a0b-b, Tilburg University, School of Economics and Management.
    10. M I Reis dos Santos & P M Reis dos Santos, 2011. "Construction and validation of distribution-based regression simulation metamodels," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 62(7), pages 1376-1384, July.
    11. Kleijnen, J.P.C., 1997. "Experimental Design for Sensitivity Analysis, Optimization and Validation of Simulation Models," Discussion Paper 1997-52, Tilburg University, Center for Economic Research.
    12. Katarzyna Growiec & Jakub Growiec & Bogumil Kaminski, 2017. "Social Network Structure and The Trade-Off Between Social Utility and Economic Performance," KAE Working Papers 2017-026, Warsaw School of Economics, Collegium of Economic Analysis.
    13. Acharki, Naoufal & Bertoncello, Antoine & Garnier, Josselin, 2023. "Robust prediction interval estimation for Gaussian processes by cross-validation method," Computational Statistics & Data Analysis, Elsevier, vol. 178(C).
    14. Shankhajyoti De & Arabin Kumar Dey & Deepak Kumar Gouda, 2022. "Construction of Confidence Interval for a Univariate Stock Price Signal Predicted Through Long Short Term Memory Network," Annals of Data Science, Springer, vol. 9(2), pages 271-284, April.
    15. Giorgio Fagiolo & Mattia Guerini & Francesco Lamperti & Alessio Moneta & Andrea Roventini, 2017. "Validation of Agent-Based Models in Economics and Finance," LEM Papers Series 2017/23, Laboratory of Economics and Management (LEM), Sant'Anna School of Advanced Studies, Pisa, Italy.
    16. Sorin Daniel MANOLE & Corina PETRESCU & Ramona Ioana VLADA, 2016. "Determinants of household loans," Theoretical and Applied Economics, Asociatia Generala a Economistilor din Romania - AGER, vol. 0(4(609), W), pages 89-102, Winter.
    17. H. Christopher Frey & Sumeet R. Patil, 2002. "Identification and Review of Sensitivity Analysis Methods," Risk Analysis, John Wiley & Sons, vol. 22(3), pages 553-578, June.
    18. Tunali, S. & Batmaz, I., 2003. "A metamodeling methodology involving both qualitative and quantitative input factors," European Journal of Operational Research, Elsevier, vol. 150(2), pages 437-450, October.
    19. Kleijnen, J.P.C., 1995. "Sensitivity analysis and optimization of system dynamics models : Regression analysis and statistical design of experiments," Other publications TiSEM 87ee6ee0-592c-4204-ac50-6, Tilburg University, School of Economics and Management.
    20. Robertson, Joseph J. & Polly, Ben J. & Collis, Jon M., 2015. "Reduced-order modeling and simulated annealing optimization for efficient residential building utility bill calibration," Applied Energy, Elsevier, vol. 148(C), pages 169-177.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:ejores:v:170:y:2006:i:1:p:120-131. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/eor .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.