IDEAS home Printed from https://ideas.repec.org/a/wly/navres/v64y2017i6p502-527.html
   My bibliography  Save this article

Combined variance reduction techniques in fully sequential selection procedures

Author

Listed:
  • Shing Chih Tsai
  • Jun Luo
  • Chi Ching Sung

Abstract

In the past several decades, many ranking‐and‐selection (R&S) procedures have been developed to select the best simulated system with the largest (or smallest) mean performance measure from a finite number of alternatives. A major issue to address in these R&S problems is to balance the trade‐off between the effectiveness (ie, making a correct selection with a high probability) and the efficiency (ie, using a small total number of observations). In this paper, we take a frequentist's point of view by setting a predetermined probability of correct selection while trying to reduce the total sample size, that is, to improve the efficiency but also maintain the effectiveness. In particular, in order to achieve this goal, we investigate combining various variance reduction techniques into the fully sequential framework, resulting in different R&S procedures with either finite‐time or asymptotic statistical validity. Extensive numerical experiments show great improvement in the efficiency of our proposed procedures as compared with several existing procedures.

Suggested Citation

  • Shing Chih Tsai & Jun Luo & Chi Ching Sung, 2017. "Combined variance reduction techniques in fully sequential selection procedures," Naval Research Logistics (NRL), John Wiley & Sons, vol. 64(6), pages 502-527, September.
    • Handle: RePEc:wly:navres:v:64:y:2017:i:6:p:502-527
    DOI: 10.1002/nav.21770
    as

    Download full text from publisher

    File URL: https://doi.org/10.1002/nav.21770
    Download Restriction: no
    File URL: https://libkey.io/10.1002/nav.21770?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Barry L. Nelson, 2013. "Foundations and Methods of Stochastic Simulation," International Series in Operations Research and Management Science, Springer, edition 127, number 978-1-4614-6160-9, April.
    2. Athanassios N. Avramidis & James R. Wilson, 1996. "Integrated Variance Reduction Strategies for Simulation," Operations Research, INFORMS, vol. 44(2), pages 327-346, April.
    3. Paul Glasserman & Philip Heidelberger & Perwez Shahabuddin, 1999. "Asymptotically Optimal Importance Sampling and Stratification for Pricing Path‐Dependent Options," Mathematical Finance, Wiley Blackwell, vol. 9(2), pages 117-152, April.
    4. Shing Chih Tsai & Chen Hao Kuo, 2012. "Screening and selection procedures with control variates and correlation induction techniques," Naval Research Logistics (NRL), John Wiley & Sons, vol. 59(5), pages 340-361, August.
    5. Shing Tsai & Barry Nelson, 2010. "Fully sequential selection procedures with control variates," IISE Transactions, Taylor & Francis Journals, vol. 42(1), pages 71-82.
    6. Seong-Hee Kim & Barry L. Nelson, 2006. "On the Asymptotic Validity of Fully Sequential Selection Procedures for Steady-State Simulation," Operations Research, INFORMS, vol. 54(3), pages 475-488, June.
    7. Stephen E. Chick & Koichiro Inoue, 2001. "New Two-Stage and Sequential Procedures for Selecting the Best Simulated System," Operations Research, INFORMS, vol. 49(5), pages 732-743, October.
    8. Shing Chih Tsai & Barry L. Nelson & Jeremy Staum, 2009. "Combined Screening and Selection of the Best with Control Variates," International Series in Operations Research & Management Science, in: Christos Alexopoulos & David Goldsman & James R. Wilson (ed.), Advancing the Frontiers of Simulation, pages 263-289, Springer.
    9. Ravi Kumar & Mark E. Lewis & Huseyin Topaloglu, 2013. "Dynamic service rate control for a single‐server queue with Markov‐modulated arrivals," Naval Research Logistics (NRL), John Wiley & Sons, vol. 60(8), pages 661-677, December.
    10. Jun Luo & L. Jeff Hong & Barry L. Nelson & Yang Wu, 2015. "Fully Sequential Procedures for Large-Scale Ranking-and-Selection Problems in Parallel Computing Environments," Operations Research, INFORMS, vol. 63(5), pages 1177-1194, October.
    11. Langford E. & Schwertman N. & Owens M., 2001. "Is the Property of Being Positively Correlated Transitive?," The American Statistician, American Statistical Association, vol. 55, pages 322-325, November.
    12. L. Jeff Hong, 2006. "Fully sequential indifference‐zone selection procedures with variance‐dependent sampling," Naval Research Logistics (NRL), John Wiley & Sons, vol. 53(5), pages 464-476, August.
    13. Raghu Pasupathy & Bruce Schmeiser & Michael Taaffe & Jin Wang, 2012. "Control-variate estimation using estimated control means," IISE Transactions, Taylor & Francis Journals, vol. 44(5), pages 381-385.
    14. J. R. Wilson & A. A. B. Pritsker, 1984. "Experimental Evaluation of Variance Reduction Techniques for Queueing Simulation Using Generalized Concomitant Variables," Management Science, INFORMS, vol. 30(12), pages 1459-1472, December.
    15. Stephen E. Chick & Koichiro Inoue, 2001. "New Procedures to Select the Best Simulated System Using Common Random Numbers," Management Science, INFORMS, vol. 47(8), pages 1133-1149, August.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Tsai, Shing Chih & Yeh, Yingchieh & Kuo, Chen Yun, 2021. "Efficient optimization algorithms for surgical scheduling under uncertainty," European Journal of Operational Research, Elsevier, vol. 293(2), pages 579-593.
    2. Shing Chih Tsai & Wu Hung Lin & Chia Cheng Wu & Shao Jen Weng & Ching Fen Tang, 2022. "Decision support algorithms for optimizing surgery start times considering the performance variation," Health Care Management Science, Springer, vol. 25(2), pages 208-221, June.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Shing Chih Tsai & Chen Hao Kuo, 2012. "Screening and selection procedures with control variates and correlation induction techniques," Naval Research Logistics (NRL), John Wiley & Sons, vol. 59(5), pages 340-361, August.
    2. Tsai, Shing Chih & Chu, I-Hao, 2012. "Controlled multistage selection procedures for comparison with a standard," European Journal of Operational Research, Elsevier, vol. 223(3), pages 709-721.
    3. Haihui Shen & L. Jeff Hong & Xiaowei Zhang, 2021. "Ranking and Selection with Covariates for Personalized Decision Making," INFORMS Journal on Computing, INFORMS, vol. 33(4), pages 1500-1519, October.
    4. Demet Batur & Lina Wang & F. Fred Choobineh, 2018. "Methods for System Selection Based on Sequential Mean–Variance Analysis," INFORMS Journal on Computing, INFORMS, vol. 30(4), pages 724-738, November.
    5. Zhongshun Shi & Yijie Peng & Leyuan Shi & Chun-Hung Chen & Michael C. Fu, 2022. "Dynamic Sampling Allocation Under Finite Simulation Budget for Feasibility Determination," INFORMS Journal on Computing, INFORMS, vol. 34(1), pages 557-568, January.
    6. Cheng, Zhenxia & Luo, Jun & Wu, Ruijing, 2023. "On the finite-sample statistical validity of adaptive fully sequential procedures," European Journal of Operational Research, Elsevier, vol. 307(1), pages 266-278.
    7. Weiwei Fan & L. Jeff Hong & Barry L. Nelson, 2016. "Indifference-Zone-Free Selection of the Best," Operations Research, INFORMS, vol. 64(6), pages 1499-1514, December.
    8. Gongbo Zhang & Yijie Peng & Jianghua Zhang & Enlu Zhou, 2023. "Asymptotically Optimal Sampling Policy for Selecting Top- m Alternatives," INFORMS Journal on Computing, INFORMS, vol. 35(6), pages 1261-1285, November.
    9. Ying Zhong & Shaoxuan Liu & Jun Luo & L. Jeff Hong, 2022. "Speeding Up Paulson’s Procedure for Large-Scale Problems Using Parallel Computing," INFORMS Journal on Computing, INFORMS, vol. 34(1), pages 586-606, January.
    10. L. Jeff Hong & Guangxin Jiang & Ying Zhong, 2022. "Solving Large-Scale Fixed-Budget Ranking and Selection Problems," INFORMS Journal on Computing, INFORMS, vol. 34(6), pages 2930-2949, November.
    11. Eric C. Ni & Dragos F. Ciocan & Shane G. Henderson & Susan R. Hunter, 2017. "Efficient Ranking and Selection in Parallel Computing Environments," Operations Research, INFORMS, vol. 65(3), pages 821-836, June.
    12. L. Jeff Hong, 2006. "Fully sequential indifference‐zone selection procedures with variance‐dependent sampling," Naval Research Logistics (NRL), John Wiley & Sons, vol. 53(5), pages 464-476, August.
    13. L. Jeff Hong & Guangxin Jiang, 2019. "Offline Simulation Online Application: A New Framework of Simulation-Based Decision Making," Asia-Pacific Journal of Operational Research (APJOR), World Scientific Publishing Co. Pte. Ltd., vol. 36(06), pages 1-22, December.
    14. Shing Chih Tsai, 2013. "Rapid Screening Procedures for Zero-One Optimization via Simulation," INFORMS Journal on Computing, INFORMS, vol. 25(2), pages 317-331, May.
    15. Demet Batur & F. Fred Choobineh, 2021. "Selecting the Best Alternative Based on Its Quantile," INFORMS Journal on Computing, INFORMS, vol. 33(2), pages 657-671, May.
    16. Peter I. Frazier, 2014. "A Fully Sequential Elimination Procedure for Indifference-Zone Ranking and Selection with Tight Bounds on Probability of Correct Selection," Operations Research, INFORMS, vol. 62(4), pages 926-942, August.
    17. Lee, Loo Hay & Chew, Ek Peng & Teng, Suyan & Chen, Yankai, 2008. "Multi-objective simulation-based evolutionary algorithm for an aircraft spare parts allocation problem," European Journal of Operational Research, Elsevier, vol. 189(2), pages 476-491, September.
    18. Han, Chulwoo & Park, Frank C., 2022. "A geometric framework for covariance dynamics," Journal of Banking & Finance, Elsevier, vol. 134(C).
    19. Lee, Loo Hay & Chew, Ek Peng & Manikam, Puvaneswari, 2006. "A general framework on the simulation-based optimization under fixed computing budget," European Journal of Operational Research, Elsevier, vol. 174(3), pages 1828-1841, November.
    20. Flötteröd, Gunnar, 2017. "A search acceleration method for optimization problems with transport simulation constraints," Transportation Research Part B: Methodological, Elsevier, vol. 98(C), pages 239-260.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wly:navres:v:64:y:2017:i:6:p:502-527. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: https://doi.org/10.1002/(ISSN)1520-6750 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.