IDEAS home Printed from https://ideas.repec.org/a/inm/orijoc/v31y2019i1p21-39.html
   My bibliography  Save this article

An Asymptotically Optimal Set Approach for Simulation Optimization

Author

Listed:
  • Liujia Hu

    (Quantitative Advisory Service, Ernst and Young LLP, New York, New York 10036)

  • Sigrún Andradóttir

    (Stewart School of Industrial and Systems Engineering, Georgia Institute of Technology, Atlanta, Georgia 30332)

Abstract

We propose an asymptotically optimal set (AOS) approach for solving stochastic optimization problems with discrete or continuous feasible regions. Our AOS approach is a framework for designing provably convergent algorithms that are adaptive in seeking new points and in resampling or discarding already sampled points. The framework is an improvement over the adaptive search with resampling (ASR) method for stochastic optimization in that it spends less effort on inferior points and uses a more robust estimate of the optimal solution. We present conditions guaranteeing that the AOS approach is globally convergent and will eventually discard suboptimal sampled points with probability one, compare the algorithms, and analyze when (additional) resampling (beyond the minimum) is desirable. Our theoretical results show that AOS has stronger performance guarantees than ASR. Our numerical results suggest that AOS makes substantial improvements over ASR, especially for difficult problems with large numbers of local optima.

Suggested Citation

  • Liujia Hu & Sigrún Andradóttir, 2019. "An Asymptotically Optimal Set Approach for Simulation Optimization," INFORMS Journal on Computing, INFORMS, vol. 31(1), pages 21-39, February.
    • Handle: RePEc:inm:orijoc:v:31:y:2019:i:1:p:21-39
    DOI: 10.1287/ijoc.2018.0811
    as

    Download full text from publisher

    File URL: https://doi.org/10.1287/ijoc.2018.0811
    Download Restriction: no
    File URL: https://libkey.io/10.1287/ijoc.2018.0811?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Sujin Kim & Raghu Pasupathy & Shane G. Henderson, 2015. "A Guide to Sample Average Approximation," International Series in Operations Research & Management Science, in: Michael C Fu (ed.), Handbook of Simulation Optimization, edition 127, chapter 0, pages 207-243, Springer.
    2. L. Jeff Hong & Barry L. Nelson, 2006. "Discrete Optimization via Simulation Using COMPASS," Operations Research, INFORMS, vol. 54(1), pages 115-129, February.
    3. Stephen M. Robinson, 1996. "Analysis of Sample-Path Optimization," Mathematics of Operations Research, INFORMS, vol. 21(3), pages 513-528, August.
    4. A. Shapiro & Y. Wardi, 1996. "Convergence Analysis of Stochastic Algorithms," Mathematics of Operations Research, INFORMS, vol. 21(3), pages 615-628, August.
    5. Sigrún Andradóttir & Andrei A. Prudius, 2009. "Balanced Explorative and Exploitative Search with Estimation for Simulation Optimization," INFORMS Journal on Computing, INFORMS, vol. 21(2), pages 193-208, May.
    6. Jiaqiao Hu & Michael C. Fu & Steven I. Marcus, 2007. "A Model Reference Adaptive Search Method for Global Optimization," Operations Research, INFORMS, vol. 55(3), pages 549-568, June.
    7. Alrefaei, Mahmoud H. & Andradottir, Sigrun, 2001. "A modification of the stochastic ruler method for discrete stochastic optimization," European Journal of Operational Research, Elsevier, vol. 133(1), pages 160-182, August.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Wang, Honggang, 2012. "Retrospective optimization of mixed-integer stochastic systems using dynamic simplex linear interpolation," European Journal of Operational Research, Elsevier, vol. 217(1), pages 141-148.
    2. Qi Fan & Jiaqiao Hu, 2018. "Surrogate-Based Promising Area Search for Lipschitz Continuous Simulation Optimization," INFORMS Journal on Computing, INFORMS, vol. 30(4), pages 677-693, November.
    3. Jie Xu & Barry L. Nelson & L. Jeff Hong, 2013. "An Adaptive Hyperbox Algorithm for High-Dimensional Discrete Optimization via Simulation Problems," INFORMS Journal on Computing, INFORMS, vol. 25(1), pages 133-146, February.
    4. Andrei A. Prudius & Sigrún Andradóttir, 2012. "Averaging frameworks for simulation optimization with applications to simulated annealing," Naval Research Logistics (NRL), John Wiley & Sons, vol. 59(6), pages 411-429, September.
    5. Shing Chih Tsai, 2013. "Rapid Screening Procedures for Zero-One Optimization via Simulation," INFORMS Journal on Computing, INFORMS, vol. 25(2), pages 317-331, May.
    6. Alfieri, Arianna & Matta, Andrea, 2012. "Mathematical programming formulations for approximate simulation of multistage production systems," European Journal of Operational Research, Elsevier, vol. 219(3), pages 773-783.
    7. Flam, Sjur Didrik & Mirman, Leonard J., 1998. "Groping for optimal growth," Journal of Economic Dynamics and Control, Elsevier, vol. 23(2), pages 191-207, September.
    8. Sigrún Andradóttir & Andrei A. Prudius, 2009. "Balanced Explorative and Exploitative Search with Estimation for Simulation Optimization," INFORMS Journal on Computing, INFORMS, vol. 21(2), pages 193-208, May.
    9. Huifu Xu & Fanwen Meng, 2007. "Convergence Analysis of Sample Average Approximation Methods for a Class of Stochastic Mathematical Programs with Equality Constraints," Mathematics of Operations Research, INFORMS, vol. 32(3), pages 648-668, August.
    10. Powell, Warren B., 2019. "A unified framework for stochastic optimization," European Journal of Operational Research, Elsevier, vol. 275(3), pages 795-821.
    11. Deniz Preil & Michael Krapp, 2023. "Genetic multi-armed bandits: a reinforcement learning approach for discrete optimization via simulation," Papers 2302.07695, arXiv.org.
    12. Xiaojun Chen & Masao Fukushima, 2005. "Expected Residual Minimization Method for Stochastic Linear Complementarity Problems," Mathematics of Operations Research, INFORMS, vol. 30(4), pages 1022-1038, November.
    13. Qi Zhang & Jiaqiao Hu, 2019. "Simulation Optimization Using Multi-Time-Scale Adaptive Random Search," Asia-Pacific Journal of Operational Research (APJOR), World Scientific Publishing Co. Pte. Ltd., vol. 36(06), pages 1-34, December.
    14. Sun, Haoze & Weng, Chengguo & Zhang, Yi, 2017. "Optimal multivariate quota-share reinsurance: A nonparametric mean-CVaR framework," Insurance: Mathematics and Economics, Elsevier, vol. 72(C), pages 197-214.
    15. Arianna Alfieri & Andrea Matta & Giulia Pedrielli, 2015. "Mathematical programming models for joint simulation–optimization applied to closed queueing networks," Annals of Operations Research, Springer, vol. 231(1), pages 105-127, August.
    16. Özdemir, Deniz & Yücesan, Enver & Herer, Yale T., 2013. "Multi-location transshipment problem with capacitated production," European Journal of Operational Research, Elsevier, vol. 226(3), pages 425-435.
    17. Chuljin Park & Seong-Hee Kim, 2015. "Penalty Function with Memory for Discrete Optimization via Simulation with Stochastic Constraints," Operations Research, INFORMS, vol. 63(5), pages 1195-1212, October.
    18. Satyajith Amaran & Nikolaos V. Sahinidis & Bikram Sharda & Scott J. Bury, 2016. "Simulation optimization: a review of algorithms and applications," Annals of Operations Research, Springer, vol. 240(1), pages 351-380, May.
    19. Lihua Sun & L. Jeff Hong & Zhaolin Hu, 2014. "Balancing Exploitation and Exploration in Discrete Optimization via Simulation Through a Gaussian Process-Based Search," Operations Research, INFORMS, vol. 62(6), pages 1416-1438, December.
    20. Kabirian, Alireza & Ólafsson, Sigurdur, 2011. "Continuous optimization via simulation using Golden Region search," European Journal of Operational Research, Elsevier, vol. 208(1), pages 19-27, January.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:inm:orijoc:v:31:y:2019:i:1:p:21-39. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Asher (email available below). General contact details of provider: https://edirc.repec.org/data/inforea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.