IDEAS home Printed from https://ideas.repec.org/a/wly/navres/v57y2010i6p583-604.html
   My bibliography  Save this article

Adaptive random search for continuous simulation optimization

Author

Listed:
  • Sigrún Andradóttir
  • Andrei A. Prudius

Abstract

We present, analyze, and compare three random search methods for solving stochastic optimization problems with uncountable feasible regions. Our adaptive search with resampling (ASR) approach is a framework for designing provably convergent algorithms that are adaptive and may consequently involve local search. The deterministic and stochastic shrinking ball (DSB and SSB) approaches are also convergent, but they are based on pure random search with the only difference being the estimator of the optimal solution [the DSB method was originally proposed and analyzed by Baumert and Smith]. The three methods use different techniques to reduce the effects of noise in the estimated objective function values. Our ASR method achieves this goal through resampling of already sampled points, whereas the DSB and SSB approaches address it by averaging observations in balls that shrink with time. We present conditions under which the three methods are convergent, both in probability and almost surely, and provide a limited computational study aimed at comparing the methods. Although further investigation is needed, our numerical results suggest that the ASR approach is promising, especially for difficult problems where the probability of identifying good solutions using pure random search is small. © 2010 Wiley Periodicals, Inc. Naval Research Logistics, 2010

Suggested Citation

  • Sigrún Andradóttir & Andrei A. Prudius, 2010. "Adaptive random search for continuous simulation optimization," Naval Research Logistics (NRL), John Wiley & Sons, vol. 57(6), pages 583-604, September.
    • Handle: RePEc:wly:navres:v:57:y:2010:i:6:p:583-604
    DOI: 10.1002/nav.20422
    as

    Download full text from publisher

    File URL: https://doi.org/10.1002/nav.20422
    Download Restriction: no
    File URL: https://libkey.io/10.1002/nav.20422?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Stephen M. Robinson, 1996. "Analysis of Sample-Path Optimization," Mathematics of Operations Research, INFORMS, vol. 21(3), pages 513-528, August.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Yongchao Liu & Huifu Xu & Jane J. Ye, 2011. "Penalized Sample Average Approximation Methods for Stochastic Mathematical Programs with Complementarity Constraints," Mathematics of Operations Research, INFORMS, vol. 36(4), pages 670-694, November.
    2. Alfieri, Arianna & Matta, Andrea, 2012. "Mathematical programming formulations for approximate simulation of multistage production systems," European Journal of Operational Research, Elsevier, vol. 219(3), pages 773-783.
    3. Jörg Fliege & Huifu Xu, 2011. "Stochastic Multiobjective Optimization: Sample Average Approximation and Applications," Journal of Optimization Theory and Applications, Springer, vol. 151(1), pages 135-162, October.
    4. Qi Fan & Jiaqiao Hu, 2018. "Surrogate-Based Promising Area Search for Lipschitz Continuous Simulation Optimization," INFORMS Journal on Computing, INFORMS, vol. 30(4), pages 677-693, November.
    5. Flam, Sjur Didrik & Mirman, Leonard J., 1998. "Groping for optimal growth," Journal of Economic Dynamics and Control, Elsevier, vol. 23(2), pages 191-207, September.
    6. Victor DeMiguel & Huifu Xu, 2009. "A Stochastic Multiple-Leader Stackelberg Model: Analysis, Computation, and Application," Operations Research, INFORMS, vol. 57(5), pages 1220-1235, October.
    7. L. Dai & C. H. Chen & J. R. Birge, 2000. "Convergence Properties of Two-Stage Stochastic Programming," Journal of Optimization Theory and Applications, Springer, vol. 106(3), pages 489-509, September.
    8. Gürkan, G. & Ozge, A.Y. & Robinson, S.M., 1997. "Sample-path solution of stochastic variational inequalities," Discussion Paper 1997-87, Tilburg University, Center for Economic Research.
    9. Lin, Rung-Chuan & Sir, Mustafa Y. & Pasupathy, Kalyan S., 2013. "Multi-objective simulation optimization using data envelopment analysis and genetic algorithm: Specific application to determining optimal resource levels in surgical services," Omega, Elsevier, vol. 41(5), pages 881-892.
    10. Gürkan, G. & Ozdemir, O. & Smeers, Y., 2013. "Generation Capacity Investments in Electricity Markets : Perfect Competition," Discussion Paper 2013-045, Tilburg University, Center for Economic Research.
    11. Z. L. Chen & W. B. Powell, 1999. "Convergent Cutting-Plane and Partial-Sampling Algorithm for Multistage Stochastic Linear Programs with Recourse," Journal of Optimization Theory and Applications, Springer, vol. 102(3), pages 497-524, September.
    12. Birbil, S.I. & Gürkan, G. & Listeş, O., 2004. "Simulation-based solution of stochastic mathematical programs with complementarity constraints: Sample-path analysis," ERIM Report Series Research in Management ERS-2004-016-LIS, Erasmus Research Institute of Management (ERIM), ERIM is the joint research institute of the Rotterdam School of Management, Erasmus University and the Erasmus School of Economics (ESE) at Erasmus University Rotterdam.
    13. Ankur Kulkarni & Uday Shanbhag, 2012. "Recourse-based stochastic nonlinear programming: properties and Benders-SQP algorithms," Computational Optimization and Applications, Springer, vol. 51(1), pages 77-123, January.
    14. Sohani Liyanage & Hussein Dia & Rusul Abduljabbar & Saeed Asadi Bagloee, 2019. "Flexible Mobility On-Demand: An Environmental Scan," Sustainability, MDPI, vol. 11(5), pages 1-39, February.
    15. Huifu Xu & Dali Zhang, 2013. "Stochastic Nash equilibrium problems: sample average approximation and applications," Computational Optimization and Applications, Springer, vol. 55(3), pages 597-645, July.
    16. Gürkan, G. & Ozge, A.Y., 1996. "Sample-Path Optimization of Buffer Allocations in a Tandem Queue - Part I : Theoretical Issues," Other publications TiSEM 77da022b-635b-46fd-bf4a-f, Tilburg University, School of Economics and Management.
    17. Gürkan, G. & Ozge, A.Y. & Robinson, S.M., 1997. "Sample-path solutions for simulation optimization problems and stochastic variational inequalities," Discussion Paper 1997-78, Tilburg University, Center for Economic Research.
    18. Huifu Xu & Fanwen Meng, 2007. "Convergence Analysis of Sample Average Approximation Methods for a Class of Stochastic Mathematical Programs with Equality Constraints," Mathematics of Operations Research, INFORMS, vol. 32(3), pages 648-668, August.
    19. Leyuan Shi & Sigurdur O´lafsson, 2000. "Nested Partitions Method for Stochastic Optimization," Methodology and Computing in Applied Probability, Springer, vol. 2(3), pages 271-291, September.
    20. Gürkan, G. & Pang, J.S., 2009. "Approximizations of Nash equilibria," Other publications TiSEM de211d31-d77d-4211-9ca8-2, Tilburg University, School of Economics and Management.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wly:navres:v:57:y:2010:i:6:p:583-604. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: https://doi.org/10.1002/(ISSN)1520-6750 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.