IDEAS home Printed from https://ideas.repec.org/a/eee/csdana/v144y2020ics0167947319301999.html
   My bibliography  Save this article

A comparison of general-purpose optimization algorithms for finding optimal approximate experimental designs

Author

Listed:
  • García-Ródenas, Ricardo
  • García-García, José Carlos
  • López-Fidalgo, Jesús
  • Martín-Baos, José Ángel
  • Wong, Weng Kee

Abstract

Several common general purpose optimization algorithms are compared for finding A- and D-optimal designs for different types of statistical models of varying complexity, including high dimensional models with five and more factors. The algorithms of interest include exact methods, such as the interior point method, the Nelder–Mead method, the active set method, the sequential quadratic programming, and metaheuristic algorithms, such as particle swarm optimization, simulated annealing and genetic algorithms. Several simulations are performed, which provide general recommendations on the utility and performance of each method, including hybridized versions of metaheuristic algorithms for finding optimal experimental designs. A key result is that general-purpose optimization algorithms, both exact methods and metaheuristic algorithms, perform well for finding optimal approximate experimental designs.

Suggested Citation

  • García-Ródenas, Ricardo & García-García, José Carlos & López-Fidalgo, Jesús & Martín-Baos, José Ángel & Wong, Weng Kee, 2020. "A comparison of general-purpose optimization algorithms for finding optimal approximate experimental designs," Computational Statistics & Data Analysis, Elsevier, vol. 144(C).
    • Handle: RePEc:eee:csdana:v:144:y:2020:i:c:s0167947319301999
    DOI: 10.1016/j.csda.2019.106844
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0167947319301999
    Download Restriction: Full text for ScienceDirect subscribers only.
    File URL: https://libkey.io/10.1016/j.csda.2019.106844?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. J. W. Stallings & J. P. Morgan, 2015. "General weighted optimality of designed experiments," Biometrika, Biometrika Trust, vol. 102(4), pages 925-935.
    2. Wenyu Sun & Ya-Xiang Yuan, 2006. "Optimization Theory and Methods," Springer Optimization and Its Applications, Springer, number 978-0-387-24976-6, June.
    3. Min Yang & Stefanie Biedermann & Elina Tang, 2013. "On Optimal Designs for Nonlinear Models: A General and Efficient Algorithm," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 108(504), pages 1411-1420, December.
    4. Palhazi Cuervo, Daniel & Goos, Peter & Sörensen, Kenneth & Arráiz, Emely, 2014. "An iterated local search algorithm for the vehicle routing problem with backhauls," European Journal of Operational Research, Elsevier, vol. 237(2), pages 454-464.
    5. Socha, Krzysztof & Dorigo, Marco, 2008. "Ant colony optimization for continuous domains," European Journal of Operational Research, Elsevier, vol. 185(3), pages 1155-1173, March.
    6. Yuanzhi Huang & Steven G. Gilmour & Kalliopi Mylona & Peter Goos, 2019. "Optimal design of experiments for non‐linear response surface models," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 68(3), pages 623-640, April.
    7. Joy King & Weng-Kee Wong, 2000. "Minimax D-Optimal Designs for the Logistic Model," Biometrics, The International Biometric Society, vol. 56(4), pages 1263-1267, December.
    8. Nguyen, Nam-Ky & Miller, Alan J., 1992. "A review of some exchange algorithms for constructing discrete D-optimal designs," Computational Statistics & Data Analysis, Elsevier, vol. 14(4), pages 489-498, November.
    9. L. Ingber, 1993. "Simulated annealing: Practice versus theory," Lester Ingber Papers 93sa, Lester Ingber.
    10. Espinosa-Aranda, José Luis & García-Ródenas, Ricardo & Ramírez-Flores, María del Carmen & López-García, María Luz & Angulo, Eusebio, 2015. "High-speed railway scheduling based on user preferences," European Journal of Operational Research, Elsevier, vol. 246(3), pages 772-786.
    11. Martin-Martin, R. & Torsney, B. & Lopez-Fidalgo, J., 2007. "Construction of marginally and conditionally restricted designs using multiplicative algorithms," Computational Statistics & Data Analysis, Elsevier, vol. 51(12), pages 5547-5561, August.
    12. Weng Kee Wong & Ray-Bing Chen & Chien-Chih Huang & Weichung Wang, 2015. "A Modified Particle Swarm Optimization Technique for Finding Optimal Designs for Mixture Models," PLOS ONE, Public Library of Science, vol. 10(6), pages 1-23, June.
    13. Hamada M. & Martz H. F. & Reese C. S. & Wilson A. G., 2001. "Finding Near-Optimal Bayesian Experimental Designs via Genetic Algorithms," The American Statistician, American Statistical Association, vol. 55, pages 175-181, August.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Nedka Dechkova Nikiforova & Rossella Berni & Jesús Fernando López‐Fidalgo, 2022. "Optimal approximate choice designs for a two‐step coffee choice, taste and choice again experiment," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 71(5), pages 1895-1917, November.
    2. Rios, Nicholas & Winker, Peter & Lin, Dennis K.J., 2022. "TA algorithms for D-optimal OofA Mixture designs," Computational Statistics & Data Analysis, Elsevier, vol. 168(C).
    3. Kao, Ming-Hung & Khogeer, Hazar, 2021. "Optimal designs for mixed continuous and binary responses with quantitative and qualitative factors," Journal of Multivariate Analysis, Elsevier, vol. 182(C).
    4. Chen, Ping-Yang & Chen, Ray-Bing & Chen, Yu-Shi & Wong, Weng Kee, 2023. "Numerical Methods for Finding A-optimal Designs Analytically," Econometrics and Statistics, Elsevier, vol. 28(C), pages 155-162.
    5. Wael Korani & Malek Mouhoub, 2021. "Review on Nature-Inspired Algorithms," SN Operations Research Forum, Springer, vol. 2(3), pages 1-26, September.
    6. Ul Hassan, Mahmood & Miller, Frank, 2021. "An exchange algorithm for optimal calibration of items in computerized achievement tests," Computational Statistics & Data Analysis, Elsevier, vol. 157(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Masoudi, Ehsan & Holling, Heinz & Wong, Weng Kee, 2017. "Application of imperialist competitive algorithm to find minimax and standardized maximin optimal designs," Computational Statistics & Data Analysis, Elsevier, vol. 113(C), pages 330-345.
    2. Haoyu Wang & Chongqi Zhang, 2022. "The mixture design threshold accepting algorithm for generating $$\varvec{D}$$ D -optimal designs of the mixture models," Metrika: International Journal for Theoretical and Applied Statistics, Springer, vol. 85(3), pages 345-371, April.
    3. Lianyan Fu & Faming Ma & Zhuoxi Yu & Zhichuan Zhu, 2023. "Multiplication Algorithms for Approximate Optimal Distributions with Cost Constraints," Mathematics, MDPI, vol. 11(8), pages 1-14, April.
    4. Bera, Sasadhar & Mukherjee, Indrajit, 2016. "A multistage and multiple response optimization approach for serial manufacturing system," European Journal of Operational Research, Elsevier, vol. 248(2), pages 444-452.
    5. Saeid Pooladsaz & Mahboobeh Doosti-Irani, 2024. "An algorithm for generating efficient block designs via a novel particle swarm approach," Computational Statistics, Springer, vol. 39(5), pages 2437-2449, July.
    6. Zhang, Zhe & Song, Xiaoling & Gong, Xue & Yin, Yong & Lev, Benjamin & Zhou, Xiaoyang, 2024. "Coordinated seru scheduling and distribution operation problems with DeJong’s learning effects," European Journal of Operational Research, Elsevier, vol. 313(2), pages 452-464.
    7. Yu, Jun & Meng, Xiran & Wang, Yaping, 2023. "Optimal designs for semi-parametric dose-response models under random contamination," Computational Statistics & Data Analysis, Elsevier, vol. 178(C).
    8. Yasushi Narushima & Shummin Nakayama & Masashi Takemura & Hiroshi Yabe, 2023. "Memoryless Quasi-Newton Methods Based on the Spectral-Scaling Broyden Family for Riemannian Optimization," Journal of Optimization Theory and Applications, Springer, vol. 197(2), pages 639-664, May.
    9. Saha, Tanay & Rakshit, Suman & Khare, Swanand R., 2023. "Linearly structured quadratic model updating using partial incomplete eigendata," Applied Mathematics and Computation, Elsevier, vol. 446(C).
    10. Bergey, Paul K. & Ragsdale, Cliff, 2005. "Modified differential evolution: a greedy random strategy for genetic recombination," Omega, Elsevier, vol. 33(3), pages 255-265, June.
    11. Guang Li & Paat Rusmevichientong & Huseyin Topaloglu, 2015. "The d -Level Nested Logit Model: Assortment and Price Optimization Problems," Operations Research, INFORMS, vol. 63(2), pages 325-342, April.
    12. Zheng, Sanpeng & Feng, Renzhong, 2023. "A variable projection method for the general radial basis function neural network," Applied Mathematics and Computation, Elsevier, vol. 451(C).
    13. Moriguchi, Kai & Ueki, Tatsuhito & Saito, Masashi, 2020. "Establishing optimal forest harvesting regulation with continuous approximation," Operations Research Perspectives, Elsevier, vol. 7(C).
    14. Jörg Fliege & Andrey Tin & Alain Zemkoho, 2021. "Gauss–Newton-type methods for bilevel optimization," Computational Optimization and Applications, Springer, vol. 78(3), pages 793-824, April.
    15. David Easterling & Layne Watson & Michael Madigan & Brent Castle & Michael Trosset, 2014. "Parallel deterministic and stochastic global minimization of functions with very many minima," Computational Optimization and Applications, Springer, vol. 57(2), pages 469-492, March.
    16. Hai-Jun Wang & Qin Ni, 2010. "A Convex Approximation Method For Large Scale Linear Inequality Constrained Minimization," Asia-Pacific Journal of Operational Research (APJOR), World Scientific Publishing Co. Pte. Ltd., vol. 27(01), pages 85-101.
    17. Anand Kumar & Manoj Thakur & Garima Mittal, 2018. "A new ants interaction scheme for continuous optimization problems," International Journal of System Assurance Engineering and Management, Springer;The Society for Reliability, Engineering Quality and Operations Management (SREQOM),India, and Division of Operation and Maintenance, Lulea University of Technology, Sweden, vol. 9(4), pages 784-801, August.
    18. Mayer, D. G. & Belward, J. A. & Burrage, K., 1996. "Use of advanced techniques to optimize a multi-dimensional dairy model," Agricultural Systems, Elsevier, vol. 50(3), pages 239-253.
    19. Arnouts, Heidi & Goos, Peter, 2010. "Update formulas for split-plot and block designs," Computational Statistics & Data Analysis, Elsevier, vol. 54(12), pages 3381-3391, December.
    20. Chen, Liang, 2016. "A high-order modified Levenberg–Marquardt method for systems of nonlinear equations with fourth-order convergence," Applied Mathematics and Computation, Elsevier, vol. 285(C), pages 79-93.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:csdana:v:144:y:2020:i:c:s0167947319301999. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/csda .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.