IDEAS home Printed from https://ideas.repec.org/p/hal/journl/hal-01135640.html
   My bibliography  Save this paper

Efficient Sampling and Metamodeling for Computational Economic Models

Author

Listed:
  • Isabelle Salle

    (GREThA - Groupe de Recherche en Economie Théorique et Appliquée - UB - Université de Bordeaux - CNRS - Centre National de la Recherche Scientifique)

  • Murat Yildizoglu

    (GREThA - Groupe de Recherche en Economie Théorique et Appliquée - UB - Université de Bordeaux - CNRS - Centre National de la Recherche Scientifique)

Abstract

Extensive exploration of simulation models comes at a high computational cost, all the more when the model involves a lot of parameters. Economists usually rely on random explorations, such as Monte Carlo simulations, and basic econometric modeling to approximate the properties of computational models. This paper aims to provide guidelines for the use of a much more efficient method that combines a parsimonious sampling of the parameter space using a specific design of experiments (DoE), with a well-suited metamodeling method first developed in geostatistics: kriging. We illustrate these guidelines by following them in the analysis of two simple and well known economic models: Nelson and Winter's industrial dynamics model, and Cournot oligopoly with learning firms. In each case, we show that our DoE experiments can catch the main effects of the parameters on the models' dynamics with a much lower number of simulations than the Monte-Carlo sampling (e.g. 85 simulations instead of 2,000 in the first case). In the analysis of the second model, we also introduce supplementary numerical tools that may be combined with this method, for characterizing configurations complying with a specific criterion (social optimal, replication of stylized facts, etc.). Our appendix gives an example of the R-project code that can be used to apply this method on other models, in order to encourage other researchers to quickly test this approach on their models. © Springer Science+Business Media New York 2013.

Suggested Citation

  • Isabelle Salle & Murat Yildizoglu, 2014. "Efficient Sampling and Metamodeling for Computational Economic Models," Post-Print hal-01135640, HAL.
  • Handle: RePEc:hal:journl:hal-01135640
    DOI: 10.1007/s10614-013-9406-7
    as

    Download full text from publisher

    To our knowledge, this item is not available for download. To find whether it is available, there are three options:
    1. Check below whether another version of this item is available online.
    2. Check on the provider's web page whether it is in fact available.
    3. Perform a search for a similarly titled item that would be available.

    Other versions of this item:

    References listed on IDEAS

    as
    1. Yıldızoğlu, Murat & Sénégas, Marc-Alexandre & Salle, Isabelle & Zumpe, Martin, 2014. "Learning The Optimal Buffer-Stock Consumption Rule Of Carroll," Macroeconomic Dynamics, Cambridge University Press, vol. 18(4), pages 727-752, June.
    2. Tesfatsion, Leigh & Judd, Kenneth L., 2006. "Handbook of Computational Economics, Vol. 2: Agent-Based Computational Economics," Staff General Research Papers Archive 10368, Iowa State University, Department of Economics.
    3. Mebane Jr., Walter R. & Sekhon, Jasjeet S., 2011. "Genetic Optimization Using Derivatives: The rgenoud Package for R," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 42(i11).
    4. Leigh Tesfatsion & Kenneth L. Judd (ed.), 2006. "Handbook of Computational Economics," Handbook of Computational Economics, Elsevier, edition 1, volume 2, number 2.
    5. Nelson, Richard R & Winter, Sidney G, 1982. "The Schumpeterian Tradeoff Revisited," American Economic Review, American Economic Association, vol. 72(1), pages 114-132, March.
    6. Edward Herbst & Frank Schorfheide, 2014. "Sequential Monte Carlo Sampling For Dsge Models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 29(7), pages 1073-1098, November.
    7. Oeffner, Marc, 2008. "Agent–Based Keynesian Macroeconomics - An Evolutionary Model Embedded in an Agent–Based Computer Simulation," MPRA Paper 18199, University Library of Munich, Germany, revised Oct 2009.
    8. Richard R. Nelson & Sidney G. Winter, 1978. "Forces Generating and Limiting Concentration under Schumpeterian Competition," Bell Journal of Economics, The RAND Corporation, vol. 9(2), pages 524-548, Autumn.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Salle, Isabelle & Yıldızoğlu, Murat & Sénégas, Marc-Alexandre, 2013. "Inflation targeting in a learning economy: An ABM perspective," Economic Modelling, Elsevier, vol. 34(C), pages 114-128.
    2. Mellár, Tamás & Hau, Orsolya & Sebestyén, Tamás, 2013. "Láthatóvá tehető-e a láthatatlan kéz? Egy ágensalapú piaci modell tapasztalatai [Can the invisible hand be rendered visible? Experiences of an agent-based market model]," Közgazdasági Szemle (Economic Review - monthly of the Hungarian Academy of Sciences), Közgazdasági Szemle Alapítvány (Economic Review Foundation), vol. 0(9), pages 992-1024.
    3. Sinitskaya, Ekaterina & Tesfatsion, Leigh, 2015. "Macroeconomies as constructively rational games," Journal of Economic Dynamics and Control, Elsevier, vol. 61(C), pages 152-182.
    4. Isabelle SALLE & Marc-Alexandre SENEGAS & Murat YILDIZOGLU, 2013. "How Transparent About Its Inflation Target Should a Central Bank be? An Agent-Based Model Assessment," Cahiers du GREThA (2007-2019) 2013-24, Groupe de Recherche en Economie Théorique et Appliquée (GREThA).
    5. Isabelle Salle & Marc-Alexandre Sénégas & Murat Yıldızoğlu, 2019. "How transparent about its inflation target should a central bank be?," Journal of Evolutionary Economics, Springer, vol. 29(1), pages 391-427, March.
    6. Müller, Matthias & Kudic, Muhamed & Vermeulen, Ben, 2021. "The influence of the structure of technological knowledge on inter-firm R&D collaboration and knowledge discovery: An agent-based simulation approach," Journal of Business Research, Elsevier, vol. 129(C), pages 570-579.
    7. Váry, Miklós, 2015. "Piaci alkalmazkodás ragadós árak mellett - Calvo-típusú ármerevség egy ágensalapú modellben [Market adjustment under sticky prices: the price rigidity of a Calvo type in an agent-based model]," Közgazdasági Szemle (Economic Review - monthly of the Hungarian Academy of Sciences), Közgazdasági Szemle Alapítvány (Economic Review Foundation), vol. 0(1), pages 48-77.
    8. Sinitskaya, Ekaterina, 2014. "Computational modeling of an economy using elements of artificial intelligence," ISU General Staff Papers 201401010800005291, Iowa State University, Department of Economics.
    9. Popoyan, Lilit & Napoletano, Mauro & Roventini, Andrea, 2017. "Taming macroeconomic instability: Monetary and macro-prudential policy interactions in an agent-based model," Journal of Economic Behavior & Organization, Elsevier, vol. 134(C), pages 117-140.
    10. J. Silvestre, & T. Araújo & M. St. Aubyn, 2016. "Economic growth and individual satisfaction in an agent-based economy," Working Papers Department of Economics 2016/19, ISEG - Lisbon School of Economics and Management, Department of Economics, Universidade de Lisboa.
    11. Deniz Erdemlioglu & Nikola Gradojevic, 2021. "Heterogeneous investment horizons, risk regimes, and realized jumps," International Journal of Finance & Economics, John Wiley & Sons, Ltd., vol. 26(1), pages 617-643, January.
    12. Balint, T. & Lamperti, F. & Mandel, A. & Napoletano, M. & Roventini, A. & Sapio, A., 2017. "Complexity and the Economics of Climate Change: A Survey and a Look Forward," Ecological Economics, Elsevier, vol. 138(C), pages 252-265.
    13. Kubin, Ingrid & Zörner, Thomas O. & Gardini, Laura & Commendatore, Pasquale, 2019. "A credit cycle model with market sentiments," Structural Change and Economic Dynamics, Elsevier, vol. 50(C), pages 159-174.
    14. Westerhoff Frank H., 2008. "The Use of Agent-Based Financial Market Models to Test the Effectiveness of Regulatory Policies," Journal of Economics and Statistics (Jahrbuecher fuer Nationaloekonomie und Statistik), De Gruyter, vol. 228(2-3), pages 195-227, April.
    15. Luca Riccetti & Alberto Russo & Mauro Gallegati, 2015. "An agent based decentralized matching macroeconomic model," Journal of Economic Interaction and Coordination, Springer;Society for Economic Science with Heterogeneous Interacting Agents, vol. 10(2), pages 305-332, October.
    16. Klaus Jaffe, 2015. "Agent based simulations visualize Adam Smith's invisible hand by solving Friedrich Hayek's Economic Calculus," Papers 1509.04264, arXiv.org, revised Nov 2015.
    17. Lovric, M. & Kaymak, U. & Spronk, J., 2008. "A Conceptual Model of Investor Behavior," ERIM Report Series Research in Management ERS-2008-030-F&A, Erasmus Research Institute of Management (ERIM), ERIM is the joint research institute of the Rotterdam School of Management, Erasmus University and the Erasmus School of Economics (ESE) at Erasmus University Rotterdam.
    18. repec:hal:spmain:info:hdl:2441/5bnglqth5987gaq6dhju3psjn3 is not listed on IDEAS
    19. Francesco Lamperti & Giovanni Dosi & Mauro Napoletano & Andrea Roventini & Alessandro Sapio, 2018. "And then he wasn't a she : Climate change and green transitions in an agent-based integrated assessment model," Working Papers hal-03443464, HAL.
    20. Dirk Helbing & Thomas U. Grund, 2013. "Editorial: Agent-Based Modeling And Techno-Social Systems," Advances in Complex Systems (ACS), World Scientific Publishing Co. Pte. Ltd., vol. 16(04n05), pages 1-3.
    21. Frank Westerhoff & Martin Hohnisch, 2010. "Consumer sentiment and countercyclical fiscal policies," International Review of Applied Economics, Taylor & Francis Journals, vol. 24(5), pages 609-618.

    More about this item

    Keywords

    economic; models; sampling; computational;
    All these keywords.

    JEL classification:

    • C61 - Mathematical and Quantitative Methods - - Mathematical Methods; Programming Models; Mathematical and Simulation Modeling - - - Optimization Techniques; Programming Models; Dynamic Analysis
    • C63 - Mathematical and Quantitative Methods - - Mathematical Methods; Programming Models; Mathematical and Simulation Modeling - - - Computational Techniques
    • C80 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - General
    • C90 - Mathematical and Quantitative Methods - - Design of Experiments - - - General

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:hal:journl:hal-01135640. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: CCSD (email available below). General contact details of provider: https://hal.archives-ouvertes.fr/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.