IDEAS home Printed from https://ideas.repec.org/p/wop/safiwp/96-03-011.html
   My bibliography  Save this paper

Active Nonlinear Tests (ANTs) of Complex Simulation Models

Author

Abstract

Simulation models are becoming increasingly common in the analysis of critical scientific, policy, and management issues. Such models provide a way to analyze complex systems characterized by both large parameter spaces and nonlinear interactions. Unfortunately, these same characteristics make understanding such models using traditional testing techniques extremely difficult. Here we show how a model's structure and robustness can be tested via a simple, automatic, nonlinear search algorithm designed to actively "break" the model's implications. Using the active nonlinear tests (ANTs) developed here, one can easily probe for key weaknesses in a simulation's structure, and thereby begin to improve and refine the model's design. We demonstrate ANTs by testing a well-known model of global dynamics (World 3), and show how this technique can be used to uncover small, but powerful, nonlinear effects that may highlight vulnerabilities in the original model. Key words. Testing Simulation Models, Nonlinear Sensitivity Analysis, World3 Model, and Genetic Algorithms In Management Science 44:6 (June 1998): 820-30.

Suggested Citation

  • John H. Miller, 1996. "Active Nonlinear Tests (ANTs) of Complex Simulation Models," Working Papers 96-03-011, Santa Fe Institute.
    • Handle: RePEc:wop:safiwp:96-03-011
    as

    Download full text from publisher

    To our knowledge, this item is not available for download. To find whether it is available, there are three options:
    1. Check below whether another version of this item is available online.
    2. Check on the provider's web page whether it is in fact available.
    3. Perform a search for a similarly titled item that would be available.

    References listed on IDEAS

    as
    1. Steve Bankes, 1993. "Exploratory Modeling for Policy Analysis," Operations Research, INFORMS, vol. 41(3), pages 435-449, June.
    2. William D. Nordhaus, 1992. "Lethal Model 2: The Limits to Growth Revisited," Brookings Papers on Economic Activity, Economic Studies Program, The Brookings Institution, vol. 23(2), pages 1-60.
    3. Ronald L. Iman & Jon C. Helton, 1988. "An Investigation of Uncertainty and Sensitivity Analysis Techniques for Computer Models," Risk Analysis, John Wiley & Sons, vol. 8(1), pages 71-90, March.
    4. Holland, John H & Miller, John H, 1991. "Artificial Adaptive Agents in Economic Theory," American Economic Review, American Economic Association, vol. 81(2), pages 365-371, May.
    5. David C. Cox & Paul Baybutt, 1981. "Methods for Uncertainty Analysis: A Comparative Survey," Risk Analysis, John Wiley & Sons, vol. 1(4), pages 251-258, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. John H. Miller, 1998. "Active Nonlinear Tests (ANTs) of Complex Simulation Models," Management Science, INFORMS, vol. 44(6), pages 820-830, June.
    2. James K. Hammitt, 1990. "Subjective‐Probability‐Based Scenarios for Uncertain Input Parameters: Stratospheric Ozone Depletion," Risk Analysis, John Wiley & Sons, vol. 10(1), pages 93-102, March.
    3. Andrew E. Smith & P. Barry Ryan & John S. Evans, 1992. "The Effect of Neglecting Correlations When Propagating Uncertainty and Estimating the Population Distribution of Risk," Risk Analysis, John Wiley & Sons, vol. 12(4), pages 467-474, December.
    4. Fritz A. Seiler & Joseph L. Alvarez, 1996. "On the Selection of Distributions for Stochastic Variables," Risk Analysis, John Wiley & Sons, vol. 16(1), pages 5-18, February.
    5. Pogany, Peter, 2013. "Thermodynamic Isolation and the New World Order," MPRA Paper 49924, University Library of Munich, Germany.
    6. Smulders, Sjak & Gradus, Raymond, 1996. "Pollution abatement and long-term growth," European Journal of Political Economy, Elsevier, vol. 12(3), pages 505-532, November.
    7. S. Cucurachi & E. Borgonovo & R. Heijungs, 2016. "A Protocol for the Global Sensitivity Analysis of Impact Assessment Models in Life Cycle Assessment," Risk Analysis, John Wiley & Sons, vol. 36(2), pages 357-377, February.
    8. Badunenko, Oleg & Galeotti, Marzio & Hunt, Lester C., 2021. "Better to grow or better to improve? Measuring environmental efficiency in OECD countries with a Stochastic Environmental Kuznets Frontier," FEEM Working Papers 316226, Fondazione Eni Enrico Mattei (FEEM).
    9. William Tracy, 2014. "Paradox Lost: The Evolution of Strategies in Selten’s Chain Store Game," Computational Economics, Springer;Society for Computational Economics, vol. 43(1), pages 83-103, January.
    10. Kollman, Ken & Miller, John H. & Page, Scott E., 1997. "Landscape formation in a spatial voting model," Economics Letters, Elsevier, vol. 55(1), pages 121-130, August.
    11. Ondřej Šíma, 2020. "Reálná ekonomika jako zdroj nerovnováhy obchodní bilance - základní přístup [Real Economy as a Source of Trade Balance Disequilibrium - Basic Approach]," Politická ekonomie, Prague University of Economics and Business, vol. 2020(3), pages 322-347.
    12. Robbie Maris & Mark Holmes, 2023. "Economic Growth Theory and Natural Resource Constraints: A Stocktake and Critical Assessment," Australian Economic Review, The University of Melbourne, Melbourne Institute of Applied Economic and Social Research, vol. 56(2), pages 255-268, June.
    13. Guido A Veldhuis & Nico M de Reus & Bas MJ Keijser, 2020. "Concept development for comprehensive operations support with modeling and simulation," The Journal of Defense Modeling and Simulation, , vol. 17(1), pages 99-116, January.
    14. Joshua M. Epstein, 2007. "Agent-Based Computational Models and Generative Social Science," Introductory Chapters, in: Generative Social Science Studies in Agent-Based Computational Modeling, Princeton University Press.
    15. Ho, Teck-Hua, 1996. "Finite automata play repeated prisoner's dilemma with information processing costs," Journal of Economic Dynamics and Control, Elsevier, vol. 20(1-3), pages 173-207.
    16. Marco Casari, 2002. "Can genetic algorithms explain experimental anomalies? An application to common property resources," UFAE and IAE Working Papers 542.02, Unitat de Fonaments de l'Anàlisi Econòmica (UAB) and Institut d'Anàlisi Econòmica (CSIC).
    17. Benoît Desmarchelier & Faridah Djellal & Faïz Gallouj, 2018. "Public Service Innovation Networks (PSINs): Collaborating for Innovation and Value Creation," Working Papers halshs-01934275, HAL.
    18. Kenneth Button & Brien Benson, 2013. "Handling biases in forecasting when making transportation policy," Chapters, in: Thomas Vanoutrive & Ann Verhetsel (ed.), Smart Transport Networks, chapter 4, pages 49-67, Edward Elgar Publishing.
    19. Casari, Marco, 2008. "Markets in equilibrium with firms out of equilibrium: A simulation study," Journal of Economic Behavior & Organization, Elsevier, vol. 65(2), pages 261-276, February.
    20. R駩s Chenavaz & Octavio Escobar, 2015. "Population distribution, effective area and economic growth," Applied Economics, Taylor & Francis Journals, vol. 47(53), pages 5776-5790, November.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wop:safiwp:96-03-011. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Thomas Krichel (email available below). General contact details of provider: https://edirc.repec.org/data/epstfus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.