IDEAS home Printed from https://ideas.repec.org/a/spr/comaot/v12y2006i4d10.1007_s10588-006-8873-y.html
   My bibliography  Save this article

Validation and verification of social processes within agent-based computational organization models

Author

Listed:
  • Levent Yilmaz

    (Auburn University)

Abstract

The use of simulation modeling in computational analysis of organizations is becoming a prominent approach in social science research. However, relying on simulations to gain intuition about social phenomena has significant implications. While simulations may give rise to interesting macro-level phenomena, and sometimes even mimic empirical data, the underlying micro and macro level processes may be far from realistic. Yet, this realism may be important to infer results that are relevant to existing theories of social systems and to policy making. Therefore, it is important to assess not only predictive capability but also explanation accuracy of formal models in terms of the degree of realism reflected by the embedded processes. This paper presents a process-centric perspective for the validation and verification (V&V) of agent-based computational organization models. Following an overview of the role of V&V within the life cycle of a simulation study, emergent issues in agent-based organization model V&V are outlined. The notion of social contract that facilitates capturing micro level processes among agents is introduced to enable reasoning about the integrity and consistency of agent-based organization designs. Social contracts are shown to enable modular compositional verification of interaction dynamics among peer agents. Two types of consistency are introduced: horizontal and vertical consistency. It is argued that such local consistency analysis is necessary, but insufficient to validate emergent macro processes within multi-agent organizations. As such, new formal validation metrics are introduced to substantiate the operational validity of emergent macro-level behavior.

Suggested Citation

  • Levent Yilmaz, 2006. "Validation and verification of social processes within agent-based computational organization models," Computational and Mathematical Organization Theory, Springer, vol. 12(4), pages 283-312, December.
  • Handle: RePEc:spr:comaot:v:12:y:2006:i:4:d:10.1007_s10588-006-8873-y
    DOI: 10.1007/s10588-006-8873-y
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s10588-006-8873-y
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s10588-006-8873-y?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Dery, Richard & Landry, Maurice & Banville, Claude, 1993. "Revisiting the issue of model validation in OR: An epistemological view," European Journal of Operational Research, Elsevier, vol. 66(2), pages 168-183, April.
    2. Landry, Maurice & Malouin, Jean-Louis & Oral, Muhittin, 1983. "Model validation in operations research," European Journal of Operational Research, Elsevier, vol. 14(3), pages 207-220, November.
    3. Joshua M. Epstein & Robert L. Axtell, 1996. "Growing Artificial Societies: Social Science from the Bottom Up," MIT Press Books, The MIT Press, edition 1, volume 1, number 0262550253, April.
    4. Oral, Muhittin & Kettani, Ossama, 1993. "The facets of the modeling and validation process in operations research," European Journal of Operational Research, Elsevier, vol. 66(2), pages 216-234, April.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Liang Chen & Guy G. Gable & Haibo Hu, 2013. "Communication and organizational social networks: a simulation model," Computational and Mathematical Organization Theory, Springer, vol. 19(4), pages 460-479, December.
    2. Dehua Gao & Aliakbar Akbaritabar, 2022. "Using agent-based modeling in routine dynamics research: a quantitative and content analysis of literature," Review of Managerial Science, Springer, vol. 16(2), pages 521-550, February.
    3. Lea Sonderegger-Wakolbinger & Christian Stummer, 2015. "An agent-based simulation of customer multi-channel choice behavior," Central European Journal of Operations Research, Springer;Slovak Society for Operations Research;Hungarian Operational Research Society;Czech Society for Operations Research;Österr. Gesellschaft für Operations Research (ÖGOR);Slovenian Society Informatika - Section for Operational Research;Croatian Operational Research Society, vol. 23(2), pages 459-477, June.
    4. Azar, Elie & Nikolopoulou, Christina & Papadopoulos, Sokratis, 2016. "Integrating and optimizing metrics of sustainable building performance using human-focused agent-based modeling," Applied Energy, Elsevier, vol. 183(C), pages 926-937.
    5. Bing Bai & Byungjoon Yoo & Xiuquan Deng & Iljoo Kim & Dehua Gao, 2016. "Linking routines to the evolution of IT capability on agent-based modeling and simulation: a dynamic perspective," Computational and Mathematical Organization Theory, Springer, vol. 22(2), pages 184-211, June.
    6. Jiang, Guoyin & Shang, Jennifer & Liu, Wenping & Feng, Xiaodong & Lei, Junli, 2020. "Modeling the dynamics of online review life cycle: Role of social and economic moderations," European Journal of Operational Research, Elsevier, vol. 285(1), pages 360-379.
    7. Zhu, Hou & Hu, Bin, 2018. "Impact of information on public opinion reversal—An agent based model," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 512(C), pages 578-587.
    8. Jiang, Guoyin & Tadikamalla, Pandu R. & Shang, Jennifer & Zhao, Ling, 2016. "Impacts of knowledge on online brand success: an agent-based model for online market share enhancement," European Journal of Operational Research, Elsevier, vol. 248(3), pages 1093-1103.
    9. M Günther & C Stummer & L M Wakolbinger & M Wildpaner, 2011. "An agent-based simulation approach for the new product diffusion of a novel biomass fuel," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 62(1), pages 12-20, January.
    10. Yu Zhang & Jason Leezer, 2010. "Simulating human-like decisions in a memory-based agent model," Computational and Mathematical Organization Theory, Springer, vol. 16(4), pages 373-399, December.
    11. Kathleen M Carley & Geoffrey P Morgan & Michael J Lanham, 2018. "Deterring the development and use of nuclear weapons: a multi-level modeling approach," The Journal of Defense Modeling and Simulation, , vol. 15(4), pages 483-493, October.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Arnold Reisman & Muhittin Oral, 2005. "Soft Systems Methodology: A Context Within a 50-Year Retrospective of OR/MS," Interfaces, INFORMS, vol. 35(2), pages 164-178, April.
    2. C W Olphert & J M Wilson, 2004. "Validation of decision-aiding spreadsheets: the influence of contingency factors," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 55(1), pages 12-22, January.
    3. Janová, Jitka & Hampel, David & Nerudová, Danuše, 2019. "Design and validation of a tax sustainability index," European Journal of Operational Research, Elsevier, vol. 278(3), pages 916-926.
    4. Norese, Maria Franca & Viale, Susanna, 2002. "A multi-profile sorting procedure in the public administration," European Journal of Operational Research, Elsevier, vol. 138(2), pages 365-379, April.
    5. Landry, M. & Banville, C. & Oral, M., 1996. "Model legitimisation in operational research," European Journal of Operational Research, Elsevier, vol. 92(3), pages 443-457, August.
    6. D Champion & J M Wilson, 2010. "The impact of contingency factors on validation of problem structuring methods," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 61(9), pages 1420-1431, September.
    7. Robinson, Stewart, 2002. "General concepts of quality for discrete-event simulation," European Journal of Operational Research, Elsevier, vol. 138(1), pages 103-117, April.
    8. Mingers, John & Rosenhead, Jonathan, 2004. "Problem structuring methods in action," European Journal of Operational Research, Elsevier, vol. 152(3), pages 530-554, February.
    9. Luís de Sousa & Alberto Rodrigues da Silva, 2015. "Showcasing a Domain Specific Language for Spatial Simulation Scenarios with case studies," ERSA conference papers ersa15p1044, European Regional Science Association.
    10. Ross Richardson & Matteo G. Richiardi & Michael Wolfson, 2015. "We ran one billion agents. Scaling in simulation models," LABORatorio R. Revelli Working Papers Series 142, LABORatorio R. Revelli, Centre for Employment Studies.
    11. Andrada Tomoaia‐Cotisel & Samuel D. Allen & Hyunjung Kim & David Andersen & Zaid Chalabi, 2022. "Rigorously interpreted quotation analysis for evaluating causal loop diagrams in late‐stage conceptualization," System Dynamics Review, System Dynamics Society, vol. 38(1), pages 41-80, January.
    12. Cincotti, Silvano & Raberto, Marco & Teglio, Andrea, 2010. "Credit money and macroeconomic instability in the agent-based model and simulator Eurace," Economics - The Open-Access, Open-Assessment E-Journal (2007-2020), Kiel Institute for the World Economy (IfW Kiel), vol. 4, pages 1-32.
    13. Kleijnen, J.P.C., 1995. "Statistical validation of simulation models : A case study," Other publications TiSEM 4da192cf-c3f4-40a4-aea4-5, Tilburg University, School of Economics and Management.
    14. Joshua M. Epstein, 2007. "Agent-Based Computational Models and Generative Social Science," Introductory Chapters, in: Generative Social Science Studies in Agent-Based Computational Modeling, Princeton University Press.
    15. Rich, Karl M. & Ross, R. Brent & Baker, A. Derek & Negassa, Asfaw, 2011. "Quantifying value chain analysis in the context of livestock systems in developing countries," Food Policy, Elsevier, vol. 36(2), pages 214-222, April.
    16. Laobing Zhang & Gabriele Landucci & Genserik Reniers & Nima Khakzad & Jianfeng Zhou, 2018. "DAMS: A Model to Assess Domino Effects by Using Agent‐Based Modeling and Simulation," Risk Analysis, John Wiley & Sons, vol. 38(8), pages 1585-1600, August.
    17. Luca Riccetti & Alberto Russo & Mauro Gallegati, 2015. "An agent based decentralized matching macroeconomic model," Journal of Economic Interaction and Coordination, Springer;Society for Economic Science with Heterogeneous Interacting Agents, vol. 10(2), pages 305-332, October.
    18. Yanuar Nugroho & Gindo Tampubolon, 2008. "Network Dynamics in the Transition to Democracy: Mapping Global Networks of Contemporary Indonesian Civil Society," Sociological Research Online, , vol. 13(5), pages 144-160, September.
    19. Barr, Jason & Saraceno, Francesco, 2009. "Organization, learning and cooperation," Journal of Economic Behavior & Organization, Elsevier, vol. 70(1-2), pages 39-53, May.
    20. Sheri M. Markose, 2005. "Computability and Evolutionary Complexity: Markets as Complex Adaptive Systems (CAS)," Economic Journal, Royal Economic Society, vol. 115(504), pages 159-192, 06.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:comaot:v:12:y:2006:i:4:d:10.1007_s10588-006-8873-y. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.