IDEAS home Printed from https://ideas.repec.org/a/eee/jeborg/v215y2023icp382-405.html
   My bibliography  Save this article

Observing the creation of new knowledge in the economics laboratory—Do participants discover how to learn from outcome feedback in a dynamic decision problem?

Author

Listed:
  • Pittnauer, Sabine
  • Hohnisch, Martin

Abstract

Domain-general learning rules often enable decision makers to learn from outcome feedback which actions tend to achieve a desired goal. However, in novel and complex environments decision makers must explore how to learn, i.e., acquire procedural knowledge of how to elicit and evaluate outcome feedback that will enable them to navigate toward a desired goal despite the vastness of the set of possible policies. Using a dynamic business simulation, this study investigated: (1) whether and how frequently participants discovered an effective procedure to learn from outcome feedback that allowed them to navigate toward a policy that maximizes long-term business profit (and hence their monetary payoff from the experiment), and (2) whether high monetary incentives affected learning procedures and performance. We found that a number of participants discovered an effective learning procedure and succeeded in approximating the optimal policy. In line with the heuristic method, this learning procedure involved a simplification of the search space and the application of domain-general learning rules to this simplified space. Although the decision histories of about half of the participants feature the key aspect of the effective learning procedure—search among the different steady states of the dynamical system—implementation errors prevented many of the participants from realizing the full potential of the learning procedure. We found no evidence to suggest that high monetary incentives affect the effectiveness of learning. Overall, the study illustrates that a “prepared mind” can discover new, effective learning procedures, although their initial implementation may require substantial refinement.

Suggested Citation

  • Pittnauer, Sabine & Hohnisch, Martin, 2023. "Observing the creation of new knowledge in the economics laboratory—Do participants discover how to learn from outcome feedback in a dynamic decision problem?," Journal of Economic Behavior & Organization, Elsevier, vol. 215(C), pages 382-405.
  • Handle: RePEc:eee:jeborg:v:215:y:2023:i:c:p:382-405
    DOI: 10.1016/j.jebo.2023.09.015
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0167268123003311
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.jebo.2023.09.015?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Daniel Houser & Michael Keane & Kevin McCabe, 2004. "Behavior in a Dynamic Decision Problem: An Analysis of Experimental Evidence Using a Bayesian Type Classification Algorithm," Econometrica, Econometric Society, vol. 72(3), pages 781-822, May.
    2. Camerer, Colin F & Hogarth, Robin M, 1999. "The Effects of Financial Incentives in Experiments: A Review and Capital-Labor-Production Framework," Journal of Risk and Uncertainty, Springer, vol. 19(1-3), pages 7-42, December.
    3. Christina Fang & Daniel Levinthal, 2009. "Near-Term Liability of Exploitation: Exploration and Exploitation in Multistage Problems," Organization Science, INFORMS, vol. 20(3), pages 538-551, June.
    4. Erling Moxnes, 1998. "Not Only the Tragedy of the Commons: Misperceptions of Bioeconomics," Management Science, INFORMS, vol. 44(9), pages 1234-1248, September.
    5. Debanjan Mitra & Peter N. Golder, 2006. "How Does Objective Quality Affect Perceived Quality? Short-Term Effects, Long-Term Effects, and Asymmetries," Marketing Science, INFORMS, vol. 25(3), pages 230-247, 05-06.
    6. Michael J. Leiblein & Jeffrey J. Reuer & Todd Zenger, 2018. "What Makes a Decision Strategic?," Strategy Science, INFORMS, vol. 3(4), pages 558-573, December.
    7. Bonner, Sarah E. & Sprinkle, Geoffrey B., 2002. "The effects of monetary incentives on effort and task performance: theories, evidence, and a framework for research," Accounting, Organizations and Society, Elsevier, vol. 27(4-5), pages 303-345.
    8. MacLeod, W. Bentley & Pingle, Mark, 2005. "Aspiration uncertainty: its impact on decision performance and process," Journal of Economic Behavior & Organization, Elsevier, vol. 56(4), pages 617-629, April.
    9. Colin Camerer & Teck-Hua Ho, 1999. "Experience-weighted Attraction Learning in Normal Form Games," Econometrica, Econometric Society, vol. 67(4), pages 827-874, July.
    10. Herbert A. Simon, 1996. "The Sciences of the Artificial, 3rd Edition," MIT Press Books, The MIT Press, edition 1, volume 1, number 0262691914, December.
    11. Richard H. Day, 1995. "Rationality, Entrepreneurship and Institutional Evolution," Revue Économique, Programme National Persée, vol. 46(6), pages 1473-1485.
    12. Day, Richard H., 1984. "Disequilibrium economic dynamics : A post-Schumpeterian contribution," Journal of Economic Behavior & Organization, Elsevier, vol. 5(1), pages 57-76, March.
    13. Andrew B. Hargadon & Beth A. Bechky, 2006. "When Collections of Creatives Become Creative Collectives: A Field Study of Problem Solving at Work," Organization Science, INFORMS, vol. 17(4), pages 484-500, August.
    14. Pingle, Mark, 1992. "Costly optimization: an experiment," Journal of Economic Behavior & Organization, Elsevier, vol. 17(1), pages 3-30, January.
    15. Francesco Castellaneta & Oliver Gottschalg & Aleksandra Kacperczyk & Mike Wright, 2022. "Experience as Dr. Jekyll and Mr. Hyde: Performance Outcome Delays in the Private Equity Context," Journal of Management Studies, Wiley Blackwell, vol. 59(6), pages 1359-1385, September.
    16. Diehl, Ernst & Sterman, John D., 1995. "Effects of Feedback Complexity on Dynamic Decision Making," Organizational Behavior and Human Decision Processes, Elsevier, vol. 62(2), pages 198-215, May.
    17. Martin Hohnisch & Sabine Pittnauer & Reinhard Selten & Andreas Pfingsten, 2016. "Designing for Deliberative Goal-Based Decision Making in Environments with Rare Adverse Events—An Experimental Study," Organization Science, INFORMS, vol. 27(6), pages 1417-1434, December.
    18. Dan Ariely & Uri Gneezy & George Loewenstein & Nina Mazar, 2009. "Large Stakes and Big Mistakes," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 76(2), pages 451-469.
    19. Moxnes, Erling, 1998. "Overexploitation of renewable resources: The role of misperceptions," Journal of Economic Behavior & Organization, Elsevier, vol. 37(1), pages 107-127, September.
    20. Cronin, Matthew A. & Gonzalez, Cleotilde & Sterman, John D., 2009. "Why don't well-educated adults understand accumulation? A challenge to researchers, educators, and citizens," Organizational Behavior and Human Decision Processes, Elsevier, vol. 108(1), pages 116-130, January.
    21. Mas-Colell, Andreu & Whinston, Michael D. & Green, Jerry R., 1995. "Microeconomic Theory," OUP Catalogue, Oxford University Press, number 9780195102680.
    22. John D. Sterman, 1989. "Modeling Managerial Behavior: Misperceptions of Feedback in a Dynamic Decision Making Experiment," Management Science, INFORMS, vol. 35(3), pages 321-339, March.
    23. Vernon L. Smith, 1964. "Effect of Market Organization on Competitive Equilibrium," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 78(2), pages 181-201.
    24. Lori Rosenkopf & Atul Nerkar, 2001. "Beyond local search: boundary‐spanning, exploration, and impact in the optical disk industry," Strategic Management Journal, Wiley Blackwell, vol. 22(4), pages 287-306, April.
    25. David J. Teece & Gary Pisano & Amy Shuen, 1997. "Dynamic capabilities and strategic management," Strategic Management Journal, Wiley Blackwell, vol. 18(7), pages 509-533, August.
    26. Erev, I. & Roth, Alvin E., 2014. "Maximization, learning, and economic behavior," Scholarly Articles 30831199, Harvard University Department of Economics.
    27. Lee Fleming & Olav Sorenson, 2004. "Science as a map in technological search," Strategic Management Journal, Wiley Blackwell, vol. 25(8‐9), pages 909-928, August.
    28. Pingle, Mark & Day, Richard H., 1996. "Modes of economizing behavior: Experimental evidence," Journal of Economic Behavior & Organization, Elsevier, vol. 29(2), pages 191-209, March.
    29. Christina Fang, 2012. "Organizational Learning as Credit Assignment: A Model and Two Experiments," Organization Science, INFORMS, vol. 23(6), pages 1717-1732, December.
    30. Felipe A. Csaszar & Daniel A. Levinthal, 2016. "Mental representation and the discovery of new strategies," Strategic Management Journal, Wiley Blackwell, vol. 37(10), pages 2031-2049, October.
    31. Bock, Olaf & Baetge, Ingmar & Nicklisch, Andreas, 2014. "hroot: Hamburg Registration and Organization Online Tool," European Economic Review, Elsevier, vol. 71(C), pages 117-120.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Arango, Santiago & Moxnes, Erling, 2012. "Commodity cycles, a function of market complexity? Extending the cobweb experiment," Journal of Economic Behavior & Organization, Elsevier, vol. 84(1), pages 321-334.
    2. Hazhir Rahmandad & Jerker Denrell & Drazen Prelec, 2021. "What makes dynamic strategic problems difficult? Evidence from an experimental study," Strategic Management Journal, Wiley Blackwell, vol. 42(5), pages 865-897, May.
    3. Schnier, Kurt E. & Anderson, Christopher M., 2006. "Decision making in patchy resource environments: Spatial misperception of bioeconomic models," Journal of Economic Behavior & Organization, Elsevier, vol. 61(2), pages 234-254, October.
    4. H. Stouten & A. Heene & X. Gellynck & H. Polet, 2008. "The effect of restrictive policy instruments on Belgian fishing fleet dynamics," Working Papers of Faculty of Economics and Business Administration, Ghent University, Belgium 08/540, Ghent University, Faculty of Economics and Business Administration.
    5. Strohhecker, Jürgen & Leyer, Michael, 2019. "How stock-flow failure and general cognitive ability impact performance in operational dynamic control tasks," European Journal of Operational Research, Elsevier, vol. 276(3), pages 1044-1055.
    6. Jürgen Strohhecker & Andreas Größler, 2012. "Implementing Sustainable Business Strategies," Systems Research and Behavioral Science, Wiley Blackwell, vol. 29(6), pages 547-570, November.
    7. Strohhecker, Jürgen & Größler, Andreas, 2013. "Do personal traits influence inventory management performance?—The case of intelligence, personality, interest and knowledge," International Journal of Production Economics, Elsevier, vol. 142(1), pages 37-50.
    8. David H. Hsu & Kwanghui Lim, 2014. "Knowledge Brokering and Organizational Innovation: Founder Imprinting Effects," Organization Science, INFORMS, vol. 25(4), pages 1134-1153, August.
    9. Mittone, Luigi & Morreale, Azzurra & Ritala, Paavo, 2024. "Initial conditions and path dependence in explorative and exploitative learning: An experimental study," Technovation, Elsevier, vol. 129(C).
    10. Cronin, Matthew A. & Gonzalez, Cleotilde & Sterman, John D., 2009. "Why don't well-educated adults understand accumulation? A challenge to researchers, educators, and citizens," Organizational Behavior and Human Decision Processes, Elsevier, vol. 108(1), pages 116-130, January.
    11. Langley, Paul A. & Morecroft, John D. W., 2004. "Performance and learning in a simulation of oil industry dynamics," European Journal of Operational Research, Elsevier, vol. 155(3), pages 715-732, June.
    12. Gogi, Anastasia & Tako, Antuela A. & Robinson, Stewart, 2016. "An experimental investigation into the role of simulation models in generating insights," European Journal of Operational Research, Elsevier, vol. 249(3), pages 931-944.
    13. Marshall S. Jiang & Jie Jiao & Zhouyu Lin & Jun Xia, 2021. "Learning through observation or through acquisition? Innovation performance as an outcome of internal and external knowledge combination," Asia Pacific Journal of Management, Springer, vol. 38(1), pages 35-63, March.
    14. Capaldo, Antonio & Messeni Petruzzelli, Antonio, 2011. "In search of alliance-level relational capabilities: Balancing innovation value creation and appropriability in R&D alliances," Scandinavian Journal of Management, Elsevier, vol. 27(3), pages 273-286, September.
    15. John Hey & Tibor Neugebauer & Abdolkarim Sadrieh, 2009. "An Experimental Analysis of Optimal Renewable Resource Management: The Fishery," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 44(2), pages 263-285, October.
    16. Thompson, James P. & Howick, Susan & Belton, Valerie, 2016. "Critical Learning Incidents in system dynamics modelling engagements," European Journal of Operational Research, Elsevier, vol. 249(3), pages 945-958.
    17. Kirsten Davis & Navid Ghaffarzadegan & Jacob Grohs & Dustin Grote & Niyousha Hosseinichimeh & David Knight & Hesam Mahmoudi & Konstantinos Triantis, 2020. "The Lake Urmia vignette: a tool to assess understanding of complexity in socio‐environmental systems," System Dynamics Review, System Dynamics Society, vol. 36(2), pages 191-222, April.
    18. Faison P. Gibson, 2003. "Supporting Learning in Evolving Dynamic Environments," Computational and Mathematical Organization Theory, Springer, vol. 9(4), pages 305-326, December.
    19. Jonathan E. Alevy & Craig E. Landry & John A. List, 2015. "Field Experiments On The Anchoring Of Economic Valuations," Economic Inquiry, Western Economic Association International, vol. 53(3), pages 1522-1538, July.
    20. Hyun Ju Jung, 2020. "Recombination sources and breakthrough inventions: university-developed technology versus firm-developed technology," The Journal of Technology Transfer, Springer, vol. 45(4), pages 1121-1166, August.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jeborg:v:215:y:2023:i:c:p:382-405. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/jebo .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.