IDEAS home Printed from https://ideas.repec.org/a/eee/jeborg/v215y2023icp382-405.html
   My bibliography  Save this article

Observing the creation of new knowledge in the economics laboratory—Do participants discover how to learn from outcome feedback in a dynamic decision problem?

Author

Listed:
  • Pittnauer, Sabine
  • Hohnisch, Martin

Abstract

Domain-general learning rules often enable decision makers to learn from outcome feedback which actions tend to achieve a desired goal. However, in novel and complex environments decision makers must explore how to learn, i.e., acquire procedural knowledge of how to elicit and evaluate outcome feedback that will enable them to navigate toward a desired goal despite the vastness of the set of possible policies. Using a dynamic business simulation, this study investigated: (1) whether and how frequently participants discovered an effective procedure to learn from outcome feedback that allowed them to navigate toward a policy that maximizes long-term business profit (and hence their monetary payoff from the experiment), and (2) whether high monetary incentives affected learning procedures and performance. We found that a number of participants discovered an effective learning procedure and succeeded in approximating the optimal policy. In line with the heuristic method, this learning procedure involved a simplification of the search space and the application of domain-general learning rules to this simplified space. Although the decision histories of about half of the participants feature the key aspect of the effective learning procedure—search among the different steady states of the dynamical system—implementation errors prevented many of the participants from realizing the full potential of the learning procedure. We found no evidence to suggest that high monetary incentives affect the effectiveness of learning. Overall, the study illustrates that a “prepared mind” can discover new, effective learning procedures, although their initial implementation may require substantial refinement.

Suggested Citation

  • Pittnauer, Sabine & Hohnisch, Martin, 2023. "Observing the creation of new knowledge in the economics laboratory—Do participants discover how to learn from outcome feedback in a dynamic decision problem?," Journal of Economic Behavior & Organization, Elsevier, vol. 215(C), pages 382-405.
  • Handle: RePEc:eee:jeborg:v:215:y:2023:i:c:p:382-405
    DOI: 10.1016/j.jebo.2023.09.015
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0167268123003311
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.jebo.2023.09.015?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Moxnes, Erling, 1998. "Overexploitation of renewable resources: The role of misperceptions," Journal of Economic Behavior & Organization, Elsevier, vol. 37(1), pages 107-127, September.
    2. Daniel Houser & Michael Keane & Kevin McCabe, 2004. "Behavior in a Dynamic Decision Problem: An Analysis of Experimental Evidence Using a Bayesian Type Classification Algorithm," Econometrica, Econometric Society, vol. 72(3), pages 781-822, May.
    3. Camerer, Colin F & Hogarth, Robin M, 1999. "The Effects of Financial Incentives in Experiments: A Review and Capital-Labor-Production Framework," Journal of Risk and Uncertainty, Springer, vol. 19(1-3), pages 7-42, December.
    4. Christina Fang & Daniel Levinthal, 2009. "Near-Term Liability of Exploitation: Exploration and Exploitation in Multistage Problems," Organization Science, INFORMS, vol. 20(3), pages 538-551, June.
    5. Erling Moxnes, 1998. "Not Only the Tragedy of the Commons: Misperceptions of Bioeconomics," Management Science, INFORMS, vol. 44(9), pages 1234-1248, September.
    6. Cronin, Matthew A. & Gonzalez, Cleotilde & Sterman, John D., 2009. "Why don't well-educated adults understand accumulation? A challenge to researchers, educators, and citizens," Organizational Behavior and Human Decision Processes, Elsevier, vol. 108(1), pages 116-130, January.
    7. Debanjan Mitra & Peter N. Golder, 2006. "How Does Objective Quality Affect Perceived Quality? Short-Term Effects, Long-Term Effects, and Asymmetries," Marketing Science, INFORMS, vol. 25(3), pages 230-247, 05-06.
    8. Michael J. Leiblein & Jeffrey J. Reuer & Todd Zenger, 2018. "What Makes a Decision Strategic?," Strategy Science, INFORMS, vol. 3(4), pages 558-573, December.
    9. Bonner, Sarah E. & Sprinkle, Geoffrey B., 2002. "The effects of monetary incentives on effort and task performance: theories, evidence, and a framework for research," Accounting, Organizations and Society, Elsevier, vol. 27(4-5), pages 303-345.
    10. Mas-Colell, Andreu & Whinston, Michael D. & Green, Jerry R., 1995. "Microeconomic Theory," OUP Catalogue, Oxford University Press, number 9780195102680.
    11. MacLeod, W. Bentley & Pingle, Mark, 2005. "Aspiration uncertainty: its impact on decision performance and process," Journal of Economic Behavior & Organization, Elsevier, vol. 56(4), pages 617-629, April.
    12. Colin Camerer & Teck-Hua Ho, 1999. "Experience-weighted Attraction Learning in Normal Form Games," Econometrica, Econometric Society, vol. 67(4), pages 827-874, July.
    13. John D. Sterman, 1989. "Modeling Managerial Behavior: Misperceptions of Feedback in a Dynamic Decision Making Experiment," Management Science, INFORMS, vol. 35(3), pages 321-339, March.
    14. Herbert A. Simon, 1996. "The Sciences of the Artificial, 3rd Edition," MIT Press Books, The MIT Press, edition 1, volume 1, number 0262691914, December.
    15. Richard H. Day, 1995. "Rationality, Entrepreneurship and Institutional Evolution," Revue Économique, Programme National Persée, vol. 46(6), pages 1473-1485.
    16. Vernon L. Smith, 1964. "Effect of Market Organization on Competitive Equilibrium," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 78(2), pages 181-201.
    17. Day, Richard H., 1984. "Disequilibrium economic dynamics : A post-Schumpeterian contribution," Journal of Economic Behavior & Organization, Elsevier, vol. 5(1), pages 57-76, March.
    18. Andrew B. Hargadon & Beth A. Bechky, 2006. "When Collections of Creatives Become Creative Collectives: A Field Study of Problem Solving at Work," Organization Science, INFORMS, vol. 17(4), pages 484-500, August.
    19. Lori Rosenkopf & Atul Nerkar, 2001. "Beyond local search: boundary‐spanning, exploration, and impact in the optical disk industry," Strategic Management Journal, Wiley Blackwell, vol. 22(4), pages 287-306, April.
    20. David J. Teece & Gary Pisano & Amy Shuen, 1997. "Dynamic capabilities and strategic management," Strategic Management Journal, Wiley Blackwell, vol. 18(7), pages 509-533, August.
    21. Erev, I. & Roth, Alvin E., 2014. "Maximization, learning, and economic behavior," Scholarly Articles 30831199, Harvard University Department of Economics.
    22. Pingle, Mark, 1992. "Costly optimization: an experiment," Journal of Economic Behavior & Organization, Elsevier, vol. 17(1), pages 3-30, January.
    23. Lee Fleming & Olav Sorenson, 2004. "Science as a map in technological search," Strategic Management Journal, Wiley Blackwell, vol. 25(8‐9), pages 909-928, August.
    24. Francesco Castellaneta & Oliver Gottschalg & Aleksandra Kacperczyk & Mike Wright, 2022. "Experience as Dr. Jekyll and Mr. Hyde: Performance Outcome Delays in the Private Equity Context," Journal of Management Studies, Wiley Blackwell, vol. 59(6), pages 1359-1385, September.
    25. Pingle, Mark & Day, Richard H., 1996. "Modes of economizing behavior: Experimental evidence," Journal of Economic Behavior & Organization, Elsevier, vol. 29(2), pages 191-209, March.
    26. Dan Ariely & Uri Gneezy & George Loewenstein & Nina Mazar, 2009. "Large Stakes and Big Mistakes," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 76(2), pages 451-469.
    27. Christina Fang, 2012. "Organizational Learning as Credit Assignment: A Model and Two Experiments," Organization Science, INFORMS, vol. 23(6), pages 1717-1732, December.
    28. Felipe A. Csaszar & Daniel A. Levinthal, 2016. "Mental representation and the discovery of new strategies," Strategic Management Journal, Wiley Blackwell, vol. 37(10), pages 2031-2049, October.
    29. Diehl, Ernst & Sterman, John D., 1995. "Effects of Feedback Complexity on Dynamic Decision Making," Organizational Behavior and Human Decision Processes, Elsevier, vol. 62(2), pages 198-215, May.
    30. Bock, Olaf & Baetge, Ingmar & Nicklisch, Andreas, 2014. "hroot: Hamburg Registration and Organization Online Tool," European Economic Review, Elsevier, vol. 71(C), pages 117-120.
    31. Martin Hohnisch & Sabine Pittnauer & Reinhard Selten & Andreas Pfingsten, 2016. "Designing for Deliberative Goal-Based Decision Making in Environments with Rare Adverse Events—An Experimental Study," Organization Science, INFORMS, vol. 27(6), pages 1417-1434, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Arango, Santiago & Moxnes, Erling, 2012. "Commodity cycles, a function of market complexity? Extending the cobweb experiment," Journal of Economic Behavior & Organization, Elsevier, vol. 84(1), pages 321-334.
    2. Strohhecker, Jürgen & Leyer, Michael, 2019. "How stock-flow failure and general cognitive ability impact performance in operational dynamic control tasks," European Journal of Operational Research, Elsevier, vol. 276(3), pages 1044-1055.
    3. Hazhir Rahmandad & Jerker Denrell & Drazen Prelec, 2021. "What makes dynamic strategic problems difficult? Evidence from an experimental study," Strategic Management Journal, Wiley Blackwell, vol. 42(5), pages 865-897, May.
    4. Jürgen Strohhecker & Andreas Größler, 2012. "Implementing Sustainable Business Strategies," Systems Research and Behavioral Science, Wiley Blackwell, vol. 29(6), pages 547-570, November.
    5. Strohhecker, Jürgen & Größler, Andreas, 2013. "Do personal traits influence inventory management performance?—The case of intelligence, personality, interest and knowledge," International Journal of Production Economics, Elsevier, vol. 142(1), pages 37-50.
    6. Schnier, Kurt E. & Anderson, Christopher M., 2006. "Decision making in patchy resource environments: Spatial misperception of bioeconomic models," Journal of Economic Behavior & Organization, Elsevier, vol. 61(2), pages 234-254, October.
    7. H. Stouten & A. Heene & X. Gellynck & H. Polet, 2008. "The effect of restrictive policy instruments on Belgian fishing fleet dynamics," Working Papers of Faculty of Economics and Business Administration, Ghent University, Belgium 08/540, Ghent University, Faculty of Economics and Business Administration.
    8. Noah Gans & George Knox & Rachel Croson, 2007. "Simple Models of Discrete Choice and Their Performance in Bandit Experiments," Manufacturing & Service Operations Management, INFORMS, vol. 9(4), pages 383-408, December.
    9. John Hey & Tibor Neugebauer & Abdolkarim Sadrieh, 2009. "An Experimental Analysis of Optimal Renewable Resource Management: The Fishery," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 44(2), pages 263-285, October.
    10. David H. Hsu & Kwanghui Lim, 2014. "Knowledge Brokering and Organizational Innovation: Founder Imprinting Effects," Organization Science, INFORMS, vol. 25(4), pages 1134-1153, August.
    11. Stephan Billinger & Kannan Srikanth & Nils Stieglitz & Terry R. Schumacher, 2021. "Exploration and exploitation in complex search tasks: How feedback influences whether and where human agents search," Strategic Management Journal, Wiley Blackwell, vol. 42(2), pages 361-385, February.
    12. Mittone, Luigi & Morreale, Azzurra & Ritala, Paavo, 2024. "Initial conditions and path dependence in explorative and exploitative learning: An experimental study," Technovation, Elsevier, vol. 129(C).
    13. David C. Lane & Birgit Kopainsky & Ali Kerem Saysel, 2017. "Role of Information Feedback in Soil Nitrogen Management: Results from a Dynamic Simulation Game," Systems Research and Behavioral Science, Wiley Blackwell, vol. 34(4), pages 424-439, July.
    14. Cronin, Matthew A. & Gonzalez, Cleotilde & Sterman, John D., 2009. "Why don't well-educated adults understand accumulation? A challenge to researchers, educators, and citizens," Organizational Behavior and Human Decision Processes, Elsevier, vol. 108(1), pages 116-130, January.
    15. Langley, Paul A. & Morecroft, John D. W., 2004. "Performance and learning in a simulation of oil industry dynamics," European Journal of Operational Research, Elsevier, vol. 155(3), pages 715-732, June.
    16. Miles M. Yang & Hong Jiang & Michael Shayne Gary, 2016. "Challenging learning goals improve performance in dynamically complex microworld simulations," System Dynamics Review, System Dynamics Society, vol. 32(3-4), pages 204-232, July.
    17. Gogi, Anastasia & Tako, Antuela A. & Robinson, Stewart, 2016. "An experimental investigation into the role of simulation models in generating insights," European Journal of Operational Research, Elsevier, vol. 249(3), pages 931-944.
    18. Lurie, Nicholas H. & Swaminathan, Jayashankar M., 2009. "Is timely information always better? The effect of feedback frequency on decision making," Organizational Behavior and Human Decision Processes, Elsevier, vol. 108(2), pages 315-329, March.
    19. Marshall S. Jiang & Jie Jiao & Zhouyu Lin & Jun Xia, 2021. "Learning through observation or through acquisition? Innovation performance as an outcome of internal and external knowledge combination," Asia Pacific Journal of Management, Springer, vol. 38(1), pages 35-63, March.
    20. Capaldo, Antonio & Messeni Petruzzelli, Antonio, 2011. "In search of alliance-level relational capabilities: Balancing innovation value creation and appropriability in R&D alliances," Scandinavian Journal of Management, Elsevier, vol. 27(3), pages 273-286, September.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jeborg:v:215:y:2023:i:c:p:382-405. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/jebo .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.