IDEAS home Printed from https://ideas.repec.org/p/haf/huedwp/wp201503.html
   My bibliography  Save this paper

Contemplation vs. Intuition. A reinforcement learning approach

Author

Listed:

Abstract

In a search for a positive model of decision-making with observable primitives, we rely on the burgeoning literature in cognitive neuroscience to construct a three-element machine (agent). Its control unit initiates either impulsive or cognitive element to solve a problem in a stationary Markov environment, the element "chosen" depends on whether the problem is mundane or novel, memory of past successes and the strength of inhibition. Our predictions are based on a stationary asymptotic distribution of the memory, which, depending on the parameters, can generate different "characters", e.g., an uptight dimwit, who could succeed more often with less inhibition, as well as a relaxed wise-guy, who could gain more with a stronger inhibition of impulsive (intuitive) responses. As one would expect, stronger inhibition and lower cognitive costs increase the frequency of decisions made by the cognitive element. More surprisingly, increasing the "carrot" and reducing the "stick" (being in a more supportive environment) enhances contemplative decisions (made by the cognitive unit) for an alert agent, i.e., the one who identifies novel problems frequently enough.

Suggested Citation

  • CHO, IN-KOO & Rubinchik, Anna, "undated". "Contemplation vs. Intuition. A reinforcement learning approach," Working Papers WP2015/3, University of Haifa, Department of Economics.
  • Handle: RePEc:haf:huedwp:wp201503
    as

    Download full text from publisher

    File URL: http://hevra.haifa.ac.il/econ/wp_files/wp201503.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Gilboa,Itzhak & Schmeidler,David, 2001. "A Theory of Case-Based Decisions," Cambridge Books, Cambridge University Press, number 9780521802345.
    2. Sims, Christopher A., 2010. "Rational Inattention and Monetary Economics," Handbook of Monetary Economics, in: Benjamin M. Friedman & Michael Woodford (ed.), Handbook of Monetary Economics, edition 1, volume 3, chapter 4, pages 155-181, Elsevier.
    3. Alos Ferrer, Carlos, 2013. "Think, but Not Too Much: A Dual-Process Model of Willpower and Self-Control," VfS Annual Conference 2013 (Duesseldorf): Competition Policy and Regulation in a Global Economic Order 80019, Verein für Socialpolitik / German Economic Association.
    4. Michael Woodford, 2012. "Prospect Theory as Efficient Perceptual Distortion," American Economic Review, American Economic Association, vol. 102(3), pages 41-46, May.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Lunn, Pete & Somerville, Jason J., 2015. "Surplus Identification with Non-Linear Returns," Papers WP522, Economic and Social Research Institute (ESRI).
    2. In-Koo Cho & Anna Rubinchik, 2017. "Contemplation vs. intuition: a reinforcement learning perspective," EURO Journal on Decision Processes, Springer;EURO - The Association of European Operational Research Societies, vol. 5(1), pages 141-167, November.
    3. Hansen, Lars Peter & Sargent, Thomas J., 2022. "Structured ambiguity and model misspecification," Journal of Economic Theory, Elsevier, vol. 199(C).
    4. Atal, Vidya & Bar, Talia & Gordon, Sidartha, 2016. "Project selection: Commitment and competition," Games and Economic Behavior, Elsevier, vol. 96(C), pages 30-48.
    5. Johannes Johnen, 2019. "Automatic‐renewal contracts with heterogeneous consumer inertia," Journal of Economics & Management Strategy, Wiley Blackwell, vol. 28(4), pages 765-786, November.
    6. Chatelain, Jean-Bernard & Ralf, Kirsten, 2020. "Hopf Bifurcation from New-Keynesian Taylor Rule to Ramsey Optimal Policy," EconStor Open Access Articles, ZBW - Leibniz Information Centre for Economics.
    7. Itzhak Gilboa & Andrew Postlewaite & Larry Samuelson & David Schmeidler, 2019. "What are axiomatizations good for?," Theory and Decision, Springer, vol. 86(3), pages 339-359, May.
    8. Roos, Michael W. M., 2015. "The macroeconomics of radical uncertainty," Ruhr Economic Papers 592, RWI - Leibniz-Institut für Wirtschaftsforschung, Ruhr-University Bochum, TU Dortmund University, University of Duisburg-Essen.
    9. Stephen L. Cheung & Agnieszka Tymula & Xueting Wang, 2022. "Present bias for monetary and dietary rewards," Experimental Economics, Springer;Economic Science Association, vol. 25(4), pages 1202-1233, September.
    10. Itzhak Gilboa & Andrew Postlewaite & Larry Samuelson & David Schmeidler, 2011. "Economic Models as Analogies," PIER Working Paper Archive 12-001, Penn Institute for Economic Research, Department of Economics, University of Pennsylvania.
    11. Joshua Aizenman & Mahir Binici & Michael M. Hutchison, 2016. "The Transmission of Federal Reserve Tapering News to Emerging Financial Markets," International Journal of Central Banking, International Journal of Central Banking, vol. 12(2), pages 317-356, June.
    12. Gilboa, Itzhak & Samuelson, Larry & Schmeidler, David, 2013. "Dynamics of inductive inference in a unified framework," Journal of Economic Theory, Elsevier, vol. 148(4), pages 1399-1432.
    13. Roland G. Fryer & Matthew O. Jackson, 2002. "Categorical Cognition: A Psychological Model of Categories and Identification in Decision Making," Microeconomics 0211002, University Library of Munich, Germany.
    14. Luo, Yulei & Young, Eric R., 2016. "Induced uncertainty, market price of risk, and the dynamics of consumption and wealth," Journal of Economic Theory, Elsevier, vol. 163(C), pages 1-41.
    15. Itzhak Gilboa & Andrew Postlewaite & Larry Samuelson & David Schmeidler, 2014. "A Model of Modeling," PIER Working Paper Archive 14-026, Penn Institute for Economic Research, Department of Economics, University of Pennsylvania.
    16. O'Callaghan, Patrick, 2016. "Measuring utility without mixing apples and oranges and eliciting beliefs about stock prices," MPRA Paper 69363, University Library of Munich, Germany.
    17. Luigi Paciello & Mirko Wiederholt, 2014. "Exogenous Information, Endogenous Information, and Optimal Monetary Policy," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 81(1), pages 356-388.
    18. Prato, Carlo & Wolton, Stephane, 2018. "Rational ignorance, populism, and reform," European Journal of Political Economy, Elsevier, vol. 55(C), pages 119-135.
    19. Lindé, Jesper & Smets, Frank & Wouters, Rafael, 2016. "Challenges for Central Banks´ Macro Models," Working Paper Series 323, Sveriges Riksbank (Central Bank of Sweden).
    20. Marco LiCalzi & Roland Mühlenbernd, 2022. "Feature-weighted categorized play across symmetric games," Experimental Economics, Springer;Economic Science Association, vol. 25(3), pages 1052-1078, June.

    More about this item

    Keywords

    the two-system decision-making; executive control; inhibition; adaptive learning; stochastic approximation;
    All these keywords.

    JEL classification:

    • D01 - Microeconomics - - General - - - Microeconomic Behavior: Underlying Principles

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:haf:huedwp:wp201503. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Anna Rubinchik (email available below). General contact details of provider: https://edirc.repec.org/data/dehaiil.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.