IDEAS home Printed from https://ideas.repec.org/p/igi/igierp/381.html
   My bibliography  Save this paper

Recursive methods for incentive problems

Author

Listed:
  • Matthias Messner
  • Nicola Pavoni
  • Christopher Sleet

Abstract

Many separable dynamic incentive problems have primal recursive formulations in which utility promises serve as state variables. We associate families of dual recursive problems with these by selectively dualizing constraints. We make transparent the connections between recursive primal and dual approaches, relate value iteration under each and give conditions for it to be convergent to the true value function.

Suggested Citation

  • Matthias Messner & Nicola Pavoni & Christopher Sleet, 2011. "Recursive methods for incentive problems," Working Papers 381, IGIER (Innocenzo Gasparini Institute for Economic Research), Bocconi University.
    • Handle: RePEc:igi:igierp:381
    as

    Download full text from publisher

    File URL: https://repec.unibocconi.it/igier/igi/wp/2011/381.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Stephen E. Spear & Sanjay Srivastava, 1987. "On Repeated Moral Hazard with Discounting," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 54(4), pages 599-617.
    2. Kydland, Finn E. & Prescott, Edward C., 1980. "Dynamic optimal taxation, rational expectations and optimal control," Journal of Economic Dynamics and Control, Elsevier, vol. 2(1), pages 79-91, May.
    3. Emmanuel Farhi & Iván Werning, 2007. "Inequality and Social Discounting," Journal of Political Economy, University of Chicago Press, vol. 115(3), pages 365-402.
    4. Albert Marcet & Ramon Marimon, 2019. "Recursive Contracts," Econometrica, Econometric Society, vol. 87(5), pages 1589-1631, September.
    5. Rustichini, Aldo, 1998. "Dynamic Programming Solution of Incentive Constrained Problems," Journal of Economic Theory, Elsevier, vol. 78(2), pages 329-354, February.
    6. Fernandes, Ana & Phelan, Christopher, 2000. "A Recursive Formulation for Repeated Agency with History Dependence," Journal of Economic Theory, Elsevier, vol. 91(2), pages 223-247, April.
    7. Matthias Messner & Nicola Pavoni & Christopher Sleet, "undated". "Contractive Dual Methods for Incentive Problems," GSIA Working Papers 2012-E26, Carnegie Mellon University, Tepper School of Business.
    8. Harold Cole & Felix Kubler, 2012. "Recursive Contracts, Lotteries and Weakly Concave Pareto Sets," Review of Economic Dynamics, Elsevier for the Society for Economic Dynamics, vol. 15(4), pages 479-500, October.
    9. Kenneth L. Judd & Sevin Yeltekin & James Conklin, 2003. "Computing Supergame Equilibria," Econometrica, Econometric Society, vol. 71(4), pages 1239-1254, July.
    10. Matthias Messner & Nicola Pavoni, 2004. "On the Recursive Saddle Point Method," Working Papers 255, IGIER (Innocenzo Gasparini Institute for Economic Research), Bocconi University.
    11. Narayana R. Kocherlakota, 1996. "Implications of Efficient Risk Sharing without Commitment," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 63(4), pages 595-609.
    12. Arpad Abraham & Nicola Pavoni, 2008. "Efficient Allocations with Moral Hazard and Hidden Borrowing and Lending: A Recursive Formulation," Review of Economic Dynamics, Elsevier for the Society for Economic Dynamics, vol. 11(4), pages 781-803, October.
    13. Messner Matthias & Pavoni Nicola & Sleet Christopher, "undated". "On the Dual Approach to Recursive Optimization," GSIA Working Papers 2012-E12, Carnegie Mellon University, Tepper School of Business.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Marimon, Ramon & Werner, Jan, 2021. "The envelope theorem, Euler and Bellman equations, without differentiability," Journal of Economic Theory, Elsevier, vol. 196(C).
    2. Alexandros Theloudis & Jorge Velilla & Pierre-André Chiappori & J. Ignacio Gimenéz-Nadal & José Alberto Molina, 2022. "Commitment and the Dynamics of Household Labor Supply," Working Papers 2022-042, Human Capital and Economic Opportunity Working Group.
    3. Jean Guillaume Forand & Jan Zapal, 2017. "The Demand and Supply of Favours in Dynamic Relationships," CERGE-EI Working Papers wp605, The Center for Economic Research and Graduate Education - Economics Institute, Prague.
    4. Balbus, Łukasz & Reffett, Kevin & Woźny, Łukasz, 2012. "Stationary Markovian equilibrium in altruistic stochastic OLG models with limited commitment," Journal of Mathematical Economics, Elsevier, vol. 48(2), pages 115-132.
    5. Miao, Jianjun & Zhang, Yuzhe, 2015. "A duality approach to continuous-time contracting problems with limited commitment," Journal of Economic Theory, Elsevier, vol. 159(PB), pages 929-988.
    6. Messner Matthias & Pavoni Nicola & Sleet Christopher, "undated". "On the Dual Approach to Recursive Optimization," GSIA Working Papers 2012-E12, Carnegie Mellon University, Tepper School of Business.
    7. Kam, Timothy & Stauber, Ronald, 2016. "Solving dynamic public insurance games with endogenous agent distributions: Theory and computational approximation," Journal of Mathematical Economics, Elsevier, vol. 64(C), pages 77-98.
    8. Łukasz Balbus & Kevin Reffett & Łukasz Woźny, 2015. "Time consistent Markov policies in dynamic economies with quasi-hyperbolic consumers," International Journal of Game Theory, Springer;Game Theory Society, vol. 44(1), pages 83-112, February.
    9. Balke, Neele & Lamadon, Thibaut, 2021. "Productivity shocks, long-term contracts and earnings dynamics," Working Paper Series 2021:19, IFAU - Institute for Evaluation of Labour Market and Education Policy.
    10. Jaime Hurtubia Torres & Jutta Neitzel, 2017. "Dependency traps in self-targeting food aid programs," Review of Development Economics, Wiley Blackwell, vol. 21(4), pages 147-174, November.
    11. Arie, Guy, 2016. "Dynamic costs and moral hazard: A duality-based approach," Journal of Economic Theory, Elsevier, vol. 166(C), pages 1-50.
    12. Neele Balke & Thibaut Lamadon, 2020. "Productivity Shocks, Long-Term Contracts and Earnings Dynamics," NBER Working Papers 28060, National Bureau of Economic Research, Inc.
    13. Emilio Espino & Julian Kozlowski & Juan M. Sanchez, 2013. "Too big to cheat: Efficiency and Investment in Partnerships," Working Papers 2013-001, Federal Reserve Bank of St. Louis.
    14. Harold Cole & Felix Kubler, 2012. "Recursive Contracts, Lotteries and Weakly Concave Pareto Sets," Review of Economic Dynamics, Elsevier for the Society for Economic Dynamics, vol. 15(4), pages 479-500, October.
    15. Charles Brendon, 2011. "Applying perturbation analysis to dynamic optimal tax problems," Economics Series Working Papers 581, University of Oxford, Department of Economics.
    16. Gaetano Bloise & Paolo Siconolfi, 2022. "A Negishi Approach to Recursive Contracts," Econometrica, Econometric Society, vol. 90(6), pages 2821-2855, November.
    17. YiLi Chien & Harold L. Cole & Hanno Lustig, 2014. "Implications of heterogeneity in preferences, beliefs and asset trading technologies for the macroeconomy," Working Papers 2014-14, Federal Reserve Bank of St. Louis.
    18. Espino, Emilio & Kozlowski, Julian & Sánchez, Juan M., 2018. "Investment and bilateral insurance," Journal of Economic Theory, Elsevier, vol. 176(C), pages 311-341.
    19. Łukasz Balbus & Kevin Reffett & Łukasz Woźny, 2013. "Markov Stationary Equilibria in Stochastic Supermodular Games with Imperfect Private and Public Information," Dynamic Games and Applications, Springer, vol. 3(2), pages 187-206, June.
    20. Matthias Messner & Nicola Pavoni & Christopher Sleet, "undated". "Contractive Dual Methods for Incentive Problems," GSIA Working Papers 2012-E26, Carnegie Mellon University, Tepper School of Business.
    21. Yili Chien & Harold Cole & Hanno Lustig, 2016. "Implications of Heterogeneity in Preferences, Beliefs and Asset Trading Technologies in an Endowment Economy," Review of Economic Dynamics, Elsevier for the Society for Economic Dynamics, vol. 20, pages 215-239, April.
    22. Golosov, M. & Tsyvinski, A. & Werquin, N., 2016. "Recursive Contracts and Endogenously Incomplete Markets," Handbook of Macroeconomics, in: J. B. Taylor & Harald Uhlig (ed.), Handbook of Macroeconomics, edition 1, volume 2, chapter 0, pages 725-841, Elsevier.
    23. Clayton, Christopher & Schaab, Andreas, 2022. "A Theory of Dynamic Inflation Targets," TSE Working Papers 22-1389, Toulouse School of Economics (TSE).
    24. Lilia Maliar & Serguei Maliar, 2016. "Ruling Out Multiplicity of Smooth Equilibria in Dynamic Games: A Hyperbolic Discounting Example," Dynamic Games and Applications, Springer, vol. 6(2), pages 243-261, June.
    25. Thibaut Lamadon, 2014. "Productivity Shocks, Dynamic Contracts and Income Uncertainty," 2014 Meeting Papers 243, Society for Economic Dynamics.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Messner Matthias & Pavoni Nicola & Sleet Christopher, "undated". "Recursive Methods for Dynamic Incentive Problems," GSIA Working Papers 2012-E13, Carnegie Mellon University, Tepper School of Business.
    2. Nicola Pavoni & Christopher Sleet & Matthias Messner, 2018. "The Dual Approach to Recursive Optimization: Theory and Examples," Econometrica, Econometric Society, vol. 86(1), pages 133-172, January.
    3. Mele, Antonio, 2014. "Repeated moral hazard and recursive Lagrangeans," Journal of Economic Dynamics and Control, Elsevier, vol. 42(C), pages 69-85.
    4. Golosov, M. & Tsyvinski, A. & Werquin, N., 2016. "Recursive Contracts and Endogenously Incomplete Markets," Handbook of Macroeconomics, in: J. B. Taylor & Harald Uhlig (ed.), Handbook of Macroeconomics, edition 1, volume 2, chapter 0, pages 725-841, Elsevier.
    5. Abraham Arpad & Nicola Pavoni, 2004. "Efficient Allocations, with Moral Hazard and Hidden Borrowing and Lending," Levine's Bibliography 122247000000000138, UCLA Department of Economics.
    6. Miao, Jianjun & Zhang, Yuzhe, 2015. "A duality approach to continuous-time contracting problems with limited commitment," Journal of Economic Theory, Elsevier, vol. 159(PB), pages 929-988.
    7. Balbus, Łukasz & Reffett, Kevin & Woźny, Łukasz, 2013. "A constructive geometrical approach to the uniqueness of Markov stationary equilibrium in stochastic games of intergenerational altruism," Journal of Economic Dynamics and Control, Elsevier, vol. 37(5), pages 1019-1039.
    8. Arpad Abraham & Nicola Pavoni, 2008. "Efficient Allocations with Moral Hazard and Hidden Borrowing and Lending: A Recursive Formulation," Review of Economic Dynamics, Elsevier for the Society for Economic Dynamics, vol. 11(4), pages 781-803, October.
    9. Albert Marcet & Ramon Marimon, 2019. "Recursive Contracts," Econometrica, Econometric Society, vol. 87(5), pages 1589-1631, September.
    10. Messner Matthias & Pavoni Nicola & Sleet Christopher, "undated". "On the Dual Approach to Recursive Optimization," GSIA Working Papers 2012-E12, Carnegie Mellon University, Tepper School of Business.
    11. Matthias Messner & Nicola Pavoni & Christopher Sleet, "undated". "Contractive Dual Methods for Incentive Problems," GSIA Working Papers 2012-E26, Carnegie Mellon University, Tepper School of Business.
    12. Lilia Maliar & Serguei Maliar, 2016. "Ruling Out Multiplicity of Smooth Equilibria in Dynamic Games: A Hyperbolic Discounting Example," Dynamic Games and Applications, Springer, vol. 6(2), pages 243-261, June.
    13. Karaivanov, Alexander K. & Martin, Fernando M., 2018. "Markov-perfect risk sharing, moral hazard and limited commitment," Journal of Economic Dynamics and Control, Elsevier, vol. 94(C), pages 1-23.
    14. Neele Balke & Thibaut Lamadon, 2020. "Productivity Shocks, Long-Term Contracts and Earnings Dynamics," NBER Working Papers 28060, National Bureau of Economic Research, Inc.
    15. Gaetano Bloise & Paolo Siconolfi, 2022. "A Negishi Approach to Recursive Contracts," Econometrica, Econometric Society, vol. 90(6), pages 2821-2855, November.
    16. Balke, Neele & Lamadon, Thibaut, 2021. "Productivity shocks, long-term contracts and earnings dynamics," Working Paper Series 2021:19, IFAU - Institute for Evaluation of Labour Market and Education Policy.
    17. David Martimort & Aggey Semenov & Lars Stole, 2017. "A Theory of Contracts with Limited Enforcement," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 84(2), pages 816-852.
    18. Zhigang Feng & Jianjun Miao & Adrian Peralta‐Alva & Manuel S. Santos, 2014. "Numerical Simulation Of Nonoptimal Dynamic Equilibrium Models," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 55(1), pages 83-110, February.
    19. Harold Cole & Felix Kubler, 2012. "Recursive Contracts, Lotteries and Weakly Concave Pareto Sets," Review of Economic Dynamics, Elsevier for the Society for Economic Dynamics, vol. 15(4), pages 479-500, October.
    20. Brendon, Charles & Ellison, Martin, 2018. "Time-consistently undominated policies," LSE Research Online Documents on Economics 87176, London School of Economics and Political Science, LSE Library.

    More about this item

    JEL classification:

    • C61 - Mathematical and Quantitative Methods - - Mathematical Methods; Programming Models; Mathematical and Simulation Modeling - - - Optimization Techniques; Programming Models; Dynamic Analysis
    • C73 - Mathematical and Quantitative Methods - - Game Theory and Bargaining Theory - - - Stochastic and Dynamic Games; Evolutionary Games
    • D82 - Microeconomics - - Information, Knowledge, and Uncertainty - - - Asymmetric and Private Information; Mechanism Design
    • E61 - Macroeconomics and Monetary Economics - - Macroeconomic Policy, Macroeconomic Aspects of Public Finance, and General Outlook - - - Policy Objectives; Policy Designs and Consistency; Policy Coordination

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:igi:igierp:381. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: http://www.igier.unibocconi.it/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.