IDEAS home Printed from https://ideas.repec.org/a/inm/oropre/v56y2008i3p681-696.html
   My bibliography  Save this article

A Dynamic Principal-Agent Model with Hidden Information: Sequential Optimality Through Truthful State Revelation

Author

Listed:
  • Hao Zhang

    (Marshall School of Business, University of Southern California, Los Angeles, California 90089)

  • Stefanos Zenios

    (Graduate School of Business, Stanford University, Stanford, California 94305)

Abstract

This paper proposes a general framework for a large class of multiperiod principal-agent problems. In this framework, a principal has a primary stake in the performance of a system but delegates its control to an agent. The underlying system is a Markov decision process, where the state of the system can only be observed by the agent but the agent's action is observed by both parties. This paper develops a dynamic programming algorithm to derive optimal long-term contracts for the principal. The principal indirectly controls the underlying system by offering the agent a menu of continuation utility vectors along public information paths; the agent's best response, expressed in his choice of continuation utilities, induces truthful state revelation and results in actions that maximize the principal's expected payoff. This problem is meaningful to the operations research community because it can be framed as the problem of optimally designing the reward structure of a Markov decision process with hidden states and has many applications of interest as discussed in this paper.

Suggested Citation

  • Hao Zhang & Stefanos Zenios, 2008. "A Dynamic Principal-Agent Model with Hidden Information: Sequential Optimality Through Truthful State Revelation," Operations Research, INFORMS, vol. 56(3), pages 681-696, June.
    • Handle: RePEc:inm:oropre:v:56:y:2008:i:3:p:681-696
    DOI: 10.1287/opre.1070.0451
    as

    Download full text from publisher

    File URL: http://dx.doi.org/10.1287/opre.1070.0451
    Download Restriction: no
    File URL: https://libkey.io/10.1287/opre.1070.0451?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Fudenberg, Drew & Holmstrom, Bengt & Milgrom, Paul, 1990. "Short-term contracts and long-term agency relationships," Journal of Economic Theory, Elsevier, vol. 51(1), pages 1-31, June.
    2. Cole, Harold L. & Kocherlakota, Narayana, 2001. "Dynamic Games with Hidden Actions and Hidden States," Journal of Economic Theory, Elsevier, vol. 98(1), pages 114-126, May.
    3. Erica L. Plambeck & Stefanos A. Zenios, 2000. "Performance-Based Incentives in a Dynamic Principal-Agent Model," Manufacturing & Service Operations Management, INFORMS, vol. 2(3), pages 240-263, April.
    4. Gérard P. Cachon & Martin A. Lariviere, 2001. "Contracting to Assure Supply: How to Share Demand Forecasts in a Supply Chain," Management Science, INFORMS, vol. 47(5), pages 629-646, May.
    5. Charles J. Corbett, 2001. "Stochastic Inventory Systems in a Supply Chain with Asymmetric Information: Cycle Stocks, Safety Stocks, and Consignment Stock," Operations Research, INFORMS, vol. 49(4), pages 487-500, August.
    6. Baron, David P. & Besanko, David, 1984. "Regulation and information in a continuing relationship," Information Economics and Policy, Elsevier, vol. 1(3), pages 267-302.
    7. Doepke, Matthias & Townsend, Robert M., 2006. "Dynamic mechanism design with hidden income and hidden actions," Journal of Economic Theory, Elsevier, vol. 126(1), pages 235-285, January.
    8. Bengt Holmstrom, 1979. "Moral Hazard and Observability," Bell Journal of Economics, The RAND Corporation, vol. 10(1), pages 74-91, Spring.
    9. Fernandes, Ana & Phelan, Christopher, 2000. "A Recursive Formulation for Repeated Agency with History Dependence," Journal of Economic Theory, Elsevier, vol. 91(2), pages 223-247, April.
    10. Özalp Özer & Wei Wei, 2006. "Strategic Commitments for an Optimal Capacity Decision Under Asymmetric Forecast Information," Management Science, INFORMS, vol. 52(8), pages 1238-1257, August.
    11. Marco Battaglini, 2005. "Long-Term Contracting with Markovian Consumers," American Economic Review, American Economic Association, vol. 95(3), pages 637-658, June.
    12. Yuanyao Ding & Rangcheng Jia & Shaoxiang Tang, 2003. "Dynamic principal agent model based on CMDP," Mathematical Methods of Operations Research, Springer;Gesellschaft für Operations Research (GOR);Nederlands Genootschap voor Besliskunde (NGB), vol. 58(1), pages 149-157, September.
    13. Roger B. Myerson, 1981. "Optimal Auction Design," Mathematics of Operations Research, INFORMS, vol. 6(1), pages 58-73, February.
    14. Albert Y. Ha, 2001. "Supplier‐buyer contracting: Asymmetric cost information and cutoff level policy for buyer participation," Naval Research Logistics (NRL), John Wiley & Sons, vol. 48(1), pages 41-64, February.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Hao Zhang, 2012. "Analysis of a Dynamic Adverse Selection Model with Asymptotic Efficiency," Mathematics of Operations Research, INFORMS, vol. 37(3), pages 450-474, August.
    2. Arpad Abraham & Nicola Pavoni, 2008. "Efficient Allocations with Moral Hazard and Hidden Borrowing and Lending: A Recursive Formulation," Review of Economic Dynamics, Elsevier for the Society for Economic Dynamics, vol. 11(4), pages 781-803, October.
    3. Hugo Hopenhayn & Arantxa Jarque, 2010. "Unobservable Persistent Productivity and Long Term Contracts," Review of Economic Dynamics, Elsevier for the Society for Economic Dynamics, vol. 13(2), pages 333-349, April.
    4. Dirk Bergemann & Alessandro Pavan, 2015. "Introduction to JET Symposium Issue on "Dynamic Contracts and Mechanism Design"," Cowles Foundation Discussion Papers 2016, Cowles Foundation for Research in Economics, Yale University.
    5. Leon Yang Chu & Noam Shamir & Hyoduk Shin, 2017. "Strategic Communication for Capacity Alignment with Pricing in a Supply Chain," Management Science, INFORMS, vol. 63(12), pages 4366-4377, December.
    6. Mingzhu Yu & Ruina Yang & Zelong Yi & Xuwen Cong, 2020. "Contracting in Ocean Shipping Market Under Asymmetric Information," Asia-Pacific Journal of Operational Research (APJOR), World Scientific Publishing Co. Pte. Ltd., vol. 37(02), pages 1-24, March.
    7. Sechan Oh & Özalp Özer, 2013. "Mechanism Design for Capacity Planning Under Dynamic Evolutions of Asymmetric Demand Forecasts," Management Science, INFORMS, vol. 59(4), pages 987-1007, April.
    8. Dirk Bergemann & Maher Said, 2010. "Dynamic Auctions: A Survey," Levine's Working Paper Archive 661465000000000035, David K. Levine.
    9. Z. Justin Ren & Morris A. Cohen & Teck H. Ho & Christian Terwiesch, 2010. "Information Sharing in a Long-Term Supply Chain Relationship: The Role of Customer Review Strategy," Operations Research, INFORMS, vol. 58(1), pages 81-93, February.
    10. Abraham Arpad & Nicola Pavoni, 2004. "Efficient Allocations, with Moral Hazard and Hidden Borrowing and Lending," Levine's Bibliography 122247000000000138, UCLA Department of Economics.
    11. Ehsan Bolandifar & Tianjun Feng & Fuqiang Zhang, 2018. "Simple Contracts to Assure Supply Under Noncontractible Capacity and Asymmetric Cost Information," Manufacturing & Service Operations Management, INFORMS, vol. 20(2), pages 217-231, May.
    12. Hao Zhang, 2012. "Solving an Infinite Horizon Adverse Selection Model Through Finite Policy Graphs," Operations Research, INFORMS, vol. 60(4), pages 850-864, August.
    13. Bergemann, Dirk & Pavan, Alessandro, 2015. "Introduction to Symposium on Dynamic Contracts and Mechanism Design," Journal of Economic Theory, Elsevier, vol. 159(PB), pages 679-701.
    14. Dimitris Kostamis & Izak Duenyas, 2011. "Purchasing Under Asymmetric Demand and Cost Information: When Is More Private Information Better?," Operations Research, INFORMS, vol. 59(4), pages 914-928, August.
    15. Qi Feng & Guoming Lai & Lauren Xiaoyuan Lu, 2015. "Dynamic Bargaining in a Supply Chain with Asymmetric Demand Information," Management Science, INFORMS, vol. 61(2), pages 301-315, February.
    16. Hamid Nazerzadeh & Georgia Perakis, 2016. "Technical Note—Nonlinear Pricing Competition with Private Capacity Information," Operations Research, INFORMS, vol. 64(2), pages 329-340, April.
    17. Terry A. Taylor & Erica L. Plambeck, 2007. "Simple Relational Contracts to Motivate Capacity Investment: Price Only vs. Price and Quantity," Manufacturing & Service Operations Management, INFORMS, vol. 9(1), pages 94-113, January.
    18. İsmail Bakal & Nesim Erkip & Refik Güllü, 2011. "Value of supplier’s capacity information in a two-echelon supply chain," Annals of Operations Research, Springer, vol. 191(1), pages 115-135, November.
    19. Jean Tirole, 2016. "From Bottom of the Barrel to Cream of the Crop: Sequential Screening With Positive Selection," Econometrica, Econometric Society, vol. 84(4), pages 1291-1343, July.
    20. Amiya K. Chakravarty & Jun Zhang, 2007. "Collaboration in contingent capacities with information asymmetry," Naval Research Logistics (NRL), John Wiley & Sons, vol. 54(4), pages 421-432, June.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:inm:oropre:v:56:y:2008:i:3:p:681-696. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Asher (email available below). General contact details of provider: https://edirc.repec.org/data/inforea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.