IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2010.08985.html
   My bibliography  Save this paper

Scenario-decomposition Solution Framework for Nonseparable Stochastic Control Problems

Author

Listed:
  • Xin Huang
  • Duan Li
  • Daniel Zhuoyu Long

Abstract

When stochastic control problems do not possess separability and/or monotonicity, the dynamic programming pioneered by Bellman in 1950s fails to work as a time-decomposition solution method. Such cases have posted a great challenge to the control society in both theoretical foundation and solution methodologies for many years. With the help of the progressive hedging algorithm proposed by Rockafellar and Wets in 1991, we develop a novel scenario-decomposition solution framework for stochastic control problems which could be nonseparable and/or non-monotonic, thus extending the reach of stochastic optimal control. We discuss then some of its promising applications, including online quadratic programming problems and dynamic portfolio selection problems with smoothing properties.

Suggested Citation

  • Xin Huang & Duan Li & Daniel Zhuoyu Long, 2020. "Scenario-decomposition Solution Framework for Nonseparable Stochastic Control Problems," Papers 2010.08985, arXiv.org.
    • Handle: RePEc:arx:papers:2010.08985
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2010.08985
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. R. T. Rockafellar & Roger J.-B. Wets, 1991. "Scenarios and Policy Aggregation in Optimization Under Uncertainty," Mathematics of Operations Research, INFORMS, vol. 16(1), pages 119-147, February.
    2. Carraway, Robert L. & Morin, Thomas L. & Moskowitz, Herbert, 1990. "Generalized dynamic programming for multicriteria optimization," European Journal of Operational Research, Elsevier, vol. 44(1), pages 95-104, January.
    3. Duan Li & Wan‐Lung Ng, 2000. "Optimal Dynamic Portfolio Selection: Multiperiod Mean‐Variance Formulation," Mathematical Finance, Wiley Blackwell, vol. 10(3), pages 387-406, July.
    4. Cui, Xiangyu & Gao, Jianjun & Li, Xun & Li, Duan, 2014. "Optimal multi-period mean–variance policy under no-shorting constraint," European Journal of Operational Research, Elsevier, vol. 234(2), pages 459-468.
    5. D. J. White, 1974. "Technical Note—Dynamic Programming and Probabilistic Constraints," Operations Research, INFORMS, vol. 22(3), pages 654-664, June.
    6. Shipra Agrawal & Zizhuo Wang & Yinyu Ye, 2014. "A Dynamic Near-Optimal Algorithm for Online Linear Programming," Operations Research, INFORMS, vol. 62(4), pages 876-890, August.
    7. Domingo, Alleli & Sniedovich, Moshe, 1993. "Experiments with dynamic programming algorithms for nonseparable problems," European Journal of Operational Research, Elsevier, vol. 67(2), pages 172-187, June.
    8. Tomasz R. Bielecki & Hanqing Jin & Stanley R. Pliska & Xun Yu Zhou, 2005. "Continuous‐Time Mean‐Variance Portfolio Selection With Bankruptcy Prohibition," Mathematical Finance, Wiley Blackwell, vol. 15(2), pages 213-244, April.
    9. Unknown, 1986. "Letters," Choices: The Magazine of Food, Farm, and Resource Issues, Agricultural and Applied Economics Association, vol. 1(4), pages 1-9.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Xiangyu Cui & Duan Li & Xun Li, 2014. "Mean-Variance Policy for Discrete-time Cone Constrained Markets: The Consistency in Efficiency and Minimum-Variance Signed Supermartingale Measure," Papers 1403.0718, arXiv.org.
    2. Xiangyu Cui & Jianjun Gao & Yun Shi, 2021. "Multi-period mean–variance portfolio optimization with management fees," Operational Research, Springer, vol. 21(2), pages 1333-1354, June.
    3. Cong, F. & Oosterlee, C.W., 2016. "Multi-period mean–variance portfolio optimization based on Monte-Carlo simulation," Journal of Economic Dynamics and Control, Elsevier, vol. 64(C), pages 23-38.
    4. Gao, Jianjun & Xiong, Yan & Li, Duan, 2016. "Dynamic mean-risk portfolio selection with multiple risk measures in continuous-time," European Journal of Operational Research, Elsevier, vol. 249(2), pages 647-656.
    5. Strub, Moris S. & Li, Duan & Cui, Xiangyu & Gao, Jianjun, 2019. "Discrete-time mean-CVaR portfolio selection and time-consistency induced term structure of the CVaR," Journal of Economic Dynamics and Control, Elsevier, vol. 108(C).
    6. Xun Li & Zuo Quan Xu, 2015. "Continuous-Time Mean-Variance Portfolio Selection with Constraints on Wealth and Portfolio," Papers 1507.06850, arXiv.org.
    7. Cong, F. & Oosterlee, C.W., 2016. "On pre-commitment aspects of a time-consistent strategy for a mean-variance investor," Journal of Economic Dynamics and Control, Elsevier, vol. 70(C), pages 178-193.
    8. De Gennaro Aquino, Luca & Sornette, Didier & Strub, Moris S., 2023. "Portfolio selection with exploration of new investment assets," European Journal of Operational Research, Elsevier, vol. 310(2), pages 773-792.
    9. Yuanyuan Zhang & Xiang Li & Sini Guo, 2018. "Portfolio selection problems with Markowitz’s mean–variance framework: a review of literature," Fuzzy Optimization and Decision Making, Springer, vol. 17(2), pages 125-158, June.
    10. Yao, Haixiang & Li, Zhongfei & Li, Duan, 2016. "Multi-period mean-variance portfolio selection with stochastic interest rate and uncontrollable liability," European Journal of Operational Research, Elsevier, vol. 252(3), pages 837-851.
    11. Xiangyu Cui & Xun Li & Duan Li & Yun Shi, 2014. "Time Consistent Behavior Portfolio Policy for Dynamic Mean-Variance Formulation," Papers 1408.6070, arXiv.org, revised Aug 2015.
    12. Shihao Zhu & Jingtao Shi, 2019. "Optimal Reinsurance and Investment Strategies under Mean-Variance Criteria: Partial and Full Information," Papers 1906.08410, arXiv.org, revised Jun 2020.
    13. Cvitanic, Jaksa & Lazrak, Ali & Wang, Tan, 2008. "Implications of the Sharpe ratio as a performance measure in multi-period settings," Journal of Economic Dynamics and Control, Elsevier, vol. 32(5), pages 1622-1649, May.
    14. Wan-Kai Pang & Yuan-Hua Ni & Xun Li & Ka-Fai Cedric Yiu, 2013. "Continuous-time Mean-Variance Portfolio Selection with Stochastic Parameters," Papers 1302.6669, arXiv.org.
    15. Stefania Corsaro & Valentina De Simone & Zelda Marino & Salvatore Scognamiglio, 2022. "l 1 -Regularization in Portfolio Selection with Machine Learning," Mathematics, MDPI, vol. 10(4), pages 1-15, February.
    16. Pun, Chi Seng & Wong, Hoi Ying, 2019. "A linear programming model for selection of sparse high-dimensional multiperiod portfolios," European Journal of Operational Research, Elsevier, vol. 273(2), pages 754-771.
    17. Zhang, Miao & Chen, Ping & Yao, Haixiang, 2017. "Mean-variance portfolio selection with only risky assets under regime switching," Economic Modelling, Elsevier, vol. 62(C), pages 35-42.
    18. Junna Bi & Jun Cai & Yan Zeng, 2021. "Equilibrium reinsurance-investment strategies with partial information and common shock dependence," Annals of Operations Research, Springer, vol. 307(1), pages 1-24, December.
    19. Chen, Zhiping & Li, Gang & Zhao, Yonggan, 2014. "Time-consistent investment policies in Markovian markets: A case of mean–variance analysis," Journal of Economic Dynamics and Control, Elsevier, vol. 40(C), pages 293-316.
    20. Ben-Zhang Yang & Xin-Jiang He & Song-Ping Zhu, 2020. "Continuous time mean-variance-utility portfolio problem and its equilibrium strategy," Papers 2005.06782, arXiv.org, revised Nov 2020.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2010.08985. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.