IDEAS home Printed from https://ideas.repec.org/a/taf/tsysxx/v45y2014i8p1683-1693.html
   My bibliography  Save this article

Finite horizon optimal control of non-linear discrete-time switched systems using adaptive dynamic programming with ε-error bound

Author

Listed:
  • Chunbin Qin
  • Huaguang Zhang
  • Yanhong Luo
  • Binrui Wang

Abstract

In this paper, we aim to solve the finite-horizon optimal control problem for a class of non-linear discrete-time switched systems using adaptive dynamic programming(ADP) algorithm. A new ε-optimal control scheme based on the iterative ADP algorithm is presented which makes the value function converge iteratively to the greatest lower bound of all value function indices within an error according to ε within finite time. Two neural networks are used as parametric structures to implement the iterative ADP algorithm with ε-error bound, which aim at approximating the value function and the control policy, respectively. And then, the optimal control policy is obtained. Finally, a simulation example is included to illustrate the applicability of the proposed method.

Suggested Citation

  • Chunbin Qin & Huaguang Zhang & Yanhong Luo & Binrui Wang, 2014. "Finite horizon optimal control of non-linear discrete-time switched systems using adaptive dynamic programming with ε-error bound," International Journal of Systems Science, Taylor & Francis Journals, vol. 45(8), pages 1683-1693, August.
    • Handle: RePEc:taf:tsysxx:v:45:y:2014:i:8:p:1683-1693
    DOI: 10.1080/00207721.2012.748945
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1080/00207721.2012.748945
    Download Restriction: Access to full text is restricted to subscribers.
    File URL: https://libkey.io/10.1080/00207721.2012.748945?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Weiming Xiang & Jian Xiao, 2013. "Finite-time stability and stabilisation for switched linear systems," International Journal of Systems Science, Taylor & Francis Journals, vol. 44(2), pages 384-400.
    2. Ning Cao & Huaguang Zhang & Yanhong Luo & Dezhi Feng, 2012. "Infinite horizon optimal control of affine nonlinear discrete switched systems using two-stage approximate dynamic programming," International Journal of Systems Science, Taylor & Francis Journals, vol. 43(9), pages 1673-1682.
    3. Yanhui Tong & Lixian Zhang & Peng Shi & Changhong Wang, 2013. "A common linear copositive Lyapunov function for switched positive linear systems with commutable subsystems," International Journal of Systems Science, Taylor & Francis Journals, vol. 44(11), pages 1994-2003.
    4. Ben Niu & Jun Zhao, 2013. "Tracking control for output-constrained nonlinear switched systems with a barrier Lyapunov function," International Journal of Systems Science, Taylor & Francis Journals, vol. 44(5), pages 978-985.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Lou, Xuyang & Ji, Zheng, 2021. "Self-triggering adaptive optimal control for nonlinear systems based on encoding mechanism," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 190(C), pages 1027-1047.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Mohammad Bagher Abolhasani Jabali & Mohammad Hosein Kazemi, 2017. "Power System Event Ranking Using a New Linear Parameter-Varying Modeling with a Wide Area Measurement System-Based Approach," Energies, MDPI, vol. 10(8), pages 1-14, July.
    2. Chen Zheng & Jinde Cao & Manfeng Hu & Xiaozheng Fan, 2017. "Finite-time stabilisation for discrete-time T–S fuzzy model system with channel fading and two types of parametric uncertainty," International Journal of Systems Science, Taylor & Francis Journals, vol. 48(1), pages 34-42, January.
    3. Jun Shen & James Lam, 2015. "On ℓ and gains for positive systems with bounded time-varying delays," International Journal of Systems Science, Taylor & Francis Journals, vol. 46(11), pages 1953-1960, August.
    4. Runze Chen & Zhenling Wang & Weiwei Che, 2022. "Adaptive Sliding Mode Attitude-Tracking Control of Spacecraft with Prescribed Time Performance," Mathematics, MDPI, vol. 10(3), pages 1-18, January.
    5. Yunong Zhang & Yinyan Zhang & Dechao Chen & Zhengli Xiao & Xiaogang Yan, 2017. "Division by zero, pseudo-division by zero, Zhang dynamics method and Zhang-gradient method about control singularity conquering," International Journal of Systems Science, Taylor & Francis Journals, vol. 48(1), pages 1-12, January.
    6. Yingxue Hou & Shaocheng Tong & Yongming Li, 2016. "Adaptive fuzzy backstepping control for a class of switched nonlinear systems with actuator faults," International Journal of Systems Science, Taylor & Francis Journals, vol. 47(15), pages 3581-3590, November.
    7. Junfeng Zhang & Zhengzhi Han & Fubo Zhu, 2015. "-gain analysis and control synthesis of positive switched systems," International Journal of Systems Science, Taylor & Francis Journals, vol. 46(12), pages 2111-2121, September.
    8. Zhongcai Zhang & Xueli Hu & Yang Gao & Xiaodan Hou, 2023. "Robust and Adaptive Stabilization Controllers of State-Constrained Nonholonomic Chained Systems: A Discontinuous Approach," Mathematics, MDPI, vol. 12(1), pages 1-19, December.
    9. Penghui Sun & Xi Wang & Shubo Yang & Bei Yang & Huairong Chen & Bin Wang, 2021. "Bumpless Transfer of Uncertain Switched System and Its Application to Turbofan Engines," Energies, MDPI, vol. 14(16), pages 1-21, August.
    10. Wenping Xue & Kangji Li & Guohai Liu, 2016. "DDI-based finite-time stability analysis for nonlinear switched systems with time-varying delays," International Journal of Systems Science, Taylor & Francis Journals, vol. 47(12), pages 3027-3035, September.
    11. Göksu, Gökhan & Başer, Ulviye, 2021. "Finite-time stability for switched linear systems by Jordan decomposition," Applied Mathematics and Computation, Elsevier, vol. 395(C).
    12. Yeguo Sun, 2014. "Finite-time boundedness and stabilisation of networked control systems with bounded packet dropout," International Journal of Systems Science, Taylor & Francis Journals, vol. 45(9), pages 1963-1969, September.
    13. Yongming Li & Shaocheng Tong, 2016. "Adaptive fuzzy switched control design for uncertain nonholonomic systems with input nonsmooth constraint," International Journal of Systems Science, Taylor & Francis Journals, vol. 47(14), pages 3436-3446, October.
    14. Qiang Yu & Baowei Wu, 2015. "Robust stability analysis of uncertain switched linear systems with unstable subsystems," International Journal of Systems Science, Taylor & Francis Journals, vol. 46(7), pages 1278-1287, May.
    15. Zhang, Junfeng & Zhao, Xudong & Cai, Xiushan, 2016. "Absolute exponential L1-gain analysis and synthesis of switched nonlinear positive systems with time-varying delay," Applied Mathematics and Computation, Elsevier, vol. 284(C), pages 24-36.
    16. Jilie Zhang & Huaguang Zhang & Binrui Wang & Tiaoyang Cai, 2016. "Nearly data-based optimal control for linear discrete model-free systems with delays via reinforcement learning," International Journal of Systems Science, Taylor & Francis Journals, vol. 47(7), pages 1563-1573, May.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:taf:tsysxx:v:45:y:2014:i:8:p:1683-1693. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Longhurst (email available below). General contact details of provider: http://www.tandfonline.com/TSYS20 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.