IDEAS home Printed from https://ideas.repec.org/a/taf/tsysxx/v46y2015i7p1307-1318.html
   My bibliography  Save this article

Consensus-based distributed optimisation of multi-agent networks via a two level subgradient-proximal algorithm

Author

Listed:
  • Bin Hu
  • Zhi-Hong Guan
  • Rui-Quan Liao
  • Ding-Xue Zhang
  • Gui-Lin Zheng

Abstract

This paper presents a consensus-based stochastic subgradient algorithm for multi-agent networks to minimise multiple convex but not necessarily differential objective functions, subject to an intersection set of multiple closed convex constraint sets. Compared with the existing results an alternative subgradient algorithm is first introduced based on two level subgradient iterations, where the first level is to minimise the component functions, and the second to enforce the iterates not oscillate from the constraint set wildly. In addition, a distributed consensus-based type of the proposed subgradient algorithm is constructed within the framework of multi-agent networks for the case when the iteration index of local objective functions and local constraint sets is not homologous. Detailed convergence analysis of the proposed algorithms is established using matrix theories and super-martingale convergence theorem. In addition, a pre-step convergence factor is obtained in this study to characterise the distance between the iterations and the optimal set, while some existing literatures only present a convergence work. Simulation results are given to demonstrate the effectiveness of the developed theoretical results.

Suggested Citation

  • Bin Hu & Zhi-Hong Guan & Rui-Quan Liao & Ding-Xue Zhang & Gui-Lin Zheng, 2015. "Consensus-based distributed optimisation of multi-agent networks via a two level subgradient-proximal algorithm," International Journal of Systems Science, Taylor & Francis Journals, vol. 46(7), pages 1307-1318, May.
  • Handle: RePEc:taf:tsysxx:v:46:y:2015:i:7:p:1307-1318
    DOI: 10.1080/00207721.2013.822122
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1080/00207721.2013.822122
    Download Restriction: Access to full text is restricted to subscribers.

    File URL: https://libkey.io/10.1080/00207721.2013.822122?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Fenglan Sun & Zhi-Hong Guan & Li Ding & Yan-Wu Wang, 2013. "Mean square average-consensus for multi-agent systems with measurement noise and time delay," International Journal of Systems Science, Taylor & Francis Journals, vol. 44(6), pages 995-1005.
    2. Jiahu Qin & Huijun Gao & Wei Xing Zheng, 2011. "On average consensus in directed networks of agents with switching topology and time delay," International Journal of Systems Science, Taylor & Francis Journals, vol. 42(12), pages 1947-1956.
    3. S. Sundhar Ram & A. Nedić & V. V. Veeravalli, 2010. "Distributed Stochastic Subgradient Projection Algorithms for Convex Optimization," Journal of Optimization Theory and Applications, Springer, vol. 147(3), pages 516-545, December.
    4. Quanjun Wu & Jin Zhou & Lan Xiang, 2012. "Impulsive consensus seeking in directed networks of multi-agent systems with communication time delays," International Journal of Systems Science, Taylor & Francis Journals, vol. 43(8), pages 1479-1491.
    5. Lina Rong & Shengyuan Xu & Baoyong Zhang & Yun Zou, 2013. "Accelerating average consensus by using the information of second-order neighbours with communication delays," International Journal of Systems Science, Taylor & Francis Journals, vol. 44(6), pages 1181-1188.
    6. Fenglan Sun & Zhi-Hong Guan, 2013. "Finite-time consensus for leader-following second-order multi-agent system," International Journal of Systems Science, Taylor & Francis Journals, vol. 44(4), pages 727-738.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Guoguang Wen & Zhaoxia Peng & Ahmed Rahmani & Yongguang Yu, 2014. "Distributed leader-following consensus for second-order multi-agent systems with nonlinear inherent dynamics," International Journal of Systems Science, Taylor & Francis Journals, vol. 45(9), pages 1892-1901, September.
    2. Maude J. Blondin & Matthew Hale, 2021. "A Decentralized Multi-objective Optimization Algorithm," Journal of Optimization Theory and Applications, Springer, vol. 189(2), pages 458-485, May.
    3. Zhao, Huanyu & Park, Ju H. & Zhang, Yulin, 2014. "Couple-group consensus for second-order multi-agent systems with fixed and stochastic switching topologies," Applied Mathematics and Computation, Elsevier, vol. 232(C), pages 595-605.
    4. Lijing Dong & Senchun Chai & Baihai Zhang & Sing Kiong Nguang, 2016. "Sliding mode control for multi-agent systems under a time-varying topology," International Journal of Systems Science, Taylor & Francis Journals, vol. 47(9), pages 2193-2200, July.
    5. Sabir Djaidja & Qinghe Wu, 2015. "Leader-following consensus for single-integrator multi-agent systems with multiplicative noises in directed topologies," International Journal of Systems Science, Taylor & Francis Journals, vol. 46(15), pages 2788-2798, November.
    6. Lei Liu & Jinjun Shan, 2017. "robust synchronisation of nonlinear multi-agent systems with sampled-data information," International Journal of Systems Science, Taylor & Francis Journals, vol. 48(1), pages 138-149, January.
    7. He, Xiaoyan & Wang, Qingyun, 2017. "Distributed finite-time leaderless consensus control for double-integrator multi-agent systems with external disturbances," Applied Mathematics and Computation, Elsevier, vol. 295(C), pages 65-76.
    8. Yilun Shang, 2015. "Group consensus of multi-agent systems in directed networks with noises and time delays," International Journal of Systems Science, Taylor & Francis Journals, vol. 46(14), pages 2481-2492, October.
    9. Jueyou Li & Chuanye Gu & Zhiyou Wu & Changzhi Wu, 2017. "Distributed Optimization Methods for Nonconvex Problems with Inequality Constraints over Time-Varying Networks," Complexity, Hindawi, vol. 2017, pages 1-10, December.
    10. Kazunori Sakurama & Kazushi Nakano, 2015. "Necessary and sufficient condition for average consensus of networked multi-agent systems with heterogeneous time delays," International Journal of Systems Science, Taylor & Francis Journals, vol. 46(5), pages 818-830, April.
    11. Woocheol Choi & Doheon Kim & Seok-Bae Yun, 2022. "Convergence Results of a Nested Decentralized Gradient Method for Non-strongly Convex Problems," Journal of Optimization Theory and Applications, Springer, vol. 195(1), pages 172-204, October.
    12. Junlong Zhu & Ping Xie & Mingchuan Zhang & Ruijuan Zheng & Ling Xing & Qingtao Wu, 2019. "Distributed Stochastic Subgradient Projection Algorithms Based on Weight-Balancing over Time-Varying Directed Graphs," Complexity, Hindawi, vol. 2019, pages 1-16, August.
    13. H.J. Savino & F.O. Souza & L.C.A. Pimenta, 2016. "Consensus with guaranteed convergence rate of high-order integrator agents in the presence of time-varying delays," International Journal of Systems Science, Taylor & Francis Journals, vol. 47(10), pages 2475-2486, July.
    14. Zi-Jiang Yang & Pan Qin, 2016. "Robust synchronisation tracking control of networked Euler–Lagrange systems using reference trajectory estimation based on virtual double-integrators," International Journal of Systems Science, Taylor & Francis Journals, vol. 47(9), pages 2088-2099, July.
    15. Chunnan Lin & Quanjun Wu & Lan Xiang & Jin Zhou, 2015. "Pinning impulsive directed coupled delayed dynamical network and its applications," International Journal of Systems Science, Taylor & Francis Journals, vol. 46(2), pages 193-208, January.
    16. Xia Xiao & Xiaowu Mu, 2017. "Consensus of linear multi-agent systems with communication delays by using the information of second-order neighbours under intermittent communication topology," International Journal of Systems Science, Taylor & Francis Journals, vol. 48(1), pages 200-208, January.
    17. Haimonti Dutta, 2022. "A Consensus Algorithm for Linear Support Vector Machines," Management Science, INFORMS, vol. 68(5), pages 3703-3725, May.
    18. Sun, Fenglan & Wang, Rui & Zhu, Wei & Li, Yongfu, 2019. "Flocking in nonlinear multi-agent systems with time-varying delay via event-triggered control," Applied Mathematics and Computation, Elsevier, vol. 350(C), pages 66-77.
    19. Wei Ni & Xiaoli Wang, 2022. "A Multi-Scale Method for Distributed Convex Optimization with Constraints," Journal of Optimization Theory and Applications, Springer, vol. 192(1), pages 379-400, January.
    20. Hongwen Ma & Derong Liu & Ding Wang & Biao Luo, 2016. "Bipartite output consensus in networked multi-agent systems of high-order power integrators with signed digraph and input noises," International Journal of Systems Science, Taylor & Francis Journals, vol. 47(13), pages 3116-3131, October.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:taf:tsysxx:v:46:y:2015:i:7:p:1307-1318. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Longhurst (email available below). General contact details of provider: http://www.tandfonline.com/TSYS20 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.