IDEAS home Printed from https://ideas.repec.org/a/plo/pone00/0262346.html
   My bibliography  Save this article

Variational quantum classifiers through the lens of the Hessian

Author

Listed:
  • Pinaki Sen
  • Amandeep Singh Bhatia
  • Kamalpreet Singh Bhangu
  • Ahmed Elbeltagi

Abstract

In quantum computing, the variational quantum algorithms (VQAs) are well suited for finding optimal combinations of things in specific applications ranging from chemistry all the way to finance. The training of VQAs with gradient descent optimization algorithm has shown a good convergence. At an early stage, the simulation of variational quantum circuits on noisy intermediate-scale quantum (NISQ) devices suffers from noisy outputs. Just like classical deep learning, it also suffers from vanishing gradient problems. It is a realistic goal to study the topology of loss landscape, to visualize the curvature information and trainability of these circuits in the existence of vanishing gradients. In this paper, we calculate the Hessian and visualize the loss landscape of variational quantum classifiers at different points in parameter space. The curvature information of variational quantum classifiers (VQC) is interpreted and the loss function’s convergence is shown. It helps us better understand the behavior of variational quantum circuits to tackle optimization problems efficiently. We investigated the variational quantum classifiers via Hessian on quantum computers, starting with a simple 4-bit parity problem to gain insight into the practical behavior of Hessian, then thoroughly analyzed the behavior of Hessian’s eigenvalues on training the variational quantum classifier for the Diabetes dataset. Finally, we show how the adaptive Hessian learning rate can influence the convergence while training the variational circuits.

Suggested Citation

  • Pinaki Sen & Amandeep Singh Bhatia & Kamalpreet Singh Bhangu & Ahmed Elbeltagi, 2022. "Variational quantum classifiers through the lens of the Hessian," PLOS ONE, Public Library of Science, vol. 17(1), pages 1-17, January.
  • Handle: RePEc:plo:pone00:0262346
    DOI: 10.1371/journal.pone.0262346
    as

    Download full text from publisher

    File URL: https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0262346
    Download Restriction: no

    File URL: https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0262346&type=printable
    Download Restriction: no

    File URL: https://libkey.io/10.1371/journal.pone.0262346?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Jarrod R. McClean & Sergio Boixo & Vadim N. Smelyanskiy & Ryan Babbush & Hartmut Neven, 2018. "Barren plateaus in quantum neural network training landscapes," Nature Communications, Nature, vol. 9(1), pages 1-6, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Takayuki Sakuma, 2020. "Application of deep quantum neural networks to finance," Papers 2011.07319, arXiv.org, revised May 2022.
    2. Elies Gil-Fuster & Jens Eisert & Carlos Bravo-Prieto, 2024. "Understanding quantum machine learning also requires rethinking generalization," Nature Communications, Nature, vol. 15(1), pages 1-12, December.
    3. Iris Cong & Nishad Maskara & Minh C. Tran & Hannes Pichler & Giulia Semeghini & Susanne F. Yelin & Soonwon Choi & Mikhail D. Lukin, 2024. "Enhancing detection of topological order by local error correction," Nature Communications, Nature, vol. 15(1), pages 1-14, December.
    4. Fangjun Hu & Saeed A. Khan & Nicholas T. Bronn & Gerasimos Angelatos & Graham E. Rowlands & Guilhem J. Ribeill & Hakan E. Türeci, 2024. "Overcoming the coherence time barrier in quantum machine learning on temporal data," Nature Communications, Nature, vol. 15(1), pages 1-12, December.
    5. Eric R. Anschuetz & Bobak T. Kiani, 2022. "Quantum variational algorithms are swamped with traps," Nature Communications, Nature, vol. 13(1), pages 1-10, December.
    6. Alen Senanian & Sridhar Prabhu & Vladimir Kremenetski & Saswata Roy & Yingkang Cao & Jeremy Kline & Tatsuhiro Onodera & Logan G. Wright & Xiaodi Wu & Valla Fatemi & Peter L. McMahon, 2024. "Microwave signal processing using an analog quantum reservoir computer," Nature Communications, Nature, vol. 15(1), pages 1-9, December.
    7. Enrico Fontana & Dylan Herman & Shouvanik Chakrabarti & Niraj Kumar & Romina Yalovetzky & Jamie Heredge & Shree Hari Sureshbabu & Marco Pistoia, 2024. "Characterizing barren plateaus in quantum ansätze with the adjoint representation," Nature Communications, Nature, vol. 15(1), pages 1-12, December.
    8. Aritra Sarkar & Zaid Al-Ars & Koen Bertels, 2021. "QuASeR: Quantum Accelerated de novo DNA sequence reconstruction," PLOS ONE, Public Library of Science, vol. 16(4), pages 1-23, April.
    9. Matthias C. Caro & Hsin-Yuan Huang & M. Cerezo & Kunal Sharma & Andrew Sornborger & Lukasz Cincio & Patrick J. Coles, 2022. "Generalization in quantum machine learning from few training data," Nature Communications, Nature, vol. 13(1), pages 1-11, December.
    10. He, Zhimin & Deng, Maijie & Zheng, Shenggen & Li, Lvzhou & Situ, Haozhen, 2023. "GSQAS: Graph Self-supervised Quantum Architecture Search," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 630(C).
    11. Sofiene Jerbi & Lukas J. Fiderer & Hendrik Poulsen Nautrup & Jonas M. Kübler & Hans J. Briegel & Vedran Dunjko, 2023. "Quantum machine learning beyond kernel methods," Nature Communications, Nature, vol. 14(1), pages 1-8, December.
    12. Manuel S. Rudolph & Jacob Miller & Danial Motlagh & Jing Chen & Atithi Acharya & Alejandro Perdomo-Ortiz, 2023. "Synergistic pretraining of parametrized quantum circuits via tensor networks," Nature Communications, Nature, vol. 14(1), pages 1-10, December.
    13. Wei-Ming Li & Shi-Ju Ran, 2022. "Non-Parametric Semi-Supervised Learning in Many-Body Hilbert Space with Rescaled Logarithmic Fidelity," Mathematics, MDPI, vol. 10(6), pages 1-15, March.
    14. Amine Assouel & Antoine Jacquier & Alexei Kondratyev, 2021. "A Quantum Generative Adversarial Network for distributions," Papers 2110.02742, arXiv.org.
    15. Samson Wang & Enrico Fontana & M. Cerezo & Kunal Sharma & Akira Sone & Lukasz Cincio & Patrick J. Coles, 2021. "Noise-induced barren plateaus in variational quantum algorithms," Nature Communications, Nature, vol. 12(1), pages 1-11, December.
    16. Camille Grange & Michael Poss & Eric Bourreau, 2023. "An introduction to variational quantum algorithms for combinatorial optimization problems," 4OR, Springer, vol. 21(3), pages 363-403, September.
    17. Ajagekar, Akshay & You, Fengqi, 2022. "Quantum computing and quantum artificial intelligence for renewable and sustainable energy: A emerging prospect towards climate neutrality," Renewable and Sustainable Energy Reviews, Elsevier, vol. 165(C).
    18. Michael Ragone & Bojko N. Bakalov & Frédéric Sauvage & Alexander F. Kemper & Carlos Ortiz Marrero & Martín Larocca & M. Cerezo, 2024. "A Lie algebraic theory of barren plateaus for deep parameterized quantum circuits," Nature Communications, Nature, vol. 15(1), pages 1-10, December.
    19. El Amine Cherrat & Snehal Raj & Iordanis Kerenidis & Abhishek Shekhar & Ben Wood & Jon Dee & Shouvanik Chakrabarti & Richard Chen & Dylan Herman & Shaohan Hu & Pierre Minssen & Ruslan Shaydulin & Yue , 2023. "Quantum Deep Hedging," Papers 2303.16585, arXiv.org, revised Nov 2023.
    20. Liu, Ling & Song, Tingting & Sun, Zhiwei & Lei, Jiancheng, 2022. "Quantum generative adversarial networks based on Rényi divergences," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 607(C).

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:plo:pone00:0262346. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: plosone (email available below). General contact details of provider: https://journals.plos.org/plosone/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.