IDEAS home Printed from https://ideas.repec.org/a/plo/pone00/0112659.html
   My bibliography  Save this article

Back-Propagation Operation for Analog Neural Network Hardware with Synapse Components Having Hysteresis Characteristics

Author

Listed:
  • Michihito Ueda
  • Yu Nishitani
  • Yukihiro Kaneko
  • Atsushi Omote

Abstract

To realize an analog artificial neural network hardware, the circuit element for synapse function is important because the number of synapse elements is much larger than that of neuron elements. One of the candidates for this synapse element is a ferroelectric memristor. This device functions as a voltage controllable variable resistor, which can be applied to a synapse weight. However, its conductance shows hysteresis characteristics and dispersion to the input voltage. Therefore, the conductance values vary according to the history of the height and the width of the applied pulse voltage. Due to the difficulty of controlling the accurate conductance, it is not easy to apply the back-propagation learning algorithm to the neural network hardware having memristor synapses. To solve this problem, we proposed and simulated a learning operation procedure as follows. Employing a weight perturbation technique, we derived the error change. When the error reduced, the next pulse voltage was updated according to the back-propagation learning algorithm. If the error increased the amplitude of the next voltage pulse was set in such way as to cause similar memristor conductance but in the opposite voltage scanning direction. By this operation, we could eliminate the hysteresis and confirmed that the simulation of the learning operation converged. We also adopted conductance dispersion numerically in the simulation. We examined the probability that the error decreased to a designated value within a predetermined loop number. The ferroelectric has the characteristics that the magnitude of polarization does not become smaller when voltages having the same polarity are applied. These characteristics greatly improved the probability even if the learning rate was small, if the magnitude of the dispersion is adequate. Because the dispersion of analog circuit elements is inevitable, this learning operation procedure is useful for analog neural network hardware.

Suggested Citation

  • Michihito Ueda & Yu Nishitani & Yukihiro Kaneko & Atsushi Omote, 2014. "Back-Propagation Operation for Analog Neural Network Hardware with Synapse Components Having Hysteresis Characteristics," PLOS ONE, Public Library of Science, vol. 9(11), pages 1-10, November.
  • Handle: RePEc:plo:pone00:0112659
    DOI: 10.1371/journal.pone.0112659
    as

    Download full text from publisher

    File URL: https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0112659
    Download Restriction: no

    File URL: https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0112659&type=printable
    Download Restriction: no

    File URL: https://libkey.io/10.1371/journal.pone.0112659?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Dmitri B. Strukov & Gregory S. Snider & Duncan R. Stewart & R. Stanley Williams, 2008. "The missing memristor found," Nature, Nature, vol. 453(7191), pages 80-83, May.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Min, Fuhong & Zhang, Wen & Ji, Ziyi & Zhang, Lei, 2021. "Switching dynamics of a non-autonomous FitzHugh-Nagumo circuit with piecewise-linear flux-controlled memristor," Chaos, Solitons & Fractals, Elsevier, vol. 152(C).
    2. Feng, Liang & Hu, Cheng & Yu, Juan & Jiang, Haijun & Wen, Shiping, 2021. "Fixed-time Synchronization of Coupled Memristive Complex-valued Neural Networks," Chaos, Solitons & Fractals, Elsevier, vol. 148(C).
    3. Hu, Yongbing & Li, Qian & Ding, Dawei & Jiang, Li & Yang, Zongli & Zhang, Hongwei & Zhang, Zhixin, 2021. "Multiple coexisting analysis of a fractional-order coupled memristive system and its application in image encryption," Chaos, Solitons & Fractals, Elsevier, vol. 152(C).
    4. Yan, Dengwei & Wang, Lidan & Duan, Shukai & Chen, Jiaojiao & Chen, Jiahao, 2021. "Chaotic Attractors Generated by a Memristor-Based Chaotic System and Julia Fractal," Chaos, Solitons & Fractals, Elsevier, vol. 146(C).
    5. Luo, Mengzhuo & Cheng, Jun & Liu, Xinzhi & Zhong, Shouming, 2019. "An extended synchronization analysis for memristor-based coupled neural networks via aperiodically intermittent control," Applied Mathematics and Computation, Elsevier, vol. 344, pages 163-182.
    6. Liu, Shuxin & Yu, Yongguang & Zhang, Shuo & Zhang, Yuting, 2018. "Robust stability of fractional-order memristor-based Hopfield neural networks with parameter disturbances," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 509(C), pages 845-854.
    7. Zhang, Ge & Ma, Jun & Alsaedi, Ahmed & Ahmad, Bashir & Alzahrani, Faris, 2018. "Dynamical behavior and application in Josephson Junction coupled by memristor," Applied Mathematics and Computation, Elsevier, vol. 321(C), pages 290-299.
    8. Chen, Qun & Li, Bo & Yin, Wei & Jiang, Xiaowei & Chen, Xiangyong, 2023. "Bifurcation, chaos and fixed-time synchronization of memristor cellular neural networks," Chaos, Solitons & Fractals, Elsevier, vol. 171(C).
    9. Stavrinides, Stavros G. & Hanias, Michael P. & Gonzalez, Mireia B. & Campabadal, Francesca & Contoyiannis, Yiannis & Potirakis, Stelios M. & Al Chawa, Mohamad Moner & de Benito, Carol & Tetzlaff, Rona, 2022. "On the chaotic nature of random telegraph noise in unipolar RRAM memristor devices," Chaos, Solitons & Fractals, Elsevier, vol. 160(C).
    10. Li, Liangchen & Xu, Rui & Lin, Jiazhe, 2020. "Lagrange stability for uncertain memristive neural networks with Lévy noise and leakage delay," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 549(C).
    11. Rohit Abraham John & Yiğit Demirağ & Yevhen Shynkarenko & Yuliia Berezovska & Natacha Ohannessian & Melika Payvand & Peng Zeng & Maryna I. Bodnarchuk & Frank Krumeich & Gökhan Kara & Ivan Shorubalko &, 2022. "Reconfigurable halide perovskite nanocrystal memristors for neuromorphic computing," Nature Communications, Nature, vol. 13(1), pages 1-10, December.
    12. Sakthivel, R. & Anbuvithya, R. & Mathiyalagan, K. & Ma, Yong-Ki & Prakash, P., 2016. "Reliable anti-synchronization conditions for BAM memristive neural networks with different memductance functions," Applied Mathematics and Computation, Elsevier, vol. 275(C), pages 213-228.
    13. Liying Xu & Jiadi Zhu & Bing Chen & Zhen Yang & Keqin Liu & Bingjie Dang & Teng Zhang & Yuchao Yang & Ru Huang, 2022. "A distributed nanocluster based multi-agent evolutionary network," Nature Communications, Nature, vol. 13(1), pages 1-10, December.
    14. Hua, Wentao & Wang, Yantao & Liu, Chunyan, 2024. "New method for global exponential synchronization of multi-link memristive neural networks with three kinds of time-varying delays," Applied Mathematics and Computation, Elsevier, vol. 471(C).
    15. Xu, Ying & Jia, Ya & Ma, Jun & Alsaedi, Ahmed & Ahmad, Bashir, 2017. "Synchronization between neurons coupled by memristor," Chaos, Solitons & Fractals, Elsevier, vol. 104(C), pages 435-442.
    16. Ushakov, Yury & Balanov, Alexander & Savel’ev, Sergey, 2021. "Role of noise in spiking dynamics of diffusive memristor driven by heating-cooling cycles," Chaos, Solitons & Fractals, Elsevier, vol. 145(C).
    17. Qin, Xiaoli & Wang, Cong & Li, Lixiang & Peng, Haipeng & Yang, Yixian & Ye, Lu, 2018. "Finite-time modified projective synchronization of memristor-based neural network with multi-links and leakage delay," Chaos, Solitons & Fractals, Elsevier, vol. 116(C), pages 302-315.
    18. Yan Sun & Shuting Xu & Zheqi Xu & Jiamin Tian & Mengmeng Bai & Zhiying Qi & Yue Niu & Hein Htet Aung & Xiaolu Xiong & Junfeng Han & Cuicui Lu & Jianbo Yin & Sheng Wang & Qing Chen & Reshef Tenne & All, 2022. "Mesoscopic sliding ferroelectricity enabled photovoltaic random access memory for material-level artificial vision system," Nature Communications, Nature, vol. 13(1), pages 1-8, December.
    19. Ui Yeon Won & Quoc An Vu & Sung Bum Park & Mi Hyang Park & Van Dam Do & Hyun Jun Park & Heejun Yang & Young Hee Lee & Woo Jong Yu, 2023. "Multi-neuron connection using multi-terminal floating–gate memristor for unsupervised learning," Nature Communications, Nature, vol. 14(1), pages 1-11, December.
    20. Ying, Jiajie & Liang, Yan & Wang, Junlan & Dong, Yujiao & Wang, Guangyi & Gu, Meiyuan, 2021. "A tristable locally-active memristor and its complex dynamics," Chaos, Solitons & Fractals, Elsevier, vol. 148(C).

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:plo:pone00:0112659. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: plosone (email available below). General contact details of provider: https://journals.plos.org/plosone/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.