IDEAS home Printed from https://ideas.repec.org/a/nat/natcom/v15y2024i1d10.1038_s41467-024-45312-0.html
   My bibliography  Save this article

Memristor-based storage system with convolutional autoencoder-based image compression network

Author

Listed:
  • Yulin Feng

    (Peking University
    Beijing Information Science & Technology University)

  • Yizhou Zhang

    (Peking University)

  • Zheng Zhou

    (Peking University)

  • Peng Huang

    (Peking University)

  • Lifeng Liu

    (Peking University)

  • Xiaoyan Liu

    (Peking University)

  • Jinfeng Kang

    (Peking University)

Abstract

The exponential growth of various complex images is putting tremendous pressure on storage systems. Here, we propose a memristor-based storage system with an integrated near-storage in-memory computing-based convolutional autoencoder compression network to boost the energy efficiency and speed of the image compression/retrieval and improve the storage density. We adopt the 4-bit memristor arrays to experimentally demonstrate the functions of the system. We propose a step-by-step quantization aware training scheme and an equivalent transformation for transpose convolution to improve the system performance. The system exhibits a high (>33 dB) peak signal-to-noise ratio in the compression and decompression of the ImageNet and Kodak24 datasets. Benchmark comparison results show that the 4-bit memristor-based storage system could reduce the latency and energy consumption by over 20×/5.6× and 180×/91×, respectively, compared with the server-grade central processing unit-based/the graphics processing unit-based processing system, and improve the storage density by more than 3 times.

Suggested Citation

  • Yulin Feng & Yizhou Zhang & Zheng Zhou & Peng Huang & Lifeng Liu & Xiaoyan Liu & Jinfeng Kang, 2024. "Memristor-based storage system with convolutional autoencoder-based image compression network," Nature Communications, Nature, vol. 15(1), pages 1-13, December.
    • Handle: RePEc:nat:natcom:v:15:y:2024:i:1:d:10.1038_s41467-024-45312-0
    DOI: 10.1038/s41467-024-45312-0
    as

    Download full text from publisher

    File URL: https://www.nature.com/articles/s41467-024-45312-0
    File Function: Abstract
    Download Restriction: no
    File URL: https://libkey.io/10.1038/s41467-024-45312-0?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Mingyi Rao & Hao Tang & Jiangbin Wu & Wenhao Song & Max Zhang & Wenbo Yin & Ye Zhuo & Fatemeh Kiani & Benjamin Chen & Xiangqi Jiang & Hefei Liu & Hung-Yu Chen & Rivu Midya & Fan Ye & Hao Jiang & Zhong, 2023. "Thousands of conductance levels in memristors integrated on CMOS," Nature, Nature, vol. 615(7954), pages 823-829, March.
    2. Peng Yao & Huaqiang Wu & Bin Gao & Jianshi Tang & Qingtian Zhang & Wenqiang Zhang & J. Joshua Yang & He Qian, 2020. "Fully hardware-implemented memristor convolutional neural network," Nature, Nature, vol. 577(7792), pages 641-646, January.
    3. Zhengwu Liu & Jianshi Tang & Bin Gao & Peng Yao & Xinyi Li & Dingkun Liu & Ying Zhou & He Qian & Bo Hong & Huaqiang Wu, 2020. "Neural signal analysis with memristor arrays towards high-efficiency brain–machine interfaces," Nature Communications, Nature, vol. 11(1), pages 1-9, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Djohan Bonnet & Tifenn Hirtzlin & Atreya Majumdar & Thomas Dalgaty & Eduardo Esmanhotto & Valentina Meli & Niccolo Castellani & Simon Martin & Jean-François Nodin & Guillaume Bourgeois & Jean-Michel P, 2023. "Bringing uncertainty quantification to the extreme-edge with memristor-based Bayesian neural networks," Nature Communications, Nature, vol. 14(1), pages 1-13, December.
    2. Xiangpeng Liang & Yanan Zhong & Jianshi Tang & Zhengwu Liu & Peng Yao & Keyang Sun & Qingtian Zhang & Bin Gao & Hadi Heidari & He Qian & Huaqiang Wu, 2022. "Rotating neurons for all-analog implementation of cyclic reservoir computing," Nature Communications, Nature, vol. 13(1), pages 1-11, December.
    3. Bin Gao & Ying Zhou & Qingtian Zhang & Shuanglin Zhang & Peng Yao & Yue Xi & Qi Liu & Meiran Zhao & Wenqiang Zhang & Zhengwu Liu & Xinyi Li & Jianshi Tang & He Qian & Huaqiang Wu, 2022. "Memristor-based analogue computing for brain-inspired sound localization with in situ training," Nature Communications, Nature, vol. 13(1), pages 1-8, December.
    4. Shuzhi Liu & Jianmin Zeng & Zhixin Wu & Han Hu & Ao Xu & Xiaohe Huang & Weilin Chen & Qilai Chen & Zhe Yu & Yinyu Zhao & Rong Wang & Tingting Han & Chao Li & Pingqi Gao & Hyunwoo Kim & Seung Jae Baik , 2023. "An ultrasmall organic synapse for neuromorphic computing," Nature Communications, Nature, vol. 14(1), pages 1-10, December.
    5. Peng Chen & Fenghao Liu & Peng Lin & Peihong Li & Yu Xiao & Bihua Zhang & Gang Pan, 2023. "Open-loop analog programmable electrochemical memory array," Nature Communications, Nature, vol. 14(1), pages 1-9, December.
    6. Han Zhao & Zhengwu Liu & Jianshi Tang & Bin Gao & Qi Qin & Jiaming Li & Ying Zhou & Peng Yao & Yue Xi & Yudeng Lin & He Qian & Huaqiang Wu, 2023. "Energy-efficient high-fidelity image reconstruction with memristor arrays for medical diagnosis," Nature Communications, Nature, vol. 14(1), pages 1-10, December.
    7. Mingrui Jiang & Keyi Shan & Chengping He & Can Li, 2023. "Efficient combinatorial optimization by quantum-inspired parallel annealing in analogue memristor crossbar," Nature Communications, Nature, vol. 14(1), pages 1-11, December.
    8. Yanming Liu & He Tian & Fan Wu & Anhan Liu & Yihao Li & Hao Sun & Mario Lanza & Tian-Ling Ren, 2023. "Cellular automata imbedded memristor-based recirculated logic in-memory computing," Nature Communications, Nature, vol. 14(1), pages 1-11, December.
    9. Jongmin Lee & Bum Ho Jeong & Eswaran Kamaraj & Dohyung Kim & Hakjun Kim & Sanghyuk Park & Hui Joon Park, 2023. "Light-enhanced molecular polarity enabling multispectral color-cognitive memristor for neuromorphic visual system," Nature Communications, Nature, vol. 14(1), pages 1-19, December.
    10. Yu, Fei & Kong, Xinxin & Yao, Wei & Zhang, Jin & Cai, Shuo & Lin, Hairong & Jin, Jie, 2024. "Dynamics analysis, synchronization and FPGA implementation of multiscroll Hopfield neural networks with non-polynomial memristor," Chaos, Solitons & Fractals, Elsevier, vol. 179(C).
    11. Alsuwian, Turki & Kousar, Farhana & Rasheed, Umbreen & Imran, Muhammad & Hussain, Fayyaz & Arif Khalil, R.M. & Algadi, Hassan & Batool, Najaf & Khera, Ejaz Ahmad & Kiran, Saira & Ashiq, Muhammad Naeem, 2021. "First principles investigation of physically conductive bridge filament formation of aluminum doped perovskite materials for neuromorphic memristive applications," Chaos, Solitons & Fractals, Elsevier, vol. 150(C).
    12. Ruibin Mao & Bo Wen & Arman Kazemi & Yahui Zhao & Ann Franchesca Laguna & Rui Lin & Ngai Wong & Michael Niemier & X. Sharon Hu & Xia Sheng & Catherine E. Graves & John Paul Strachan & Can Li, 2022. "Experimentally validated memristive memory augmented neural network with efficient hashing and similarity search," Nature Communications, Nature, vol. 13(1), pages 1-13, December.
    13. Zhongfang Zhang & Xiaolong Zhao & Xumeng Zhang & Xiaohu Hou & Xiaolan Ma & Shuangzhu Tang & Ying Zhang & Guangwei Xu & Qi Liu & Shibing Long, 2022. "In-sensor reservoir computing system for latent fingerprint recognition with deep ultraviolet photo-synapses and memristor array," Nature Communications, Nature, vol. 13(1), pages 1-9, December.
    14. Ren, Lujie & Mou, Jun & Banerjee, Santo & Zhang, Yushu, 2023. "A hyperchaotic map with a new discrete memristor model: Design, dynamical analysis, implementation and application," Chaos, Solitons & Fractals, Elsevier, vol. 167(C).
    15. Syed Ghazi Sarwat & Timoleon Moraitis & C. David Wright & Harish Bhaskaran, 2022. "Chalcogenide optomemristors for multi-factor neuromorphic computation," Nature Communications, Nature, vol. 13(1), pages 1-9, December.
    16. Guangdi Feng & Qiuxiang Zhu & Xuefeng Liu & Luqiu Chen & Xiaoming Zhao & Jianquan Liu & Shaobing Xiong & Kexiang Shan & Zhenzhong Yang & Qinye Bao & Fangyu Yue & Hui Peng & Rong Huang & Xiaodong Tang , 2024. "A ferroelectric fin diode for robust non-volatile memory," Nature Communications, Nature, vol. 15(1), pages 1-11, December.
    17. Seokho Seo & Beomjin Kim & Donghoon Kim & Seungwoo Park & Tae Ryong Kim & Junkyu Park & Hakcheon Jeong & See-On Park & Taehoon Park & Hyeok Shin & Myung-Su Kim & Yang-Kyu Choi & Shinhyun Choi, 2022. "The gate injection-based field-effect synapse transistor with linear conductance update for online training," Nature Communications, Nature, vol. 13(1), pages 1-10, December.
    18. Tianyu Wang & Jialin Meng & Xufeng Zhou & Yue Liu & Zhenyu He & Qi Han & Qingxuan Li & Jiajie Yu & Zhenhai Li & Yongkai Liu & Hao Zhu & Qingqing Sun & David Wei Zhang & Peining Chen & Huisheng Peng & , 2022. "Reconfigurable neuromorphic memristor network for ultralow-power smart textile electronics," Nature Communications, Nature, vol. 13(1), pages 1-8, December.
    19. Yijun Li & Jianshi Tang & Bin Gao & Jian Yao & Anjunyi Fan & Bonan Yan & Yuchao Yang & Yue Xi & Yuankun Li & Jiaming Li & Wen Sun & Yiwei Du & Zhengwu Liu & Qingtian Zhang & Song Qiu & Qingwen Li & He, 2023. "Monolithic three-dimensional integration of RRAM-based hybrid memory architecture for one-shot learning," Nature Communications, Nature, vol. 14(1), pages 1-9, December.
    20. Maosong Xie & Yueyang Jia & Chen Nie & Zuheng Liu & Alvin Tang & Shiquan Fan & Xiaoyao Liang & Li Jiang & Zhezhi He & Rui Yang, 2023. "Monolithic 3D integration of 2D transistors and vertical RRAMs in 1T–4R structure for high-density memory," Nature Communications, Nature, vol. 14(1), pages 1-11, December.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nat:natcom:v:15:y:2024:i:1:d:10.1038_s41467-024-45312-0. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.nature.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.