IDEAS home Printed from https://ideas.repec.org/a/gam/jmathe/v10y2022i16p2975-d890821.html
   My bibliography  Save this article

A Novel Artificial Visual System for Motion Direction Detection in Grayscale Images

Author

Listed:
  • Sichen Tao

    (Faculty of Engineering, University of Toyama, Toyama-shi 930-8555, Japan)

  • Yuki Todo

    (Faculty of Electrical and Computer Engineering, Kanazawa University, Kanazawa-shi 920-1192, Japan)

  • Zheng Tang

    (Faculty of Engineering, University of Toyama, Toyama-shi 930-8555, Japan)

  • Bin Li

    (Faculty of Electrical and Computer Engineering, Kanazawa University, Kanazawa-shi 920-1192, Japan)

  • Zhiming Zhang

    (Faculty of Engineering, University of Toyama, Toyama-shi 930-8555, Japan)

  • Riku Inoue

    (Faculty of Electrical and Computer Engineering, Kanazawa University, Kanazawa-shi 920-1192, Japan)

Abstract

How specific features of the environment are represented in the mammalian brain is an important unexplained mystery in neuroscience. Visual information is considered to be captured most preferentially by the brain. As one of the visual information elements, motion direction in the receptive field is thought to be collected already at the retinal direction-selective ganglion cell (DSGC) layer. However, knowledge of direction-selective (DS) mechanisms in the retina has remained only at a cellular level, and there is a lack of complete direction-sensitivity understanding in the visual system. Previous studies of DS models have been limited to the stage of one-dimensional black-and-white (binary) images or still lack biological rationality. In this paper, we innovatively propose a two-dimensional, eight-directional motion direction detection mechanism for grayscale images called the artificial visual system (AVS). The structure and neuronal functions of this mechanism are highly faithful to neuroscientific perceptions of the mammalian retinal DS pathway, and thus highly biologically reasonable. In particular, by introducing the horizontal contact pathway provided by horizontal cells (HCs) in the retinal inner nuclear layer and forming a functional collaboration with bipolar cells (BCs), the limitation that previous DS models can only recognize object motion directions in binary images is overcome; the proposed model can solve the recognizing problem of object motion directions in grayscale images. Through computer simulation experiments, we verified that AVS is effective and has high detection accuracy, and it is not affected by the shape, size, and location of objects in the receptive field. Its excellent noise immunity was also verified by adding multiple types of noise to the experimental data set. Compared to a classical convolutional neural network (CNN), it was verified that AVS is completely significantly better in terms of effectiveness and noise immunity, and has various advantages such as high interpretability, no need for learning, and easy hardware implementation. In addition, activation characteristics of neurons in AVS are highly consistent with those real in the retinal DS pathway, with strong neurofunctional similarity and brain-like superiority. Moreover, AVS will also provide a novel perspective and approach to understanding and analyzing mechanisms as well as principles of mammalian retinal direction-sensitivity in face of a cognitive bottleneck on the DS pathway that has persisted for nearly 60 years.

Suggested Citation

  • Sichen Tao & Yuki Todo & Zheng Tang & Bin Li & Zhiming Zhang & Riku Inoue, 2022. "A Novel Artificial Visual System for Motion Direction Detection in Grayscale Images," Mathematics, MDPI, vol. 10(16), pages 1-32, August.
  • Handle: RePEc:gam:jmathe:v:10:y:2022:i:16:p:2975-:d:890821
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2227-7390/10/16/2975/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/2227-7390/10/16/2975/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Thomas Euler & Peter B. Detwiler & Winfried Denk, 2002. "Directionally selective calcium signals in dendrites of starburst amacrine cells," Nature, Nature, vol. 418(6900), pages 845-852, August.
    2. Kevin L. Briggman & Moritz Helmstaedter & Winfried Denk, 2011. "Wiring specificity in the direction-selectivity circuit of the retina," Nature, Nature, vol. 471(7337), pages 183-188, March.
    3. Idan Segev, 1998. "Sound grounds for computing dendrites," Nature, Nature, vol. 393(6682), pages 207-208, May.
    4. Kenichi Ohki & Sooyoung Chung & Yeang H. Ch'ng & Prakash Kara & R. Clay Reid, 2005. "Functional imaging with cellular resolution reveals precise micro-architecture in visual cortex," Nature, Nature, vol. 433(7026), pages 597-603, February.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Sichen Tao & Xiliang Zhang & Yuxiao Hua & Zheng Tang & Yuki Todo, 2023. "A Novel Artificial Visual System for Motion Direction Detection with Completely Modeled Retinal Direction-Selective Pathway," Mathematics, MDPI, vol. 11(17), pages 1-18, August.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Jen-Chun Hsiang & Ning Shen & Florentina Soto & Daniel Kerschensteiner, 2024. "Distributed feature representations of natural stimuli across parallel retinal pathways," Nature Communications, Nature, vol. 15(1), pages 1-20, December.
    2. Dominic J. Vita & Fernanda S. Orsi & Nathan G. Stanko & Natalie A. Clark & Alexandre Tiriac, 2024. "Development and organization of the retinal orientation selectivity map," Nature Communications, Nature, vol. 15(1), pages 1-11, December.
    3. Javier G. Orlandi & Mohammad Abdolrahmani & Ryo Aoki & Dmitry R. Lyamzin & Andrea Benucci, 2023. "Distributed context-dependent choice information in mouse posterior cortex," Nature Communications, Nature, vol. 14(1), pages 1-16, December.
    4. Jason S Prentice & Olivier Marre & Mark L Ioffe & Adrianna R Loback & Gašper Tkačik & Michael J Berry II, 2016. "Error-Robust Modes of the Retinal Population Code," PLOS Computational Biology, Public Library of Science, vol. 12(11), pages 1-32, November.
    5. Brad Busse & Stephen Smith, 2013. "Automated Analysis of a Diverse Synapse Population," PLOS Computational Biology, Public Library of Science, vol. 9(3), pages 1-14, March.
    6. Elaine Tring & Konnie K. Duan & Dario L. Ringach, 2022. "ON/OFF domains shape receptive field structure in mouse visual cortex," Nature Communications, Nature, vol. 13(1), pages 1-11, December.
    7. Yuxiao Hua & Yuki Todo & Zheng Tang & Sichen Tao & Bin Li & Riku Inoue, 2022. "A Novel Bio-Inspired Motion Direction Detection Mechanism in Binary and Grayscale Background," Mathematics, MDPI, vol. 10(20), pages 1-16, October.
    8. Andrew Jo & Sercan Deniz & Jian Xu & Robert M. Duvoisin & Steven H. DeVries & Yongling Zhu, 2023. "A sign-inverted receptive field of inhibitory interneurons provides a pathway for ON-OFF interactions in the retina," Nature Communications, Nature, vol. 14(1), pages 1-16, December.
    9. Yeon Jin Kim & Beth B. Peterson & Joanna D. Crook & Hannah R. Joo & Jiajia Wu & Christian Puller & Farrel R. Robinson & Paul D. Gamlin & King-Wai Yau & Felix Viana & John B. Troy & Robert G. Smith & O, 2022. "Origins of direction selectivity in the primate retina," Nature Communications, Nature, vol. 13(1), pages 1-20, December.
    10. Andrew Jo & Sercan Deniz & Suraj Cherian & Jian Xu & Daiki Futagi & Steven H. DeVries & Yongling Zhu, 2023. "Modular interneuron circuits control motion sensitivity in the mouse retina," Nature Communications, Nature, vol. 14(1), pages 1-17, December.
    11. Elishai Ezra-Tsur & Oren Amsalem & Lea Ankri & Pritish Patil & Idan Segev & Michal Rivlin-Etzion, 2021. "Realistic retinal modeling unravels the differential role of excitation and inhibition to starburst amacrine cells in direction selectivity," PLOS Computational Biology, Public Library of Science, vol. 17(12), pages 1-31, December.
    12. Yulin Shi & Zoran Nenadic & Xiangmin Xu, 2010. "Novel Use of Matched Filtering for Synaptic Event Detection and Extraction," PLOS ONE, Public Library of Science, vol. 5(11), pages 1-15, November.
    13. Han Xu & Dashan Shang & Qing Luo & Junjie An & Yue Li & Shuyu Wu & Zhihong Yao & Woyu Zhang & Xiaoxin Xu & Chunmeng Dou & Hao Jiang & Liyang Pan & Xumeng Zhang & Ming Wang & Zhongrui Wang & Jianshi Ta, 2023. "A low-power vertical dual-gate neurotransistor with short-term memory for high energy-efficient neuromorphic computing," Nature Communications, Nature, vol. 14(1), pages 1-11, December.
    14. Tobias Clark & Vera Hapiak & Mitchell Oakes & Holly Mills & Richard Komuniecki, 2018. "Monoamines differentially modulate neuropeptide release from distinct sites within a single neuron pair," PLOS ONE, Public Library of Science, vol. 13(5), pages 1-22, May.
    15. Haleigh N. Mulholland & Matthias Kaschube & Gordon B. Smith, 2024. "Self-organization of modular activity in immature cortical networks," Nature Communications, Nature, vol. 15(1), pages 1-16, December.
    16. Yajie Liang & Rongwen Lu & Katharine Borges & Na Ji, 2023. "Stimulus edges induce orientation tuning in superior colliculus," Nature Communications, Nature, vol. 14(1), pages 1-13, December.
    17. Xiliang Zhang & Sichen Tao & Zheng Tang & Shuxin Zheng & Yoki Todo, 2023. "The Mechanism of Orientation Detection Based on Artificial Visual System for Greyscale Images," Mathematics, MDPI, vol. 11(12), pages 1-13, June.
    18. James Trousdale & Yu Hu & Eric Shea-Brown & Krešimir Josić, 2012. "Impact of Network Structure and Cellular Response on Spike Time Correlations," PLOS Computational Biology, Public Library of Science, vol. 8(3), pages 1-15, March.
    19. Héctor Acarón Ledesma & Jennifer Ding & Swen Oosterboer & Xiaolin Huang & Qiang Chen & Sui Wang & Michael Z. Lin & Wei Wei, 2024. "Dendritic mGluR2 and perisomatic Kv3 signaling regulate dendritic computation of mouse starburst amacrine cells," Nature Communications, Nature, vol. 15(1), pages 1-15, December.
    20. Anna Kreshuk & Ullrich Koethe & Elizabeth Pax & Davi D Bock & Fred A Hamprecht, 2014. "Automated Detection of Synapses in Serial Section Transmission Electron Microscopy Image Stacks," PLOS ONE, Public Library of Science, vol. 9(2), pages 1-11, February.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jmathe:v:10:y:2022:i:16:p:2975-:d:890821. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.