IDEAS home Printed from https://ideas.repec.org/a/plo/pone00/0144636.html
   My bibliography  Save this article

Hierarchical Novelty-Familiarity Representation in the Visual System by Modular Predictive Coding

Author

Listed:
  • Boris Vladimirskiy
  • Robert Urbanczik
  • Walter Senn

Abstract

Predictive coding has been previously introduced as a hierarchical coding framework for the visual system. At each level, activity predicted by the higher level is dynamically subtracted from the input, while the difference in activity continuously propagates further. Here we introduce modular predictive coding as a feedforward hierarchy of prediction modules without back-projections from higher to lower levels. Within each level, recurrent dynamics optimally segregates the input into novelty and familiarity components. Although the anatomical feedforward connectivity passes through the novelty-representing neurons, it is nevertheless the familiarity information which is propagated to higher levels. This modularity results in a twofold advantage compared to the original predictive coding scheme: the familiarity-novelty representation forms quickly, and at each level the full representational power is exploited for an optimized readout. As we show, natural images are successfully compressed and can be reconstructed by the familiarity neurons at each level. Missing information on different spatial scales is identified by novelty neurons and complements the familiarity representation. Furthermore, by virtue of the recurrent connectivity within each level, non-classical receptive field properties still emerge. Hence, modular predictive coding is a biologically realistic metaphor for the visual system that dynamically extracts novelty at various scales while propagating the familiarity information.

Suggested Citation

  • Boris Vladimirskiy & Robert Urbanczik & Walter Senn, 2015. "Hierarchical Novelty-Familiarity Representation in the Visual System by Modular Predictive Coding," PLOS ONE, Public Library of Science, vol. 10(12), pages 1-19, December.
  • Handle: RePEc:plo:pone00:0144636
    DOI: 10.1371/journal.pone.0144636
    as

    Download full text from publisher

    File URL: https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0144636
    Download Restriction: no

    File URL: https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0144636&type=printable
    Download Restriction: no

    File URL: https://libkey.io/10.1371/journal.pone.0144636?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Falk Lieder & Klaas E Stephan & Jean Daunizeau & Marta I Garrido & Karl J Friston, 2013. "A Neurocomputational Model of the Mismatch Negativity," PLOS Computational Biology, Public Library of Science, vol. 9(11), pages 1-14, November.
    2. Yan Karklin & Michael S. Lewicki, 2009. "Emergence of complex cell properties by learning to generalize in natural scenes," Nature, Nature, vol. 457(7225), pages 83-86, January.
    3. Karl Friston, 2008. "Hierarchical Models in the Brain," PLOS Computational Biology, Public Library of Science, vol. 4(11), pages 1-24, November.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Micha Heilbron & Florent Meyniel, 2019. "Confidence resets reveal hierarchical adaptive learning in humans," PLOS Computational Biology, Public Library of Science, vol. 15(4), pages 1-24, April.
    2. Jörn-Philipp Lies & Ralf M Häfner & Matthias Bethge, 2014. "Slowness and Sparseness Have Diverging Effects on Complex Cell Learning," PLOS Computational Biology, Public Library of Science, vol. 10(3), pages 1-11, March.
    3. John C. Boik, 2020. "Science-Driven Societal Transformation, Part I: Worldview," Sustainability, MDPI, vol. 12(17), pages 1-28, August.
    4. Ruben Coen-Cagli & Peter Dayan & Odelia Schwartz, 2012. "Cortical Surround Interactions and Perceptual Salience via Natural Scene Statistics," PLOS Computational Biology, Public Library of Science, vol. 8(3), pages 1-18, March.
    5. Mateus Joffily & Giorgio Coricelli, 2013. "Emotional Valence and the Free-Energy Principle," Post-Print halshs-00834063, HAL.
    6. Falk Lieder & Klaas E Stephan & Jean Daunizeau & Marta I Garrido & Karl J Friston, 2013. "A Neurocomputational Model of the Mismatch Negativity," PLOS Computational Biology, Public Library of Science, vol. 9(11), pages 1-14, November.
    7. Jaroslav Vítků & Petr Dluhoš & Joseph Davidson & Matěj Nikl & Simon Andersson & Přemysl Paška & Jan Šinkora & Petr Hlubuček & Martin Stránský & Martin Hyben & Martin Poliak & Jan Feyereisl & Marek Ros, 2020. "ToyArchitecture: Unsupervised learning of interpretable models of the environment," PLOS ONE, Public Library of Science, vol. 15(5), pages 1-50, May.
    8. Ünsal Özdilek, 2021. "Sensing Happiness in Senseless Information," Applied Research in Quality of Life, Springer;International Society for Quality-of-Life Studies, vol. 16(5), pages 2059-2084, October.
    9. Adeeti Aggarwal & Connor Brennan & Jennifer Luo & Helen Chung & Diego Contreras & Max B. Kelz & Alex Proekt, 2022. "Visual evoked feedforward–feedback traveling waves organize neural activity across the cortical hierarchy in mice," Nature Communications, Nature, vol. 13(1), pages 1-16, December.
    10. Dileep George & Jeff Hawkins, 2009. "Towards a Mathematical Theory of Cortical Micro-circuits," PLOS Computational Biology, Public Library of Science, vol. 5(10), pages 1-26, October.
    11. Iris I A Groen & Sennay Ghebreab & Victor A F Lamme & H Steven Scholte, 2012. "Spatially Pooled Contrast Responses Predict Neural and Perceptual Similarity of Naturalistic Image Categories," PLOS Computational Biology, Public Library of Science, vol. 8(10), pages 1-16, October.
    12. Jeffrey D Fitzgerald & Ryan J Rowekamp & Lawrence C Sincich & Tatyana O Sharpee, 2011. "Second Order Dimensionality Reduction Using Minimum and Maximum Mutual Information Models," PLOS Computational Biology, Public Library of Science, vol. 7(10), pages 1-9, October.
    13. David Balduzzi & Giulio Tononi, 2009. "Qualia: The Geometry of Integrated Information," PLOS Computational Biology, Public Library of Science, vol. 5(8), pages 1-24, August.
    14. Qianli Yang & Edgar Walker & R. James Cotton & Andreas S. Tolias & Xaq Pitkow, 2021. "Revealing nonlinear neural decoding by analyzing choices," Nature Communications, Nature, vol. 12(1), pages 1-13, December.
    15. Annika Garlichs & Helen Blank, 2024. "Prediction error processing and sharpening of expected information across the face-processing hierarchy," Nature Communications, Nature, vol. 15(1), pages 1-18, December.
    16. Laurence Aitchison & Máté Lengyel, 2016. "The Hamiltonian Brain: Efficient Probabilistic Inference with Excitatory-Inhibitory Neural Circuit Dynamics," PLOS Computational Biology, Public Library of Science, vol. 12(12), pages 1-24, December.
    17. Alexander Ororbia & Daniel Kifer, 2022. "The neural coding framework for learning generative models," Nature Communications, Nature, vol. 13(1), pages 1-14, December.
    18. Adam Safron, 2019. "Multilevel evolutionary developmental optimization (MEDO): A theoretical framework for understanding preferences and selection dynamics," Papers 1910.13443, arXiv.org, revised Nov 2019.
    19. Cooper A Smout & Matthew F Tang & Marta I Garrido & Jason B Mattingley, 2019. "Attention promotes the neural encoding of prediction errors," PLOS Biology, Public Library of Science, vol. 17(2), pages 1-22, February.
    20. Biswa Sengupta & Arturo Tozzi & Gerald K Cooray & Pamela K Douglas & Karl J Friston, 2016. "Towards a Neuronal Gauge Theory," PLOS Biology, Public Library of Science, vol. 14(3), pages 1-12, March.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:plo:pone00:0144636. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: plosone (email available below). General contact details of provider: https://journals.plos.org/plosone/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.