IDEAS home Printed from https://ideas.repec.org/a/plo/pcbi00/1005645.html
   My bibliography  Save this article

Neuron’s eye view: Inferring features of complex stimuli from neural responses

Author

Listed:
  • Xin Chen
  • Jeffrey M Beck
  • John M Pearson

Abstract

Experiments that study neural encoding of stimuli at the level of individual neurons typically choose a small set of features present in the world—contrast and luminance for vision, pitch and intensity for sound—and assemble a stimulus set that systematically varies along these dimensions. Subsequent analysis of neural responses to these stimuli typically focuses on regression models, with experimenter-controlled features as predictors and spike counts or firing rates as responses. Unfortunately, this approach requires knowledge in advance about the relevant features coded by a given population of neurons. For domains as complex as social interaction or natural movement, however, the relevant feature space is poorly understood, and an arbitrary a priori choice of features may give rise to confirmation bias. Here, we present a Bayesian model for exploratory data analysis that is capable of automatically identifying the features present in unstructured stimuli based solely on neuronal responses. Our approach is unique within the class of latent state space models of neural activity in that it assumes that firing rates of neurons are sensitive to multiple discrete time-varying features tied to the stimulus, each of which has Markov (or semi-Markov) dynamics. That is, we are modeling neural activity as driven by multiple simultaneous stimulus features rather than intrinsic neural dynamics. We derive a fast variational Bayesian inference algorithm and show that it correctly recovers hidden features in synthetic data, as well as ground-truth stimulus features in a prototypical neural dataset. To demonstrate the utility of the algorithm, we also apply it to cluster neural responses and demonstrate successful recovery of features corresponding to monkeys and faces in the image set.Author summary: Many neuroscience experiments begin with a set of reduced stimuli designed to vary only along a small set of variables. Yet many phenomena of interest—natural movies, objects—are not easily parameterized by a small number of dimensions. Here, we develop a novel Bayesian model for clustering stimuli based solely on neural responses, allowing us to discover which latent features of complex stimuli actually drive neural activity. We demonstrate that this model allows us to recover key features of neural responses in a pair of well-studied paradigms.

Suggested Citation

  • Xin Chen & Jeffrey M Beck & John M Pearson, 2017. "Neuron’s eye view: Inferring features of complex stimuli from neural responses," PLOS Computational Biology, Public Library of Science, vol. 13(8), pages 1-18, August.
  • Handle: RePEc:plo:pcbi00:1005645
    DOI: 10.1371/journal.pcbi.1005645
    as

    Download full text from publisher

    File URL: https://journals.plos.org/ploscompbiol/article?id=10.1371/journal.pcbi.1005645
    Download Restriction: no

    File URL: https://journals.plos.org/ploscompbiol/article/file?id=10.1371/journal.pcbi.1005645&type=printable
    Download Restriction: no

    File URL: https://libkey.io/10.1371/journal.pcbi.1005645?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Jonathan W. Pillow & Jonathon Shlens & Liam Paninski & Alexander Sher & Alan M. Litke & E. J. Chichilnisky & Eero P. Simoncelli, 2008. "Spatio-temporal correlations and visual signalling in a complete neuronal population," Nature, Nature, vol. 454(7207), pages 995-999, August.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Arne F Meyer & Jan-Philipp Diepenbrock & Max F K Happel & Frank W Ohl & Jörn Anemüller, 2014. "Discriminative Learning of Receptive Fields from Responses to Non-Gaussian Stimulus Ensembles," PLOS ONE, Public Library of Science, vol. 9(4), pages 1-15, April.
    2. Jonathan Rubin & Nachum Ulanovsky & Israel Nelken & Naftali Tishby, 2016. "The Representation of Prediction Error in Auditory Cortex," PLOS Computational Biology, Public Library of Science, vol. 12(8), pages 1-28, August.
    3. Franklin Leong & Babak Rahmani & Demetri Psaltis & Christophe Moser & Diego Ghezzi, 2024. "An actor-model framework for visual sensory encoding," Nature Communications, Nature, vol. 15(1), pages 1-13, December.
    4. Lucas Rudelt & Daniel González Marx & Michael Wibral & Viola Priesemann, 2021. "Embedding optimization reveals long-lasting history dependence in neural spiking activity," PLOS Computational Biology, Public Library of Science, vol. 17(6), pages 1-51, June.
    5. Pengcheng Zhou & Shawn D Burton & Adam C Snyder & Matthew A Smith & Nathaniel N Urban & Robert E Kass, 2015. "Establishing a Statistical Link between Network Oscillations and Neural Synchrony," PLOS Computational Biology, Public Library of Science, vol. 11(10), pages 1-25, October.
    6. Richard Naud & Wulfram Gerstner, 2012. "Coding and Decoding with Adapting Neurons: A Population Approach to the Peri-Stimulus Time Histogram," PLOS Computational Biology, Public Library of Science, vol. 8(10), pages 1-14, October.
    7. Fanfan Li & Dingwei Li & Chuanqing Wang & Guolei Liu & Rui Wang & Huihui Ren & Yingjie Tang & Yan Wang & Yitong Chen & Kun Liang & Qi Huang & Mohamad Sawan & Min Qiu & Hong Wang & Bowen Zhu, 2024. "An artificial visual neuron with multiplexed rate and time-to-first-spike coding," Nature Communications, Nature, vol. 15(1), pages 1-11, December.
    8. Kenneth W. Latimer & David J. Freedman, 2023. "Low-dimensional encoding of decisions in parietal cortex reflects long-term training history," Nature Communications, Nature, vol. 14(1), pages 1-24, December.
    9. Braden A W Brinkman & Alison I Weber & Fred Rieke & Eric Shea-Brown, 2016. "How Do Efficient Coding Strategies Depend on Origins of Noise in Neural Circuits?," PLOS Computational Biology, Public Library of Science, vol. 12(10), pages 1-34, October.
    10. Jason S Prentice & Olivier Marre & Mark L Ioffe & Adrianna R Loback & Gašper Tkačik & Michael J Berry II, 2016. "Error-Robust Modes of the Retinal Population Code," PLOS Computational Biology, Public Library of Science, vol. 12(11), pages 1-32, November.
    11. Yanyun Ren & Xiaobo Bu & Ming Wang & Yue Gong & Junjie Wang & Yuyang Yang & Guijun Li & Meng Zhang & Ye Zhou & Su-Ting Han, 2022. "Synaptic plasticity in self-powered artificial striate cortex for binocular orientation selectivity," Nature Communications, Nature, vol. 13(1), pages 1-11, December.
    12. Jan Humplik & Gašper Tkačik, 2017. "Probabilistic models for neural populations that naturally capture global coupling and criticality," PLOS Computational Biology, Public Library of Science, vol. 13(9), pages 1-26, September.
    13. Anirban Das & Alec G. Sheffield & Anirvan S. Nandy & Monika P. Jadi, 2024. "Brain-state mediated modulation of inter-laminar dependencies in visual cortex," Nature Communications, Nature, vol. 15(1), pages 1-14, December.
    14. Urs Köster & Jascha Sohl-Dickstein & Charles M Gray & Bruno A Olshausen, 2014. "Modeling Higher-Order Correlations within Cortical Microcolumns," PLOS Computational Biology, Public Library of Science, vol. 10(7), pages 1-12, July.
    15. Philip A. White & Alan E. Gelfand, 2021. "Generalized Evolutionary Point Processes: Model Specifications and Model Comparison," Methodology and Computing in Applied Probability, Springer, vol. 23(3), pages 1001-1021, September.
    16. Michael E Rule & David Schnoerr & Matthias H Hennig & Guido Sanguinetti, 2019. "Neural field models for latent state inference: Application to large-scale neuronal recordings," PLOS Computational Biology, Public Library of Science, vol. 15(11), pages 1-23, November.
    17. Martin J M Lankheet & P Christiaan Klink & Bart G Borghuis & André J Noest, 2012. "Spike-Interval Triggered Averaging Reveals a Quasi-Periodic Spiking Alternative for Stochastic Resonance in Catfish Electroreceptors," PLOS ONE, Public Library of Science, vol. 7(3), pages 1-11, March.
    18. Liangyu Tao & Samuel P. Wechsler & Vikas Bhandawat, 2023. "Sensorimotor transformation underlying odor-modulated locomotion in walking Drosophila," Nature Communications, Nature, vol. 14(1), pages 1-22, December.
    19. Srdjan Ostojic & Nicolas Brunel, 2011. "From Spiking Neuron Models to Linear-Nonlinear Models," PLOS Computational Biology, Public Library of Science, vol. 7(1), pages 1-16, January.
    20. Noel Federman & Sebastián A. Romano & Macarena Amigo-Duran & Lucca Salomon & Antonia Marin-Burgin, 2024. "Acquisition of non-olfactory encoding improves odour discrimination in olfactory cortex," Nature Communications, Nature, vol. 15(1), pages 1-19, December.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:plo:pcbi00:1005645. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: ploscompbiol (email available below). General contact details of provider: https://journals.plos.org/ploscompbiol/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.