IDEAS home Printed from https://ideas.repec.org/a/nat/natcom/v15y2024i1d10.1038_s41467-024-49669-0.html
   My bibliography  Save this article

Immersive scene representation in human visual cortex with ultra-wide-angle neuroimaging

Author

Listed:
  • Jeongho Park

    (Harvard University)

  • Edward Soucy

    (Harvard University)

  • Jennifer Segawa

    (Harvard University)

  • Ross Mair

    (Harvard University
    Harvard Medical School
    Massachusetts General Hospital)

  • Talia Konkle

    (Harvard University
    Harvard University
    Harvard University)

Abstract

While human vision spans 220°, traditional functional MRI setups display images only up to central 10-15°. Thus, it remains unknown how the brain represents a scene perceived across the full visual field. Here, we introduce a method for ultra-wide angle display and probe signatures of immersive scene representation. An unobstructed view of 175° is achieved by bouncing the projected image off angled-mirrors onto a custom-built curved screen. To avoid perceptual distortion, scenes are created with wide field-of-view from custom virtual environments. We find that immersive scene representation drives medial cortex with far-peripheral preferences, but shows minimal modulation in classic scene regions. Further, scene and face-selective regions maintain their content preferences even with extreme far-periphery stimulation, highlighting that not all far-peripheral information is automatically integrated into scene regions computations. This work provides clarifying evidence on content vs. peripheral preferences in scene representation and opens new avenues to research immersive vision.

Suggested Citation

  • Jeongho Park & Edward Soucy & Jennifer Segawa & Ross Mair & Talia Konkle, 2024. "Immersive scene representation in human visual cortex with ultra-wide-angle neuroimaging," Nature Communications, Nature, vol. 15(1), pages 1-15, December.
    • Handle: RePEc:nat:natcom:v:15:y:2024:i:1:d:10.1038_s41467-024-49669-0
    DOI: 10.1038/s41467-024-49669-0
    as

    Download full text from publisher

    File URL: https://www.nature.com/articles/s41467-024-49669-0
    File Function: Abstract
    Download Restriction: no
    File URL: https://libkey.io/10.1038/s41467-024-49669-0?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Adam Steel & Madeleine M. Billings & Edward H. Silson & Caroline E. Robertson, 2021. "A network linking scene perception and spatial memory systems in posterior cerebral cortex," Nature Communications, Nature, vol. 12(1), pages 1-13, December.
    2. Dawn Finzi & Jesse Gomez & Marisa Nordt & Alex A. Rezai & Sonia Poltoratski & Kalanit Grill-Spector, 2021. "Differential spatial computations in ventral and lateral face-selective regions are scaffolded by structural connections," Nature Communications, Nature, vol. 12(1), pages 1-14, December.
    3. C. T. Ellis & L. J. Skalaban & T. S. Yates & V. R. Bejjanki & N. I. Córdova & N. B. Turk-Browne, 2020. "Re-imagining fMRI for awake behaving infants," Nature Communications, Nature, vol. 11(1), pages 1-12, December.
    4. Adam Steel & Madeleine M. Billings & Edward H. Silson & Caroline E. Robertson, 2021. "Publisher Correction: A network linking scene perception and spatial memory systems in posterior cerebral cortex," Nature Communications, Nature, vol. 12(1), pages 1-1, December.
    5. Russell Epstein & Nancy Kanwisher, 1998. "A cortical representation of the local visual environment," Nature, Nature, vol. 392(6676), pages 598-601, April.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Marisa Nordt & Jesse Gomez & Vaidehi S. Natu & Alex A. Rezai & Dawn Finzi & Holly Kular & Kalanit Grill-Spector, 2023. "Longitudinal development of category representations in ventral temporal cortex predicts word and face recognition," Nature Communications, Nature, vol. 14(1), pages 1-16, December.
    2. Wilma A. Bainbridge & Chris I. Baker, 2022. "Multidimensional memory topography in the medial parietal cortex identified from neuroimaging of thousands of daily memory videos," Nature Communications, Nature, vol. 13(1), pages 1-16, December.
    3. Serra E. Favila & Brice A. Kuhl & Jonathan Winawer, 2022. "Perception and memory have distinct spatial tuning properties in human visual cortex," Nature Communications, Nature, vol. 13(1), pages 1-21, December.
    4. Vasiliki Bougou & Michaël Vanhoyland & Alexander Bertrand & Wim Paesschen & Hans Op De Beeck & Peter Janssen & Tom Theys, 2024. "Neuronal tuning and population representations of shape and category in human visual cortex," Nature Communications, Nature, vol. 15(1), pages 1-15, December.
    5. Ying Wang & Xue Zhang & Chunhui Wang & Weifen Huang & Qian Xu & Dong Liu & Wen Zhou & Shanguang Chen & Yi Jiang, 2022. "Modulation of biological motion perception in humans by gravity," Nature Communications, Nature, vol. 13(1), pages 1-10, December.
    6. Joel Z Leibo & Qianli Liao & Fabio Anselmi & Tomaso Poggio, 2015. "The Invariance Hypothesis Implies Domain-Specific Regions in Visual Cortex," PLOS Computational Biology, Public Library of Science, vol. 11(10), pages 1-29, October.
    7. Isabella C. Wagner & Luise P. Graichen & Boryana Todorova & Andre Lüttig & David B. Omer & Matthias Stangl & Claus Lamm, 2023. "Entorhinal grid-like codes and time-locked network dynamics track others navigating through space," Nature Communications, Nature, vol. 14(1), pages 1-18, December.
    8. Marcelo G Mattar & Michael W Cole & Sharon L Thompson-Schill & Danielle S Bassett, 2015. "A Functional Cartography of Cognitive Systems," PLOS Computational Biology, Public Library of Science, vol. 11(12), pages 1-26, December.
    9. Guohua Shen & Tomoyasu Horikawa & Kei Majima & Yukiyasu Kamitani, 2019. "Deep image reconstruction from human brain activity," PLOS Computational Biology, Public Library of Science, vol. 15(1), pages 1-23, January.
    10. Batrancea Larissa, 2021. "Research Insights From Cognitive Neuroscience For Everyday Economists," Annals - Economy Series, Constantin Brancusi University, Faculty of Economics, vol. 2, pages 35-41, April.
    11. Zhou, Lixing & Takane, Yoshio & Hwang, Heungsun, 2016. "Dynamic GSCANO (Generalized Structured Canonical Correlation Analysis) with applications to the analysis of effective connectivity in functional neuroimaging data," Computational Statistics & Data Analysis, Elsevier, vol. 101(C), pages 93-109.
    12. Mengna Yao & Bincheng Wen & Mingpo Yang & Jiebin Guo & Haozhou Jiang & Chao Feng & Yilei Cao & Huiguang He & Le Chang, 2023. "High-dimensional topographic organization of visual features in the primate temporal lobe," Nature Communications, Nature, vol. 14(1), pages 1-23, December.
    13. Michael F Bonner & Russell A Epstein, 2018. "Computational mechanisms underlying cortical responses to the affordance properties of visual scenes," PLOS Computational Biology, Public Library of Science, vol. 14(4), pages 1-31, April.
    14. Samy A. Abdel-Ghaffar & Alexander G. Huth & Mark D. Lescroart & Dustin Stansbury & Jack L. Gallant & Sonia J. Bishop, 2024. "Occipital-temporal cortical tuning to semantic and affective features of natural images predicts associated behavioral responses," Nature Communications, Nature, vol. 15(1), pages 1-17, December.
    15. Krisztina Nagy & Mark W Greenlee & Gyula Kovács, 2011. "Sensory Competition in the Face Processing Areas of the Human Brain," PLOS ONE, Public Library of Science, vol. 6(9), pages 1-12, September.
    16. Kai J Miller & Gerwin Schalk & Dora Hermes & Jeffrey G Ojemann & Rajesh P N Rao, 2016. "Spontaneous Decoding of the Timing and Content of Human Object Perception from Cortical Surface Recordings Reveals Complementary Information in the Event-Related Potential and Broadband Spectral Chang," PLOS Computational Biology, Public Library of Science, vol. 12(1), pages 1-20, January.
    17. Ping‐Shou Zhong & Jun Li & Piotr Kokoszka, 2021. "Multivariate analysis of variance and change points estimation for high‐dimensional longitudinal data," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 48(2), pages 375-405, June.
    18. Haider Al-Tahan & Yalda Mohsenzadeh, 2021. "Reconstructing feedback representations in the ventral visual pathway with a generative adversarial autoencoder," PLOS Computational Biology, Public Library of Science, vol. 17(3), pages 1-19, March.
    19. István Czigler & Helene Intraub & Gábor Stefanics, 2013. "Prediction Beyond the Borders: ERP Indices of Boundary Extension-Related Error," PLOS ONE, Public Library of Science, vol. 8(9), pages 1-1, September.
    20. Stephen Ramanoël & Louise Kauffmann & Emilie Cousin & Michel Dojat & Carole Peyrin, 2015. "Age-Related Differences in Spatial Frequency Processing during Scene Categorization," PLOS ONE, Public Library of Science, vol. 10(8), pages 1-24, August.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nat:natcom:v:15:y:2024:i:1:d:10.1038_s41467-024-49669-0. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.nature.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.