IDEAS home Printed from https://ideas.repec.org/a/nat/nathum/v7y2023i3d10.1038_s41562-022-01507-3.html
   My bibliography  Save this article

A modality-independent proto-organization of human multisensory areas

Author

Listed:
  • Francesca Setti

    (MoMiLab, IMT School for Advanced Studies Lucca)

  • Giacomo Handjaras

    (MoMiLab, IMT School for Advanced Studies Lucca)

  • Davide Bottari

    (MoMiLab, IMT School for Advanced Studies Lucca)

  • Andrea Leo

    (University of Pisa)

  • Matteo Diano

    (University of Turin)

  • Valentina Bruno

    (University of Turin)

  • Carla Tinti

    (University of Turin)

  • Luca Cecchetti

    (MoMiLab, IMT School for Advanced Studies Lucca)

  • Francesca Garbarini

    (University of Turin)

  • Pietro Pietrini

    (MoMiLab, IMT School for Advanced Studies Lucca)

  • Emiliano Ricciardi

    (MoMiLab, IMT School for Advanced Studies Lucca)

Abstract

The processing of multisensory information is based upon the capacity of brain regions, such as the superior temporal cortex, to combine information across modalities. However, it is still unclear whether the representation of coherent auditory and visual events requires any prior audiovisual experience to develop and function. Here we measured brain synchronization during the presentation of an audiovisual, audio-only or video-only version of the same narrative in distinct groups of sensory-deprived (congenitally blind and deaf) and typically developed individuals. Intersubject correlation analysis revealed that the superior temporal cortex was synchronized across auditory and visual conditions, even in sensory-deprived individuals who lack any audiovisual experience. This synchronization was primarily mediated by low-level perceptual features, and relied on a similar modality-independent topographical organization of slow temporal dynamics. The human superior temporal cortex is naturally endowed with a functional scaffolding to yield a common representation across multisensory events.

Suggested Citation

  • Francesca Setti & Giacomo Handjaras & Davide Bottari & Andrea Leo & Matteo Diano & Valentina Bruno & Carla Tinti & Luca Cecchetti & Francesca Garbarini & Pietro Pietrini & Emiliano Ricciardi, 2023. "A modality-independent proto-organization of human multisensory areas," Nature Human Behaviour, Nature, vol. 7(3), pages 397-410, March.
    • Handle: RePEc:nat:nathum:v:7:y:2023:i:3:d:10.1038_s41562-022-01507-3
    DOI: 10.1038/s41562-022-01507-3
    as

    Download full text from publisher

    File URL: https://www.nature.com/articles/s41562-022-01507-3
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1038/s41562-022-01507-3?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Alexander G. Huth & Wendy A. de Heer & Thomas L. Griffiths & Frédéric E. Theunissen & Jack L. Gallant, 2016. "Natural speech reveals the semantic maps that tile human cerebral cortex," Nature, Nature, vol. 532(7600), pages 453-458, April.
    2. Matthew F. Glasser & Timothy S. Coalson & Emma C. Robinson & Carl D. Hacker & John Harwell & Essa Yacoub & Kamil Ugurbil & Jesper Andersson & Christian F. Beckmann & Mark Jenkinson & Stephen M. Smith , 2016. "A multi-modal parcellation of human cerebral cortex," Nature, Nature, vol. 536(7615), pages 171-178, August.
    3. Velia Cardin & Eleni Orfanidou & Jerker Rönnberg & Cheryl M. Capek & Mary Rudner & Bencie Woll, 2013. "Dissociating cognitive and sensory neural plasticity in human superior temporal cortex," Nature Communications, Nature, vol. 4(1), pages 1-5, June.
    4. Giada Lettieri & Giacomo Handjaras & Emiliano Ricciardi & Andrea Leo & Paolo Papale & Monica Betta & Pietro Pietrini & Luca Cecchetti, 2019. "Emotionotopy in the human right temporo-parietal cortex," Nature Communications, Nature, vol. 10(1), pages 1-13, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. David M Alexander & Tonio Ball & Andreas Schulze-Bonhage & Cees van Leeuwen, 2019. "Large-scale cortical travelling waves predict localized future cortical signals," PLOS Computational Biology, Public Library of Science, vol. 15(11), pages 1-34, November.
    2. Sam V Norman-Haignere & Josh H McDermott, 2018. "Neural responses to natural and model-matched stimuli reveal distinct computations in primary and nonprimary auditory cortex," PLOS Biology, Public Library of Science, vol. 16(12), pages 1-46, December.
    3. Leon D. Lotter & Amin Saberi & Justine Y. Hansen & Bratislav Misic & Casey Paquola & Gareth J. Barker & Arun L. W. Bokde & Sylvane Desrivières & Herta Flor & Antoine Grigis & Hugh Garavan & Penny Gowl, 2024. "Regional patterns of human cortex development correlate with underlying neurobiology," Nature Communications, Nature, vol. 15(1), pages 1-21, December.
    4. Haewon Nam & Chongwon Pae & Jinseok Eo & Maeng-Keun Oh & Hae-Jeong Park, 2021. "Inter-species cortical registration between macaques and humans using a functional network property under a spherical demons framework," PLOS ONE, Public Library of Science, vol. 16(10), pages 1-22, October.
    5. Chandan Singh & Armin Askari & Rich Caruana & Jianfeng Gao, 2023. "Augmenting interpretable models with large language models during training," Nature Communications, Nature, vol. 14(1), pages 1-11, December.
    6. Arno Klein & Satrajit S Ghosh & Forrest S Bao & Joachim Giard & Yrjö Häme & Eliezer Stavsky & Noah Lee & Brian Rossa & Martin Reuter & Elias Chaibub Neto & Anisha Keshavan, 2017. "Mindboggling morphometry of human brains," PLOS Computational Biology, Public Library of Science, vol. 13(2), pages 1-40, February.
    7. Sara Borgomaneri & Marco Zanon & Paolo Di Luzio & Antonio Cataneo & Giorgio Arcara & Vincenzo Romei & Marco Tamietto & Alessio Avenanti, 2023. "Increasing associative plasticity in temporo-occipital back-projections improves visual perception of emotions," Nature Communications, Nature, vol. 14(1), pages 1-15, December.
    8. Ann Hillier & Ryan P Kelly & Terrie Klinger, 2016. "Narrative Style Influences Citation Frequency in Climate Change Science," PLOS ONE, Public Library of Science, vol. 11(12), pages 1-12, December.
    9. Manish Saggar & James M. Shine & Raphaël Liégeois & Nico U. F. Dosenbach & Damien Fair, 2022. "Precision dynamical mapping using topological data analysis reveals a hub-like transition state at rest," Nature Communications, Nature, vol. 13(1), pages 1-19, December.
    10. Casey Paquola & Reinder Vos De Wael & Konrad Wagstyl & Richard A I Bethlehem & Seok-Jun Hong & Jakob Seidlitz & Edward T Bullmore & Alan C Evans & Bratislav Misic & Daniel S Margulies & Jonathan Small, 2019. "Microstructural and functional gradients are increasingly dissociated in transmodal cortices," PLOS Biology, Public Library of Science, vol. 17(5), pages 1-28, May.
    11. Peter Zhukovsky & Earvin S. Tio & Gillian Coughlan & David A. Bennett & Yanling Wang & Timothy J. Hohman & Diego A. Pizzagalli & Benoit H. Mulsant & Aristotle N. Voineskos & Daniel Felsky, 2024. "Genetic influences on brain and cognitive health and their interactions with cardiovascular conditions and depression," Nature Communications, Nature, vol. 15(1), pages 1-11, December.
    12. Tingting Bo & Jie Li & Ganlu Hu & Ge Zhang & Wei Wang & Qian Lv & Shaoling Zhao & Junjie Ma & Meng Qin & Xiaohui Yao & Meiyun Wang & Guang-Zhong Wang & Zheng Wang, 2023. "Brain-wide and cell-specific transcriptomic insights into MRI-derived cortical morphology in macaque monkeys," Nature Communications, Nature, vol. 14(1), pages 1-15, December.
    13. Gustavo Deco & Diego Vidaurre & Morten L. Kringelbach, 2021. "Revisiting the global workspace orchestrating the hierarchical organization of the human brain," Nature Human Behaviour, Nature, vol. 5(4), pages 497-511, April.
    14. Sofie L. Valk & Ting Xu & Casey Paquola & Bo-yong Park & Richard A. I. Bethlehem & Reinder Vos de Wael & Jessica Royer & Shahrzad Kharabian Masouleh & Şeyma Bayrak & Peter Kochunov & B. T. Thomas Yeo , 2022. "Genetic and phylogenetic uncoupling of structure and function in human transmodal cortex," Nature Communications, Nature, vol. 13(1), pages 1-17, December.
    15. Natalie Weed & Trygve Bakken & Nile Graddis & Nathan Gouwens & Daniel Millman & Michael Hawrylycz & Jack Waters, 2019. "Identification of genetic markers for cortical areas using a Random Forest classification routine and the Allen Mouse Brain Atlas," PLOS ONE, Public Library of Science, vol. 14(9), pages 1-13, September.
    16. Beau Sievers & Christopher Welker & Uri Hasson & Adam M. Kleinbaum & Thalia Wheatley, 2024. "Consensus-building conversation leads to neural alignment," Nature Communications, Nature, vol. 15(1), pages 1-15, December.
    17. Zachariah M. Reagh & Charan Ranganath, 2023. "Flexible reuse of cortico-hippocampal representations during encoding and recall of naturalistic events," Nature Communications, Nature, vol. 14(1), pages 1-15, December.
    18. Daniel S. Kluger & Carina Forster & Omid Abbasi & Nikos Chalas & Arno Villringer & Joachim Gross, 2023. "Modulatory dynamics of periodic and aperiodic activity in respiration-brain coupling," Nature Communications, Nature, vol. 14(1), pages 1-12, December.
    19. Sreejan Kumar & Theodore R. Sumers & Takateru Yamakoshi & Ariel Goldstein & Uri Hasson & Kenneth A. Norman & Thomas L. Griffiths & Robert D. Hawkins & Samuel A. Nastase, 2024. "Shared functional specialization in transformer-based language models and the human brain," Nature Communications, Nature, vol. 15(1), pages 1-19, December.
    20. Andrea I. Luppi & Helena M. Gellersen & Zhen-Qi Liu & Alexander R. D. Peattie & Anne E. Manktelow & Ram Adapa & Adrian M. Owen & Lorina Naci & David K. Menon & Stavros I. Dimitriadis & Emmanuel A. Sta, 2024. "Systematic evaluation of fMRI data-processing pipelines for consistent functional connectomics," Nature Communications, Nature, vol. 15(1), pages 1-24, December.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nat:nathum:v:7:y:2023:i:3:d:10.1038_s41562-022-01507-3. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.nature.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.