IDEAS home Printed from https://ideas.repec.org/a/nat/nature/v532y2016i7600d10.1038_nature17637.html
   My bibliography  Save this article

Natural speech reveals the semantic maps that tile human cerebral cortex

Author

Listed:
  • Alexander G. Huth

    (Helen Wills Neuroscience Institute, University of California)

  • Wendy A. de Heer

    (University of California)

  • Thomas L. Griffiths

    (Helen Wills Neuroscience Institute, University of California
    University of California)

  • Frédéric E. Theunissen

    (Helen Wills Neuroscience Institute, University of California
    University of California)

  • Jack L. Gallant

    (Helen Wills Neuroscience Institute, University of California
    University of California)

Abstract

The meaning of language is represented in regions of the cerebral cortex collectively known as the ‘semantic system’. However, little of the semantic system has been mapped comprehensively, and the semantic selectivity of most regions is unknown. Here we systematically map semantic selectivity across the cortex using voxel-wise modelling of functional MRI (fMRI) data collected while subjects listened to hours of narrative stories. We show that the semantic system is organized into intricate patterns that seem to be consistent across individuals. We then use a novel generative model to create a detailed semantic atlas. Our results suggest that most areas within the semantic system represent information about specific semantic domains, or groups of related concepts, and our atlas shows which domains are represented in each area. This study demonstrates that data-driven methods—commonplace in studies of human neuroanatomy and functional connectivity—provide a powerful and efficient means for mapping functional representations in the brain.

Suggested Citation

  • Alexander G. Huth & Wendy A. de Heer & Thomas L. Griffiths & Frédéric E. Theunissen & Jack L. Gallant, 2016. "Natural speech reveals the semantic maps that tile human cerebral cortex," Nature, Nature, vol. 532(7600), pages 453-458, April.
    • Handle: RePEc:nat:nature:v:532:y:2016:i:7600:d:10.1038_nature17637
    DOI: 10.1038/nature17637
    as

    Download full text from publisher

    File URL: https://www.nature.com/articles/nature17637
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1038/nature17637?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Beau Sievers & Christopher Welker & Uri Hasson & Adam M. Kleinbaum & Thalia Wheatley, 2024. "Consensus-building conversation leads to neural alignment," Nature Communications, Nature, vol. 15(1), pages 1-15, December.
    2. Sam V Norman-Haignere & Josh H McDermott, 2018. "Neural responses to natural and model-matched stimuli reveal distinct computations in primary and nonprimary auditory cortex," PLOS Biology, Public Library of Science, vol. 16(12), pages 1-46, December.
    3. Jörn Diedrichsen & Nikolaus Kriegeskorte, 2017. "Representational models: A common framework for understanding encoding, pattern-component, and representational-similarity analysis," PLOS Computational Biology, Public Library of Science, vol. 13(4), pages 1-33, April.
    4. Chandan Singh & Armin Askari & Rich Caruana & Jianfeng Gao, 2023. "Augmenting interpretable models with large language models during training," Nature Communications, Nature, vol. 14(1), pages 1-11, December.
    5. Desjardins, Christoph, 2021. "Don't be too SMART, but SAVE your goals: Proposal for a renewed goal-setting formula for Generation Y," Journal of Applied Leadership and Management, Hochschule Kempten - University of Applied Sciences, Professional School of Business & Technology, vol. 9, pages 73-87.
    6. Katherine Farrow & Gilles Grolleau & Naoufel Mzoughi, 2018. "What in the Word! The Scope for the Effect of Word Choice on Economic Behavior," Kyklos, Wiley Blackwell, vol. 71(4), pages 557-580, November.
    7. Zsuzsanna Kocsis & Rick L. Jenison & Peter N. Taylor & Ryan M. Calmus & Bob McMurray & Ariane E. Rhone & McCall E. Sarrett & Carolina Deifelt Streese & Yukiko Kikuchi & Phillip E. Gander & Joel I. Ber, 2023. "Immediate neural impact and incomplete compensation after semantic hub disconnection," Nature Communications, Nature, vol. 14(1), pages 1-17, December.
    8. Sreejan Kumar & Theodore R. Sumers & Takateru Yamakoshi & Ariel Goldstein & Uri Hasson & Kenneth A. Norman & Thomas L. Griffiths & Robert D. Hawkins & Samuel A. Nastase, 2024. "Shared functional specialization in transformer-based language models and the human brain," Nature Communications, Nature, vol. 15(1), pages 1-19, December.
    9. Timothy N Rubin & Oluwasanmi Koyejo & Krzysztof J Gorgolewski & Michael N Jones & Russell A Poldrack & Tal Yarkoni, 2017. "Decoding brain activity using a large-scale probabilistic functional-anatomical atlas of human cognition," PLOS Computational Biology, Public Library of Science, vol. 13(10), pages 1-24, October.
    10. Ariel Goldstein & Avigail Grinstein-Dabush & Mariano Schain & Haocheng Wang & Zhuoqiao Hong & Bobbi Aubrey & Samuel A. Nastase & Zaid Zada & Eric Ham & Amir Feder & Harshvardhan Gazula & Eliav Buchnik, 2024. "Alignment of brain embeddings and artificial contextual embeddings in natural language points to common geometric patterns," Nature Communications, Nature, vol. 15(1), pages 1-12, December.
    11. Francesca Setti & Giacomo Handjaras & Davide Bottari & Andrea Leo & Matteo Diano & Valentina Bruno & Carla Tinti & Luca Cecchetti & Francesca Garbarini & Pietro Pietrini & Emiliano Ricciardi, 2023. "A modality-independent proto-organization of human multisensory areas," Nature Human Behaviour, Nature, vol. 7(3), pages 397-410, March.
    12. Sebastian P. H. Speer & Laetitia Mwilambwe-Tshilobo & Lily Tsoi & Shannon M. Burns & Emily B. Falk & Diana I. Tamir, 2024. "Hyperscanning shows friends explore and strangers converge in conversation," Nature Communications, Nature, vol. 15(1), pages 1-13, December.
    13. Laurent Caplette & Nicholas B. Turk-Browne, 2024. "Computational reconstruction of mental representations using human behavior," Nature Communications, Nature, vol. 15(1), pages 1-19, December.
    14. Charlotte Caucheteux & Alexandre Gramfort & Jean-Rémi King, 2023. "Evidence of a predictive coding hierarchy in the human brain listening to speech," Nature Human Behaviour, Nature, vol. 7(3), pages 430-441, March.
    15. Maryam Honari-Jahromi & Brea Chouinard & Esti Blanco-Elorrieta & Liina Pylkkänen & Alona Fyshe, 2021. "Neural representation of words within phrases: Temporal evolution of color-adjectives and object-nouns during simple composition," PLOS ONE, Public Library of Science, vol. 16(3), pages 1-17, March.
    16. Lorenza Lucchi Basili & Pier Luigi Sacco, 2017. "Tie-Up Cycles in Long-Term Mating. Part II: Fictional Narratives and the Social Cognition of Mating," Challenges, MDPI, vol. 8(1), pages 1-60, February.
    17. David M Alexander & Tonio Ball & Andreas Schulze-Bonhage & Cees van Leeuwen, 2019. "Large-scale cortical travelling waves predict localized future cortical signals," PLOS Computational Biology, Public Library of Science, vol. 15(11), pages 1-34, November.
    18. Keiko Ohmae & Shogo Ohmae, 2024. "Emergence of syntax and word prediction in an artificial neural circuit of the cerebellum," Nature Communications, Nature, vol. 15(1), pages 1-13, December.
    19. Xue L. Gong & Alexander G. Huth & Fatma Deniz & Keith Johnson & Jack L. Gallant & Frédéric E. Theunissen, 2023. "Phonemic segmentation of narrative speech in human cerebral cortex," Nature Communications, Nature, vol. 14(1), pages 1-17, December.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nat:nature:v:532:y:2016:i:7600:d:10.1038_nature17637. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    We have no bibliographic references for this item. You can help adding them by using this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.nature.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.