IDEAS home Printed from https://ideas.repec.org/a/nat/natcom/v15y2024i1d10.1038_s41467-024-48781-5.html
   My bibliography  Save this article

Systematic evaluation of fMRI data-processing pipelines for consistent functional connectomics

Author

Listed:
  • Andrea I. Luppi

    (University of Cambridge
    University of Cambridge
    University of Cambridge
    McGill University)

  • Helena M. Gellersen

    (German Center for Neurodegenerative Diseases
    University of Cambridge)

  • Zhen-Qi Liu

    (McGill University)

  • Alexander R. D. Peattie

    (University of Cambridge
    University of Cambridge)

  • Anne E. Manktelow

    (University of Cambridge
    University of Cambridge)

  • Ram Adapa

    (University of Cambridge
    University of Cambridge)

  • Adrian M. Owen

    (Western Institute for Neuroscience (WIN), Western University
    Western Institute for Neuroscience (WIN), Western University)

  • Lorina Naci

    (School of Psychology, Trinity College Dublin)

  • David K. Menon

    (University of Cambridge)

  • Stavros I. Dimitriadis

    (University of Barcelona
    University of Barcelona
    Cardiff University Brain Research Imaging Centre (CUBRIC), School of Psychology, College of Biomedical and Life Sciences
    School of Medicine, College of Biomedical and Life Sciences, Cardiff University)

  • Emmanuel A. Stamatakis

    (University of Cambridge
    University of Cambridge)

Abstract

Functional interactions between brain regions can be viewed as a network, enabling neuroscientists to investigate brain function through network science. Here, we systematically evaluate 768 data-processing pipelines for network reconstruction from resting-state functional MRI, evaluating the effect of brain parcellation, connectivity definition, and global signal regression. Our criteria seek pipelines that minimise motion confounds and spurious test-retest discrepancies of network topology, while being sensitive to both inter-subject differences and experimental effects of interest. We reveal vast and systematic variability across pipelines’ suitability for functional connectomics. Inappropriate choice of data-processing pipeline can produce results that are not only misleading, but systematically so, with the majority of pipelines failing at least one criterion. However, a set of optimal pipelines consistently satisfy all criteria across different datasets, spanning minutes, weeks, and months. We provide a full breakdown of each pipeline’s performance across criteria and datasets, to inform future best practices in functional connectomics.

Suggested Citation

  • Andrea I. Luppi & Helena M. Gellersen & Zhen-Qi Liu & Alexander R. D. Peattie & Anne E. Manktelow & Ram Adapa & Adrian M. Owen & Lorina Naci & David K. Menon & Stavros I. Dimitriadis & Emmanuel A. Sta, 2024. "Systematic evaluation of fMRI data-processing pipelines for consistent functional connectomics," Nature Communications, Nature, vol. 15(1), pages 1-24, December.
    • Handle: RePEc:nat:natcom:v:15:y:2024:i:1:d:10.1038_s41467-024-48781-5
    DOI: 10.1038/s41467-024-48781-5
    as

    Download full text from publisher

    File URL: https://www.nature.com/articles/s41467-024-48781-5
    File Function: Abstract
    Download Restriction: no
    File URL: https://libkey.io/10.1038/s41467-024-48781-5?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Andrea I. Luppi & Michael M. Craig & Ioannis Pappas & Paola Finoia & Guy B. Williams & Judith Allanson & John D. Pickard & Adrian M. Owen & Lorina Naci & David K. Menon & Emmanuel A. Stamatakis, 2019. "Consciousness-specific dynamic interactions of brain integration and functional diversity," Nature Communications, Nature, vol. 10(1), pages 1-12, December.
    2. Vincent Bazinet & Justine Y. Hansen & Reinder Vos de Wael & Boris C. Bernhardt & Martijn P. Heuvel & Bratislav Misic, 2023. "Assortative mixing in micro-architecturally annotated brain connectomes," Nature Communications, Nature, vol. 14(1), pages 1-16, December.
    3. Maria Giulia Preti & Dimitri Van De Ville, 2019. "Decoupling of brain function from structure reveals regional behavioral specialization in humans," Nature Communications, Nature, vol. 10(1), pages 1-7, December.
    4. Marc-Andre Schulz & B. T. Thomas Yeo & Joshua T. Vogelstein & Janaina Mourao-Miranada & Jakob N. Kather & Konrad Kording & Blake Richards & Danilo Bzdok, 2020. "Different scaling of linear models and deep learning in UKBiobank brain images versus machine-learning datasets," Nature Communications, Nature, vol. 11(1), pages 1-15, December.
    5. Selen Atasoy & Isaac Donnelly & Joel Pearson, 2016. "Human brain networks function in connectome-specific harmonic waves," Nature Communications, Nature, vol. 7(1), pages 1-10, April.
    6. Justine Y. Hansen & Golia Shafiei & Jacob W. Vogel & Kelly Smart & Carrie E. Bearden & Martine Hoogman & Barbara Franke & Daan Rooij & Jan Buitelaar & Carrie R. McDonald & Sanjay M. Sisodiya & Lianne , 2022. "Local molecular and global connectomic contributions to cross-disorder cortical abnormalities," Nature Communications, Nature, vol. 13(1), pages 1-17, December.
    7. Maria Luisa Saggio & Petra Ritter & Viktor K Jirsa, 2016. "Analytical Operations Relate Structural and Functional Connectivity in the Brain," PLOS ONE, Public Library of Science, vol. 11(8), pages 1-25, August.
    8. Thomas J. Littlejohns & Jo Holliday & Lorna M. Gibson & Steve Garratt & Niels Oesingmann & Fidel Alfaro-Almagro & Jimmy D. Bell & Chris Boultwood & Rory Collins & Megan C. Conroy & Nicola Crabtree & N, 2020. "The UK Biobank imaging enhancement of 100,000 participants: rationale, data collection, management and future directions," Nature Communications, Nature, vol. 11(1), pages 1-12, December.
    9. Matthew F. Glasser & Timothy S. Coalson & Emma C. Robinson & Carl D. Hacker & John Harwell & Essa Yacoub & Kamil Ugurbil & Jesper Andersson & Christian F. Beckmann & Mark Jenkinson & Stephen M. Smith , 2016. "A multi-modal parcellation of human cerebral cortex," Nature, Nature, vol. 536(7615), pages 171-178, August.
    10. James C. Pang & Kevin M. Aquino & Marianne Oldehinkel & Peter A. Robinson & Ben D. Fulcher & Michael Breakspear & Alex Fornito, 2023. "Geometric constraints on human brain function," Nature, Nature, vol. 618(7965), pages 566-574, June.
    11. Rotem Botvinik-Nezer & Felix Holzmeister & Colin F. Camerer & Anna Dreber & Juergen Huber & Magnus Johannesson & Michael Kirchler & Roni Iwanir & Jeanette A. Mumford & R. Alison Adcock & Paolo Avesani, 2020. "Variability in the analysis of a single neuroimaging dataset by many teams," Nature, Nature, vol. 582(7810), pages 84-88, June.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Andrea I. Luppi & Lynn Uhrig & Jordy Tasserie & Camilo M. Signorelli & Emmanuel A. Stamatakis & Alain Destexhe & Bechir Jarraya & Rodrigo Cofre, 2024. "Local orchestration of distributed functional patterns supporting loss and restoration of consciousness in the primate brain," Nature Communications, Nature, vol. 15(1), pages 1-22, December.
    2. Jie Xia & Cirong Liu & Jiao Li & Yao Meng & Siqi Yang & Huafu Chen & Wei Liao, 2024. "Decomposing cortical activity through neuronal tracing connectome-eigenmodes in marmosets," Nature Communications, Nature, vol. 15(1), pages 1-13, December.
    3. Jessica Dafflon & Pedro F. Da Costa & František Váša & Ricardo Pio Monti & Danilo Bzdok & Peter J. Hellyer & Federico Turkheimer & Jonathan Smallwood & Emily Jones & Robert Leech, 2022. "A guided multiverse study of neuroimaging analyses," Nature Communications, Nature, vol. 13(1), pages 1-13, December.
    4. Yaqian Yang & Zhiming Zheng & Longzhao Liu & Hongwei Zheng & Yi Zhen & Yi Zheng & Xin Wang & Shaoting Tang, 2023. "Enhanced brain structure-function tethering in transmodal cortex revealed by high-frequency eigenmodes," Nature Communications, Nature, vol. 14(1), pages 1-14, December.
    5. Leon D. Lotter & Amin Saberi & Justine Y. Hansen & Bratislav Misic & Casey Paquola & Gareth J. Barker & Arun L. W. Bokde & Sylvane Desrivières & Herta Flor & Antoine Grigis & Hugh Garavan & Penny Gowl, 2024. "Regional patterns of human cortex development correlate with underlying neurobiology," Nature Communications, Nature, vol. 15(1), pages 1-21, December.
    6. Alessandra Griffa & Mathieu Mach & Julien Dedelley & Daniel Gutierrez-Barragan & Alessandro Gozzi & Gilles Allali & Joanes Grandjean & Dimitri Ville & Enrico Amico, 2023. "Evidence for increased parallel information transmission in human brain networks compared to macaques and male mice," Nature Communications, Nature, vol. 14(1), pages 1-15, December.
    7. Bingxin Zhao & Yujue Li & Zirui Fan & Zhenyi Wu & Juan Shu & Xiaochen Yang & Yilin Yang & Xifeng Wang & Bingxuan Li & Xiyao Wang & Carlos Copana & Yue Yang & Jinjie Lin & Yun Li & Jason L. Stein & Joa, 2024. "Eye-brain connections revealed by multimodal retinal and brain imaging genetics," Nature Communications, Nature, vol. 15(1), pages 1-19, December.
    8. Gustavo Deco & Diego Vidaurre & Morten L. Kringelbach, 2021. "Revisiting the global workspace orchestrating the hierarchical organization of the human brain," Nature Human Behaviour, Nature, vol. 5(4), pages 497-511, April.
    9. S. Parker Singleton & Andrea I. Luppi & Robin L. Carhart-Harris & Josephine Cruzat & Leor Roseman & David J. Nutt & Gustavo Deco & Morten L. Kringelbach & Emmanuel A. Stamatakis & Amy Kuceyeski, 2022. "Receptor-informed network control theory links LSD and psilocybin to a flattening of the brain’s control energy landscape," Nature Communications, Nature, vol. 13(1), pages 1-13, December.
    10. Panagiotis Fotiadis & Matthew Cieslak & Xiaosong He & Lorenzo Caciagli & Mathieu Ouellet & Theodore D. Satterthwaite & Russell T. Shinohara & Dani S. Bassett, 2023. "Myelination and excitation-inhibition balance synergistically shape structure-function coupling across the human cortex," Nature Communications, Nature, vol. 14(1), pages 1-21, December.
    11. Audrey C. Luo & Valerie J. Sydnor & Adam Pines & Bart Larsen & Aaron F. Alexander-Bloch & Matthew Cieslak & Sydney Covitz & Andrew A. Chen & Nathalia Bianchini Esper & Eric Feczko & Alexandre R. Franc, 2024. "Functional connectivity development along the sensorimotor-association axis enhances the cortical hierarchy," Nature Communications, Nature, vol. 15(1), pages 1-16, December.
    12. Saaket Agrawal & Marcus D. R. Klarqvist & Nathaniel Diamant & Takara L. Stanley & Patrick T. Ellinor & Nehal N. Mehta & Anthony Philippakis & Kenney Ng & Melina Claussnitzer & Steven K. Grinspoon & Pu, 2023. "BMI-adjusted adipose tissue volumes exhibit depot-specific and divergent associations with cardiometabolic diseases," Nature Communications, Nature, vol. 14(1), pages 1-10, December.
    13. Shahram Bahrami & Kaja Nordengen & Jaroslav Rokicki & Alexey A. Shadrin & Zillur Rahman & Olav B. Smeland & Piotr P. Jaholkowski & Nadine Parker & Pravesh Parekh & Kevin S. O’Connell & Torbjørn Elvsås, 2024. "The genetic landscape of basal ganglia and implications for common brain disorders," Nature Communications, Nature, vol. 15(1), pages 1-14, December.
    14. Christoph Huber & Christian König-Kersting & Matteo M. Marini, 2022. "Experimenting with Financial Professionals," Working Papers 2022-07, Faculty of Economics and Statistics, Universität Innsbruck, revised Jun 2024.
    15. Nick Huntington‐Klein & Andreu Arenas & Emily Beam & Marco Bertoni & Jeffrey R. Bloem & Pralhad Burli & Naibin Chen & Paul Grieco & Godwin Ekpe & Todd Pugatch & Martin Saavedra & Yaniv Stopnitzky, 2021. "The influence of hidden researcher decisions in applied microeconomics," Economic Inquiry, Western Economic Association International, vol. 59(3), pages 944-960, July.
    16. Dennis Bontempi & Leonard Nuernberg & Suraj Pai & Deepa Krishnaswamy & Vamsi Thiriveedhi & Ahmed Hosny & Raymond H. Mak & Keyvan Farahani & Ron Kikinis & Andrey Fedorov & Hugo J. W. L. Aerts, 2024. "End-to-end reproducible AI pipelines in radiology using the cloud," Nature Communications, Nature, vol. 15(1), pages 1-9, December.
    17. Matthew Rosenblatt & Link Tejavibulya & Rongtao Jiang & Stephanie Noble & Dustin Scheinost, 2024. "Data leakage inflates prediction performance in connectome-based machine learning models," Nature Communications, Nature, vol. 15(1), pages 1-15, December.
    18. Haewon Nam & Chongwon Pae & Jinseok Eo & Maeng-Keun Oh & Hae-Jeong Park, 2021. "Inter-species cortical registration between macaques and humans using a functional network property under a spherical demons framework," PLOS ONE, Public Library of Science, vol. 16(10), pages 1-22, October.
    19. Dreber, Anna & Johannesson, Magnus, 2023. "A framework for evaluating reproducibility and replicability in economics," Ruhr Economic Papers 1055, RWI - Leibniz-Institut für Wirtschaftsforschung, Ruhr-University Bochum, TU Dortmund University, University of Duisburg-Essen.
    20. Daria E. A. Jensen & Klaus P. Ebmeier & Sana Suri & Matthew F. S. Rushworth & Miriam C. Klein-Flügge, 2024. "Nuclei-specific hypothalamus networks predict a dimensional marker of stress in humans," Nature Communications, Nature, vol. 15(1), pages 1-19, December.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nat:natcom:v:15:y:2024:i:1:d:10.1038_s41467-024-48781-5. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.nature.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.