IDEAS home Printed from https://ideas.repec.org/a/nat/natcom/v15y2024i1d10.1038_s41467-024-54182-5.html
   My bibliography  Save this article

Digital profiling of gene expression from histology images with linearized attention

Author

Listed:
  • Marija Pizurica

    (Stanford University
    Ghent University)

  • Yuanning Zheng

    (Stanford University)

  • Francisco Carrillo-Perez

    (Stanford University)

  • Humaira Noor

    (Stanford University)

  • Wei Yao

    (Roche Diagnostics Corporation)

  • Christian Wohlfart

    (Roche Diagnostics GmbH)

  • Antoaneta Vladimirova

    (Roche Diagnostics Corporation)

  • Kathleen Marchal

    (Ghent University)

  • Olivier Gevaert

    (Stanford University
    Stanford University)

Abstract

Cancer is a heterogeneous disease requiring costly genetic profiling for better understanding and management. Recent advances in deep learning have enabled cost-effective predictions of genetic alterations from whole slide images (WSIs). While transformers have driven significant progress in non-medical domains, their application to WSIs lags behind due to high model complexity and limited dataset sizes. Here, we introduce SEQUOIA, a linearized transformer model that predicts cancer transcriptomic profiles from WSIs. SEQUOIA is developed using 7584 tumor samples across 16 cancer types, with its generalization capacity validated on two independent cohorts comprising 1368 tumors. Accurately predicted genes are associated with key cancer processes, including inflammatory response, cell cycles and metabolism. Further, we demonstrate the value of SEQUOIA in stratifying the risk of breast cancer recurrence and in resolving spatial gene expression at loco-regional levels. SEQUOIA hence deciphers clinically relevant information from WSIs, opening avenues for personalized cancer management.

Suggested Citation

  • Marija Pizurica & Yuanning Zheng & Francisco Carrillo-Perez & Humaira Noor & Wei Yao & Christian Wohlfart & Antoaneta Vladimirova & Kathleen Marchal & Olivier Gevaert, 2024. "Digital profiling of gene expression from histology images with linearized attention," Nature Communications, Nature, vol. 15(1), pages 1-14, December.
    • Handle: RePEc:nat:natcom:v:15:y:2024:i:1:d:10.1038_s41467-024-54182-5
    DOI: 10.1038/s41467-024-54182-5
    as

    Download full text from publisher

    File URL: https://www.nature.com/articles/s41467-024-54182-5
    File Function: Abstract
    Download Restriction: no
    File URL: https://libkey.io/10.1038/s41467-024-54182-5?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Christina Curtis & Sohrab P. Shah & Suet-Feung Chin & Gulisa Turashvili & Oscar M. Rueda & Mark J. Dunning & Doug Speed & Andy G. Lynch & Shamith Samarajiwa & Yinyin Yuan & Stefan Gräf & Gavin Ha & Gh, 2012. "The genomic and transcriptomic architecture of 2,000 breast tumours reveals novel subgroups," Nature, Nature, vol. 486(7403), pages 346-352, June.
    2. Yuanning Zheng & Francisco Carrillo-Perez & Marija Pizurica & Dieter Henrik Heiland & Olivier Gevaert, 2023. "Spatial cellular architecture predicts prognosis in glioblastoma," Nature Communications, Nature, vol. 14(1), pages 1-16, December.
    3. Simon, Noah & Friedman, Jerome H. & Hastie, Trevor & Tibshirani, Rob, 2011. "Regularization Paths for Cox's Proportional Hazards Model via Coordinate Descent," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 39(i05).
    4. Benoît Schmauch & Alberto Romagnoni & Elodie Pronier & Charlie Saillard & Pascale Maillé & Julien Calderaro & Aurélie Kamoun & Meriem Sefta & Sylvain Toldo & Mikhail Zaslavskiy & Thomas Clozel & Matah, 2020. "A deep learning model to predict RNA-Seq expression of tumours from whole slide images," Nature Communications, Nature, vol. 11(1), pages 1-15, December.
    5. Smriti Chawla & Anja Rockstroh & Melanie Lehman & Ellca Ratther & Atishay Jain & Anuneet Anand & Apoorva Gupta & Namrata Bhattacharya & Sarita Poonia & Priyadarshini Rai & Nirjhar Das & Angshul Majumd, 2022. "Gene expression based inference of cancer drug sensitivity," Nature Communications, Nature, vol. 13(1), pages 1-15, December.
    6. Rohit Arora & Christian Cao & Mehul Kumar & Sarthak Sinha & Ayan Chanda & Reid McNeil & Divya Samuel & Rahul K. Arora & T. Wayne Matthews & Shamir Chandarana & Robert Hart & Joseph C. Dort & Jeff Bier, 2023. "Spatial transcriptomics reveals distinct and conserved tumor core and edge architectures that predict survival and targeted therapy response," Nature Communications, Nature, vol. 14(1), pages 1-19, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Aleix Prat & Fara Brasó-Maristany & Olga Martínez-Sáez & Esther Sanfeliu & Youli Xia & Meritxell Bellet & Patricia Galván & Débora Martínez & Tomás Pascual & Mercedes Marín-Aguilera & Anna Rodríguez &, 2023. "Circulating tumor DNA reveals complex biological features with clinical relevance in metastatic breast cancer," Nature Communications, Nature, vol. 14(1), pages 1-16, December.
    2. Soave, David & Lawless, Jerald F., 2023. "Regularized regression for two phase failure time studies," Computational Statistics & Data Analysis, Elsevier, vol. 182(C).
    3. Liang, Weijuan & Zhang, Qingzhao & Ma, Shuangge, 2024. "Hierarchical false discovery rate control for high-dimensional survival analysis with interactions," Computational Statistics & Data Analysis, Elsevier, vol. 192(C).
    4. Zemin Zheng & Jie Zhang & Yang Li, 2022. "L 0 -Regularized Learning for High-Dimensional Additive Hazards Regression," INFORMS Journal on Computing, INFORMS, vol. 34(5), pages 2762-2775, September.
    5. Simon Bussy & Mokhtar Z. Alaya & Anne‐Sophie Jannot & Agathe Guilloux, 2022. "Binacox: automatic cut‐point detection in high‐dimensional Cox model with applications in genetics," Biometrics, The International Biometric Society, vol. 78(4), pages 1414-1426, December.
    6. Biagini, Francesca & Groll, Andreas & Widenmann, Jan, 2013. "Intensity-based premium evaluation for unemployment insurance products," Insurance: Mathematics and Economics, Elsevier, vol. 53(1), pages 302-316.
    7. Benedicte Sjo Tislevoll & Monica Hellesøy & Oda Helen Eck Fagerholt & Stein-Erik Gullaksen & Aashish Srivastava & Even Birkeland & Dimitrios Kleftogiannis & Pilar Ayuda-Durán & Laure Piechaczyk & Dagi, 2023. "Early response evaluation by single cell signaling profiling in acute myeloid leukemia," Nature Communications, Nature, vol. 14(1), pages 1-17, December.
    8. Leandro C. Hermida & E. Michael Gertz & Eytan Ruppin, 2022. "Predicting cancer prognosis and drug response from the tumor microbiome," Nature Communications, Nature, vol. 13(1), pages 1-15, December.
    9. Hugh Chen & Scott M. Lundberg & Su-In Lee, 2022. "Explaining a series of models by propagating Shapley values," Nature Communications, Nature, vol. 13(1), pages 1-15, December.
    10. Takumi Saegusa & Tianzhou Ma & Gang Li & Ying Qing Chen & Mei-Ling Ting Lee, 2020. "Variable Selection in Threshold Regression Model with Applications to HIV Drug Adherence Data," Statistics in Biosciences, Springer;International Chinese Statistical Association, vol. 12(3), pages 376-398, December.
    11. Camilla Tombari & Alessandro Zannini & Rebecca Bertolio & Silvia Pedretti & Matteo Audano & Luca Triboli & Valeria Cancila & Davide Vacca & Manuel Caputo & Sara Donzelli & Ilenia Segatto & Simone Vodr, 2023. "Mutant p53 sustains serine-glycine synthesis and essential amino acids intake promoting breast cancer growth," Nature Communications, Nature, vol. 14(1), pages 1-21, December.
    12. Wenhua Liang & Jianhua Yao & Ailan Chen & Qingquan Lv & Mark Zanin & Jun Liu & SookSan Wong & Yimin Li & Jiatao Lu & Hengrui Liang & Guoqiang Chen & Haiyan Guo & Jun Guo & Rong Zhou & Limin Ou & Niyun, 2020. "Early triage of critically ill COVID-19 patients using deep learning," Nature Communications, Nature, vol. 11(1), pages 1-7, December.
    13. Tatyana Deryugina & Garth Heutel & Nolan H. Miller & David Molitor & Julian Reif, 2019. "The Mortality and Medical Costs of Air Pollution: Evidence from Changes in Wind Direction," American Economic Review, American Economic Association, vol. 109(12), pages 4178-4219, December.
    14. Andreas Groll & Gerhard Tutz, 2017. "Variable selection in discrete survival models including heterogeneity," Lifetime Data Analysis: An International Journal Devoted to Statistical Methods and Applications for Time-to-Event Data, Springer, vol. 23(2), pages 305-338, April.
    15. Kevin He & Yue Wang & Xiang Zhou & Han Xu & Can Huang, 2019. "An improved variable selection procedure for adaptive Lasso in high-dimensional survival analysis," Lifetime Data Analysis: An International Journal Devoted to Statistical Methods and Applications for Time-to-Event Data, Springer, vol. 25(3), pages 569-585, July.
    16. Chuhan Wang & Adam S. Chan & Xiaohang Fu & Shila Ghazanfar & Jinman Kim & Ellis Patrick & Jean Y. H. Yang, 2025. "Benchmarking the translational potential of spatial gene expression prediction from histology," Nature Communications, Nature, vol. 16(1), pages 1-17, December.
    17. Das Ujjwal & Ebrahimi Nader, 2018. "A New Method For Covariate Selection In Cox Model," Statistics in Transition New Series, Statistics Poland, vol. 19(2), pages 297-314, June.
    18. Matthew F Dixon, 2017. "Sequence Classification of the Limit Order Book using Recurrent Neural Networks," Papers 1707.05642, arXiv.org.
    19. Caroline Hoffmann & Floriane Noel & Maximilien Grandclaudon & Lucile Massenet-Regad & Paula Michea & Philemon Sirven & Lilith Faucheux & Aurore Surun & Olivier Lantz & Mylene Bohec & Jian Ye & Weihua , 2022. "PD-L1 and ICOSL discriminate human Secretory and Helper dendritic cells in cancer, allergy and autoimmunity," Nature Communications, Nature, vol. 13(1), pages 1-20, December.
    20. Thierry Chekouo & Francesco C. Stingo & James D. Doecke & Kim-Anh Do, 2017. "A Bayesian integrative approach for multi-platform genomic data: A kidney cancer case study," Biometrics, The International Biometric Society, vol. 73(2), pages 615-624, June.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nat:natcom:v:15:y:2024:i:1:d:10.1038_s41467-024-54182-5. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.nature.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.