IDEAS home Printed from https://ideas.repec.org/a/plo/pcbi00/1000380.html
   My bibliography  Save this article

Pairwise Maximum Entropy Models for Studying Large Biological Systems: When They Can Work and When They Can't

Author

Listed:
  • Yasser Roudi
  • Sheila Nirenberg
  • Peter E Latham

Abstract

One of the most critical problems we face in the study of biological systems is building accurate statistical descriptions of them. This problem has been particularly challenging because biological systems typically contain large numbers of interacting elements, which precludes the use of standard brute force approaches. Recently, though, several groups have reported that there may be an alternate strategy. The reports show that reliable statistical models can be built without knowledge of all the interactions in a system; instead, pairwise interactions can suffice. These findings, however, are based on the analysis of small subsystems. Here, we ask whether the observations will generalize to systems of realistic size, that is, whether pairwise models will provide reliable descriptions of true biological systems. Our results show that, in most cases, they will not. The reason is that there is a crossover in the predictive power of pairwise models: If the size of the subsystem is below the crossover point, then the results have no predictive power for large systems. If the size is above the crossover point, then the results may have predictive power. This work thus provides a general framework for determining the extent to which pairwise models can be used to predict the behavior of large biological systems. Applied to neural data, the size of most systems studied so far is below the crossover point. Author Summary: Biological systems are exceedingly complicated: They consist of a large number of elements, those elements interact in nonlinear and highly unpredictable ways, and collective interactions typically play a critical role. It would seem surprising, then, that one could build a quantitative description of biological systems based only on knowledge of how pairs of elements interact. Yet, that is what a number of studies have found. Those studies, however, focused on relatively small systems. Here, we ask the question: Do their conclusions extend to large systems? We show that the answer depends on the size of the system relative to a crossover point: Below the crossover point the results on the small system have no predictive power for large systems; above the crossover point the results on the small system may have predictive power. Moreover, the crossover point can be computed analytically. This work thus provides a general framework for determining the extent to which pairwise models can be used to predict the behavior of large biological systems. It also provides a useful heuristic for designing experiments: If one is interested in understanding truly large systems via pairwise interactions, then make sure that the system one studies is above the crossover point.

Suggested Citation

  • Yasser Roudi & Sheila Nirenberg & Peter E Latham, 2009. "Pairwise Maximum Entropy Models for Studying Large Biological Systems: When They Can Work and When They Can't," PLOS Computational Biology, Public Library of Science, vol. 5(5), pages 1-18, May.
  • Handle: RePEc:plo:pcbi00:1000380
    DOI: 10.1371/journal.pcbi.1000380
    as

    Download full text from publisher

    File URL: https://journals.plos.org/ploscompbiol/article?id=10.1371/journal.pcbi.1000380
    Download Restriction: no

    File URL: https://journals.plos.org/ploscompbiol/article/file?id=10.1371/journal.pcbi.1000380&type=printable
    Download Restriction: no

    File URL: https://libkey.io/10.1371/journal.pcbi.1000380?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. S. Nirenberg & S. M. Carcieri & A. L. Jacobs & P. E. Latham, 2001. "Retinal ganglion cells act largely as independent encoders," Nature, Nature, vol. 411(6838), pages 698-701, June.
    2. Michael Socolich & Steve W. Lockless & William P. Russ & Heather Lee & Kevin H. Gardner & Rama Ranganathan, 2005. "Evolutionary information for specifying a protein fold," Nature, Nature, vol. 437(7058), pages 512-518, September.
    3. Elad Schneidman & Michael J. Berry & Ronen Segev & William Bialek, 2006. "Weak pairwise correlations imply strongly correlated network states in a neural population," Nature, Nature, vol. 440(7087), pages 1007-1012, April.
    4. William P. Russ & Drew M. Lowery & Prashant Mishra & Michael B. Yaffe & Rama Ranganathan, 2005. "Natural-like function in artificial WW domains," Nature, Nature, vol. 437(7058), pages 579-583, September.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Cofré, Rodrigo & Cessac, Bruno, 2013. "Dynamics and spike trains statistics in conductance-based integrate-and-fire neural networks with chemical and electric synapses," Chaos, Solitons & Fractals, Elsevier, vol. 50(C), pages 13-31.
    2. Montani, Fernando & Phoka, Elena & Portesi, Mariela & Schultz, Simon R., 2013. "Statistical modelling of higher-order correlations in pools of neural activity," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 392(14), pages 3066-3086.
    3. Benjamin Dunn & Maria Mørreaunet & Yasser Roudi, 2015. "Correlations and Functional Connections in a Population of Grid Cells," PLOS Computational Biology, Public Library of Science, vol. 11(2), pages 1-21, February.
    4. Dimitri Yatsenko & Krešimir Josić & Alexander S Ecker & Emmanouil Froudarakis & R James Cotton & Andreas S Tolias, 2015. "Improved Estimation and Interpretation of Correlations in Neural Circuits," PLOS Computational Biology, Public Library of Science, vol. 11(3), pages 1-28, March.
    5. Arno Onken & Valentin Dragoi & Klaus Obermayer, 2012. "A Maximum Entropy Test for Evaluating Higher-Order Correlations in Spike Counts," PLOS Computational Biology, Public Library of Science, vol. 8(6), pages 1-12, June.
    6. Xi, Ning & Muneepeerakul, Rachata & Azaele, Sandro & Wang, Yougui, 2014. "Maximum entropy model for business cycle synchronization," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 413(C), pages 189-194.
    7. Gašper Tkačik & Olivier Marre & Dario Amodei & Elad Schneidman & William Bialek & Michael J Berry II, 2014. "Searching for Collective Behavior in a Large Network of Sensory Neurons," PLOS Computational Biology, Public Library of Science, vol. 10(1), pages 1-23, January.
    8. Montangie, Lisandro & Montani, Fernando, 2015. "Quantifying higher-order correlations in a neuronal pool," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 421(C), pages 388-400.
    9. Hideaki Shimazaki & Shun-ichi Amari & Emery N Brown & Sonja Grün, 2012. "State-Space Analysis of Time-Varying Higher-Order Spike Correlation for Multiple Neural Spike Train Data," PLOS Computational Biology, Public Library of Science, vol. 8(3), pages 1-27, March.
    10. Porta Mana, PierGianLuca & Rostami, Vahid & Torre, Emiliano & Roudi, Yasser, 2018. "Maximum-entropy and representative samples of neuronal activity: a dilemma," OSF Preprints uz29n, Center for Open Science.
    11. Christian Donner & Klaus Obermayer & Hideaki Shimazaki, 2017. "Approximate Inference for Time-Varying Interactions and Macroscopic Dynamics of Neural Populations," PLOS Computational Biology, Public Library of Science, vol. 13(1), pages 1-27, January.
    12. Montangie, Lisandro & Montani, Fernando, 2017. "Higher-order correlations in common input shapes the output spiking activity of a neural population," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 471(C), pages 845-861.
    13. Einat Granot-Atedgi & Gašper Tkačik & Ronen Segev & Elad Schneidman, 2013. "Stimulus-dependent Maximum Entropy Models of Neural Population Codes," PLOS Computational Biology, Public Library of Science, vol. 9(3), pages 1-14, March.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Einat Granot-Atedgi & Gašper Tkačik & Ronen Segev & Elad Schneidman, 2013. "Stimulus-dependent Maximum Entropy Models of Neural Population Codes," PLOS Computational Biology, Public Library of Science, vol. 9(3), pages 1-14, March.
    2. Hugo Jacquin & Amy Gilson & Eugene Shakhnovich & Simona Cocco & Rémi Monasson, 2016. "Benchmarking Inverse Statistical Approaches for Protein Structure and Design with Exactly Solvable Models," PLOS Computational Biology, Public Library of Science, vol. 12(5), pages 1-18, May.
    3. Xu, Xiu-Lian & Shi, Jin-Xuan & Wang, Jun & Li, Wenfei, 2021. "Long-range correlation and critical fluctuations in coevolution networks of protein sequences," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 562(C).
    4. Tiberiu Teşileanu & Lucy J Colwell & Stanislas Leibler, 2015. "Protein Sectors: Statistical Coupling Analysis versus Conservation," PLOS Computational Biology, Public Library of Science, vol. 11(2), pages 1-20, February.
    5. Lipovetsky, Stan, 2018. "Quantum paradigm of probability amplitude and complex utility in entangled discrete choice modeling," Journal of choice modelling, Elsevier, vol. 27(C), pages 62-73.
    6. Mark L Ioffe & Michael J Berry II, 2017. "The structured ‘low temperature’ phase of the retinal population code," PLOS Computational Biology, Public Library of Science, vol. 13(10), pages 1-31, October.
    7. Katarína Bod’ová & Enikő Szép & Nicholas H Barton, 2021. "Dynamic maximum entropy provides accurate approximation of structured population dynamics," PLOS Computational Biology, Public Library of Science, vol. 17(12), pages 1-22, December.
    8. MohammadReza Zahedian & Mahsa Bagherikalhor & Andrey Trufanov & G. Reza Jafari, 2022. "Financial Crisis in the Framework of Non-zero Temperature Balance Theory," Papers 2202.03198, arXiv.org.
    9. Gaëlle Desbordes & Jianzhong Jin & Chong Weng & Nicholas A Lesica & Garrett B Stanley & Jose-Manuel Alonso, 2008. "Timing Precision in Population Coding of Natural Scenes in the Early Visual System," PLOS Biology, Public Library of Science, vol. 6(12), pages 1-11, December.
    10. Maulana, Ardian & Situngkir, Hokky, 2015. "Korelasi Bebas-skala dalam Studi Geo-politik Pemilihan [Scale-free correlation within Geopolitics of Election Studies]," MPRA Paper 66351, University Library of Munich, Germany.
    11. Hideaki Shimazaki & Shun-ichi Amari & Emery N Brown & Sonja Grün, 2012. "State-Space Analysis of Time-Varying Higher-Order Spike Correlation for Multiple Neural Spike Train Data," PLOS Computational Biology, Public Library of Science, vol. 8(3), pages 1-27, March.
    12. Timothy R Lezon & Ivet Bahar, 2010. "Using Entropy Maximization to Understand the Determinants of Structural Dynamics beyond Native Contact Topology," PLOS Computational Biology, Public Library of Science, vol. 6(6), pages 1-12, June.
    13. Xiaoyuan Liu & Hayato Ushijima-Mwesigwa & Avradip Mandal & Sarvagya Upadhyay & Ilya Safro & Arnab Roy, 2022. "Leveraging special-purpose hardware for local search heuristics," Computational Optimization and Applications, Springer, vol. 82(1), pages 1-29, May.
    14. Sacha Jennifer van Albada & Moritz Helias & Markus Diesmann, 2015. "Scalability of Asynchronous Networks Is Limited by One-to-One Mapping between Effective Connectivity and Correlations," PLOS Computational Biology, Public Library of Science, vol. 11(9), pages 1-37, September.
    15. Sahar Gelfman & Quanli Wang & Yi-Fan Lu & Diana Hall & Christopher D Bostick & Ryan Dhindsa & Matt Halvorsen & K Melodi McSweeney & Ellese Cotterill & Tom Edinburgh & Michael A Beaumont & Wayne N Fran, 2018. "meaRtools: An R package for the analysis of neuronal networks recorded on microelectrode arrays," PLOS Computational Biology, Public Library of Science, vol. 14(10), pages 1-20, October.
    16. Shou-Wen Wang & Anne-Florence Bitbol & Ned S Wingreen, 2019. "Revealing evolutionary constraints on proteins through sequence analysis," PLOS Computational Biology, Public Library of Science, vol. 15(4), pages 1-16, April.
    17. Jason S Prentice & Olivier Marre & Mark L Ioffe & Adrianna R Loback & Gašper Tkačik & Michael J Berry II, 2016. "Error-Robust Modes of the Retinal Population Code," PLOS Computational Biology, Public Library of Science, vol. 12(11), pages 1-32, November.
    18. Simona Cocco & Remi Monasson & Martin Weigt, 2013. "From Principal Component to Direct Coupling Analysis of Coevolution in Proteins: Low-Eigenvalue Modes are Needed for Structure Prediction," PLOS Computational Biology, Public Library of Science, vol. 9(8), pages 1-17, August.
    19. Montani, Fernando & Phoka, Elena & Portesi, Mariela & Schultz, Simon R., 2013. "Statistical modelling of higher-order correlations in pools of neural activity," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 392(14), pages 3066-3086.
    20. Jan Humplik & Gašper Tkačik, 2017. "Probabilistic models for neural populations that naturally capture global coupling and criticality," PLOS Computational Biology, Public Library of Science, vol. 13(9), pages 1-26, September.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:plo:pcbi00:1000380. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: ploscompbiol (email available below). General contact details of provider: https://journals.plos.org/ploscompbiol/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.