IDEAS home Printed from https://ideas.repec.org/a/spr/jagbes/v25y2020i1d10.1007_s13253-019-00377-z.html
   My bibliography  Save this article

Understanding the Stochastic Partial Differential Equation Approach to Smoothing

Author

Listed:
  • David L. Miller

    (University of St Andrews)

  • Richard Glennie

    (University of St Andrews)

  • Andrew E. Seaton

    (University of St Andrews)

Abstract

Correlation and smoothness are terms used to describe a wide variety of random quantities. In time, space, and many other domains, they both imply the same idea: quantities that occur closer together are more similar than those further apart. Two popular statistical models that represent this idea are basis-penalty smoothers (Wood in Texts in statistical science, CRC Press, Boca Raton, 2017) and stochastic partial differential equations (SPDEs) (Lindgren et al. in J R Stat Soc Series B (Stat Methodol) 73(4):423–498, 2011). In this paper, we discuss how the SPDE can be interpreted as a smoothing penalty and can be fitted using the R package mgcv, allowing practitioners with existing knowledge of smoothing penalties to better understand the implementation and theory behind the SPDE approach. Supplementary materials accompanying this paper appear online.

Suggested Citation

  • David L. Miller & Richard Glennie & Andrew E. Seaton, 2020. "Understanding the Stochastic Partial Differential Equation Approach to Smoothing," Journal of Agricultural, Biological and Environmental Statistics, Springer;The International Biometric Society;American Statistical Association, vol. 25(1), pages 1-16, March.
  • Handle: RePEc:spr:jagbes:v:25:y:2020:i:1:d:10.1007_s13253-019-00377-z
    DOI: 10.1007/s13253-019-00377-z
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s13253-019-00377-z
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s13253-019-00377-z?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Kristensen, Kasper & Nielsen, Anders & Berg, Casper W. & Skaug, Hans & Bell, Bradley M., 2016. "TMB: Automatic Differentiation and Laplace Approximation," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 70(i05).
    2. Wenceslao González‐Manteiga & Rosa M. Crujeiras & Daniel Simpson & Finn Lindgren & Håvard Rue, 2012. "In order to make spatial statistics computationally feasible, we need to forget about the covariance function," Environmetrics, John Wiley & Sons, Ltd., vol. 23(1), pages 65-74, February.
    3. D. Simpson & J. B. Illian & F. Lindgren & S. H. Sørbye & H. Rue, 2016. "Going off grid: computationally efficient inference for log-Gaussian Cox processes," Biometrika, Biometrika Trust, vol. 103(1), pages 49-70.
    4. Carpenter, Bob & Gelman, Andrew & Hoffman, Matthew D. & Lee, Daniel & Goodrich, Ben & Betancourt, Michael & Brubaker, Marcus & Guo, Jiqiang & Li, Peter & Riddell, Allen, 2017. "Stan: A Probabilistic Programming Language," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 76(i01).
    5. Ludwig Fahrmeir & Stefan Lang, 2001. "Bayesian inference for generalized additive mixed models based on Markov random field priors," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 50(2), pages 201-220.
    6. Simon N. Wood, 2003. "Thin plate regression splines," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 65(1), pages 95-114, February.
    7. Bates, Douglas & Mächler, Martin & Bolker, Ben & Walker, Steve, 2015. "Fitting Linear Mixed-Effects Models Using lme4," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 67(i01).
    8. Simon N. Wood, 2011. "Fast stable restricted maximum likelihood and marginal likelihood estimation of semiparametric generalized linear models," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 73(1), pages 3-36, January.
    9. Zhang, Hao, 2004. "Inconsistent Estimation and Asymptotically Equal Interpolations in Model-Based Geostatistics," Journal of the American Statistical Association, American Statistical Association, vol. 99, pages 250-261, January.
    10. Håvard Rue & Sara Martino & Nicolas Chopin, 2009. "Approximate Bayesian inference for latent Gaussian models by using integrated nested Laplace approximations," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 71(2), pages 319-392, April.
    11. Finn Lindgren & Håvard Rue, 2008. "On the Second‐Order Random Walk Model for Irregular Locations," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 35(4), pages 691-700, December.
    12. Simon N. Wood & Zheyuan Li & Gavin Shaddick & Nicole H. Augustin, 2017. "Generalized Additive Models for Gigadata: Modeling the U.K. Black Smoke Network Daily Data," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 112(519), pages 1199-1210, July.
    13. Finn Lindgren & Håvard Rue & Johan Lindström, 2011. "An explicit link between Gaussian fields and Gaussian Markov random fields: the stochastic partial differential equation approach," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 73(4), pages 423-498, September.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Aaron Osgood‐Zimmerman & Jon Wakefield, 2023. "A Statistical Review of Template Model Builder: A Flexible Tool for Spatial Modelling," International Statistical Review, International Statistical Institute, vol. 91(2), pages 318-342, August.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Simon N. Wood, 2020. "Inference and computation with generalized additive models and their extensions," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 29(2), pages 307-339, June.
    2. Aaron Osgood‐Zimmerman & Jon Wakefield, 2023. "A Statistical Review of Template Model Builder: A Flexible Tool for Spatial Modelling," International Statistical Review, International Statistical Institute, vol. 91(2), pages 318-342, August.
    3. Øystein Sørensen & Anders M. Fjell & Kristine B. Walhovd, 2023. "Longitudinal Modeling of Age-Dependent Latent Traits with Generalized Additive Latent and Mixed Models," Psychometrika, Springer;The Psychometric Society, vol. 88(2), pages 456-486, June.
    4. Williamson, Laura D. & Scott, Beth E. & Laxton, Megan & Illian, Janine B. & Todd, Victoria L.G. & Miller, Peter I. & Brookes, Kate L., 2022. "Comparing distribution of harbour porpoise using generalized additive models and hierarchical Bayesian models with integrated nested laplace approximation," Ecological Modelling, Elsevier, vol. 470(C).
    5. Yuan Yan & Eva Cantoni & Chris Field & Margaret Treble & Joanna Mills Flemming, 2023. "Spatiotemporal modeling of mature‐at‐length data using a sliding window approach," Environmetrics, John Wiley & Sons, Ltd., vol. 34(2), March.
    6. Jacqueline D. Seufert & Andre Python & Christoph Weisser & Elías Cisneros & Krisztina Kis‐Katos & Thomas Kneib, 2022. "Mapping ex ante risks of COVID‐19 in Indonesia using a Bayesian geostatistical model on airport network data," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 185(4), pages 2121-2155, October.
    7. Birgit Schrödle & Leonhard Held, 2011. "A primer on disease mapping and ecological regression using $${\texttt{INLA}}$$," Computational Statistics, Springer, vol. 26(2), pages 241-258, June.
    8. Gressani, Oswaldo & Lambert, Philippe, 2021. "Laplace approximations for fast Bayesian inference in generalized additive models based on P-splines," Computational Statistics & Data Analysis, Elsevier, vol. 154(C).
    9. Matthew J. Heaton & Abhirup Datta & Andrew O. Finley & Reinhard Furrer & Joseph Guinness & Rajarshi Guhaniyogi & Florian Gerber & Robert B. Gramacy & Dorit Hammerling & Matthias Katzfuss & Finn Lindgr, 2019. "A Case Study Competition Among Methods for Analyzing Large Spatial Data," Journal of Agricultural, Biological and Environmental Statistics, Springer;The International Biometric Society;American Statistical Association, vol. 24(3), pages 398-425, September.
    10. John M. Humphreys & Robert B. Srygley & David H. Branson, 2022. "Geographic Variation in Migratory Grasshopper Recruitment under Projected Climate Change," Geographies, MDPI, vol. 2(1), pages 1-19, January.
    11. Unn Dahlén & Johan Lindström & Marko Scholze, 2020. "Spatiotemporal reconstructions of global CO2‐fluxes using Gaussian Markov random fields," Environmetrics, John Wiley & Sons, Ltd., vol. 31(4), June.
    12. Fernanda Valente & Márcio Laurini, 2020. "Tornado Occurrences in the United States: A Spatio-Temporal Point Process Approach," Econometrics, MDPI, vol. 8(2), pages 1-26, June.
    13. Simon N. Wood & Zheyuan Li & Gavin Shaddick & Nicole H. Augustin, 2017. "Generalized Additive Models for Gigadata: Modeling the U.K. Black Smoke Network Daily Data," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 112(519), pages 1199-1210, July.
    14. Stefan Lang & Nikolaus Umlauf & Peter Wechselberger & Kenneth Harttgen & Thomas Kneib, 2012. "Multilevel structured additive regression," Working Papers 2012-07, Faculty of Economics and Statistics, Universität Innsbruck.
    15. Giovanna Jona Lasinio & Gianluca Mastrantonio & Alessio Pollice, 2013. "Discussing the “big n problem”," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 22(1), pages 97-112, March.
    16. Gabriel Riutort-Mayol & Virgilio Gómez-Rubio & José Luis Lerma & Julio M. del Hoyo-Meléndez, 2020. "Correlated Functional Models with Derivative Information for Modeling Microfading Spectrometry Data on Rock Art Paintings," Mathematics, MDPI, vol. 8(12), pages 1-25, December.
    17. Carson, Stuart & Mills Flemming, Joanna, 2014. "Seal encounters at sea: A contemporary spatial approach using R-INLA," Ecological Modelling, Elsevier, vol. 291(C), pages 175-181.
    18. Umlauf, Nikolaus & Adler, Daniel & Kneib, Thomas & Lang, Stefan & Zeileis, Achim, 2015. "Structured Additive Regression Models: An R Interface to BayesX," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 63(i21).
    19. Laura Serra & Claudio Detotto & Marco Vannini, 2022. "Public lands as a mitigator of wildfire burned area using a spatio-temporal model applied in Sardinia," Letters in Spatial and Resource Sciences, Springer, vol. 15(3), pages 621-635, December.
    20. Janine B. Illian & David F. R. P. Burslem, 2017. "Improving the usability of spatial point process methodology: an interdisciplinary dialogue between statistics and ecology," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 101(4), pages 495-520, October.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:jagbes:v:25:y:2020:i:1:d:10.1007_s13253-019-00377-z. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.