IDEAS home Printed from https://ideas.repec.org/a/spr/sistpr/v16y2013i1p63-80.html
   My bibliography  Save this article

Exact and approximate EM estimation of mutually exciting hawkes processes

Author

Listed:
  • Jamie Olson
  • Kathleen Carley

Abstract

Motivated by the availability of continuous event sequences that trace the social behavior in a population e.g. email, we believe that mutually exciting Hawkes processes provide a realistic and informative model for these sequences. For complex mutually exciting processes, the numerical optimization used for univariate self exciting processes may not provide stable estimates. Furthermore, convergence can be exceedingly slow, making estimation computationally expensive and multiple random restarts doubly so. We derive an expectation maximization algorithm for maximum likelihood estimation mutually exciting processes that is faster, more robust, and less biased than estimation based on numerical optimization. For an exponentially decaying excitement function, each EM step can be computed in a single $$O(N)$$ pass through the data, for $$N$$ observations, without requiring the entire dataset to be in memory. More generally, exact inference is $$\Theta (N^{2})$$ , but we identify some simple $$\Theta (N)$$ approximation strategies that seem to provide good estimates while reducing the computational cost. Copyright Springer Science+Business Media Dordrecht 2013

Suggested Citation

  • Jamie Olson & Kathleen Carley, 2013. "Exact and approximate EM estimation of mutually exciting hawkes processes," Statistical Inference for Stochastic Processes, Springer, vol. 16(1), pages 63-80, April.
  • Handle: RePEc:spr:sistpr:v:16:y:2013:i:1:p:63-80
    DOI: 10.1007/s11203-013-9074-1
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1007/s11203-013-9074-1
    Download Restriction: Access to full text is restricted to subscribers.

    File URL: https://libkey.io/10.1007/s11203-013-9074-1?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Johansen, Anders & Sornette, Didier, 2000. "Download relaxation dynamics on the WWW following newspaper publication of URL," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 276(1), pages 338-345.
    2. Yosihiko Ogata, 1998. "Space-Time Point-Process Models for Earthquake Occurrences," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 50(2), pages 379-402, June.
    3. Hoff P.D. & Raftery A.E. & Handcock M.S., 2002. "Latent Space Approaches to Social Network Analysis," Journal of the American Statistical Association, American Statistical Association, vol. 97, pages 1090-1098, December.
    4. Large, Jeremy, 2007. "Measuring the resiliency of an electronic limit order book," Journal of Financial Markets, Elsevier, vol. 10(1), pages 1-25, February.
    5. Krivitsky, Pavel N. & Handcock, Mark S., 2008. "Fitting Latent Cluster Models for Networks with latentnet," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 24(i05).
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Santitissadeekorn, Naratip & Lloyd, David J.B. & Short, Martin B. & Delahaies, Sylvain, 2020. "Approximate filtering of conditional intensity process for Poisson count data: Application to urban crime," Computational Statistics & Data Analysis, Elsevier, vol. 144(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Cristiano Varin & Manuela Cattelan & David Firth, 2016. "Statistical modelling of citation exchange between statistics journals," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 179(1), pages 1-63, January.
    2. Steffen Volkenand & Günther Filler & Martin Odening, 2020. "Price Discovery and Market Reflexivity in Agricultural Futures Contracts with Different Maturities," Risks, MDPI, vol. 8(3), pages 1-17, July.
    3. Chiara Di Maria & Antonino Abbruzzo & Gianfranco Lovison, 2022. "Networks as mediating variables: a Bayesian latent space approach," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 31(4), pages 1015-1035, October.
    4. Salter-Townshend, Michael & Murphy, Thomas Brendan, 2013. "Variational Bayesian inference for the Latent Position Cluster Model for network data," Computational Statistics & Data Analysis, Elsevier, vol. 57(1), pages 661-671.
    5. Sosa, Juan & Betancourt, Brenda, 2022. "A latent space model for multilayer network data," Computational Statistics & Data Analysis, Elsevier, vol. 169(C).
    6. Joshua Daniel Loyal & Yuguo Chen, 2020. "Statistical Network Analysis: A Review with Applications to the Coronavirus Disease 2019 Pandemic," International Statistical Review, International Statistical Institute, vol. 88(2), pages 419-440, August.
    7. Maxime Morariu-Patrichi & Mikko S. Pakkanen, 2017. "Hybrid marked point processes: characterisation, existence and uniqueness," Papers 1707.06970, arXiv.org, revised Oct 2018.
    8. Ian E. Fellows & Mark S. Handcock, 2023. "Modeling of networked populations when data is sampled or missing," METRON, Springer;Sapienza Università di Roma, vol. 81(1), pages 21-35, April.
    9. Samrachana Adhikari & Beau Dabbs, 2018. "Social Network Analysis in R: A Software Review," Journal of Educational and Behavioral Statistics, , vol. 43(2), pages 225-253, April.
    10. Large, Jeremy, 2011. "Estimating quadratic variation when quoted prices change by a constant increment," Journal of Econometrics, Elsevier, vol. 160(1), pages 2-11, January.
    11. Ioane Muni Toke & Nakahiro Yoshida, 2020. "Marked point processes and intensity ratios for limit order book modeling," Papers 2001.08442, arXiv.org.
    12. Anatoliy Swishchuk & Aiden Huffman, 2020. "General Compound Hawkes Processes in Limit Order Books," Risks, MDPI, vol. 8(1), pages 1-25, March.
    13. Dewei Wang & Chendi Jiang & Chanseok Park, 2019. "Reliability analysis of load-sharing systems with memory," Lifetime Data Analysis: An International Journal Devoted to Statistical Methods and Applications for Time-to-Event Data, Springer, vol. 25(2), pages 341-360, April.
    14. Samrachana Adhikari & Tracy Sweet & Brian Junker, 2021. "Analysis of longitudinal advice‐seeking networks following implementation of high stakes testing," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 184(4), pages 1475-1500, October.
    15. Chung, Jaewon & Bridgeford, Eric & Arroyo, Jesus & Pedigo, Benjamin D. & Saad-Eldin, Ali & Gopalakrishnan, Vivek & Xiang, Liang & Priebe, Carey E. & Vogelstein, Joshua T., 2020. "Statistical Connectomics," OSF Preprints ek4n3, Center for Open Science.
    16. Thibault Jaisson, 2014. "Market impact as anticipation of the order flow imbalance," Papers 1402.1288, arXiv.org.
    17. Falk Bräuning & Siem Jan Koopman, 2016. "The dynamic factor network model with an application to global credit risk," Working Papers 16-13, Federal Reserve Bank of Boston.
    18. Chih‐Sheng Hsieh & Lung‐Fei Lee & Vincent Boucher, 2020. "Specification and estimation of network formation and network interaction models with the exponential probability distribution," Quantitative Economics, Econometric Society, vol. 11(4), pages 1349-1390, November.
    19. Lee, Kyungsub & Seo, Byoung Ki, 2017. "Marked Hawkes process modeling of price dynamics and volatility estimation," Journal of Empirical Finance, Elsevier, vol. 40(C), pages 174-200.
    20. van den Hengel, G. & Franses, Ph.H.B.F., 2018. "Forecasting social conflicts in Africa using an Epidemic Type Aftershock Sequence model," Econometric Institute Research Papers EI2018-31, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:sistpr:v:16:y:2013:i:1:p:63-80. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.