IDEAS home Printed from https://ideas.repec.org/a/spr/sistpr/v16y2013i1p63-80.html
   My bibliography  Save this article

Exact and approximate EM estimation of mutually exciting hawkes processes

Author

Listed:
  • Jamie Olson
  • Kathleen Carley

Abstract

Motivated by the availability of continuous event sequences that trace the social behavior in a population e.g. email, we believe that mutually exciting Hawkes processes provide a realistic and informative model for these sequences. For complex mutually exciting processes, the numerical optimization used for univariate self exciting processes may not provide stable estimates. Furthermore, convergence can be exceedingly slow, making estimation computationally expensive and multiple random restarts doubly so. We derive an expectation maximization algorithm for maximum likelihood estimation mutually exciting processes that is faster, more robust, and less biased than estimation based on numerical optimization. For an exponentially decaying excitement function, each EM step can be computed in a single $$O(N)$$ pass through the data, for $$N$$ observations, without requiring the entire dataset to be in memory. More generally, exact inference is $$\Theta (N^{2})$$ , but we identify some simple $$\Theta (N)$$ approximation strategies that seem to provide good estimates while reducing the computational cost. Copyright Springer Science+Business Media Dordrecht 2013

Suggested Citation

  • Jamie Olson & Kathleen Carley, 2013. "Exact and approximate EM estimation of mutually exciting hawkes processes," Statistical Inference for Stochastic Processes, Springer, vol. 16(1), pages 63-80, April.
  • Handle: RePEc:spr:sistpr:v:16:y:2013:i:1:p:63-80
    DOI: 10.1007/s11203-013-9074-1
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1007/s11203-013-9074-1
    Download Restriction: Access to full text is restricted to subscribers.

    File URL: https://libkey.io/10.1007/s11203-013-9074-1?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Yosihiko Ogata, 1998. "Space-Time Point-Process Models for Earthquake Occurrences," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 50(2), pages 379-402, June.
    2. Hoff P.D. & Raftery A.E. & Handcock M.S., 2002. "Latent Space Approaches to Social Network Analysis," Journal of the American Statistical Association, American Statistical Association, vol. 97, pages 1090-1098, December.
    3. Krivitsky, Pavel N. & Handcock, Mark S., 2008. "Fitting Latent Cluster Models for Networks with latentnet," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 24(i05).
    4. Johansen, Anders & Sornette, Didier, 2000. "Download relaxation dynamics on the WWW following newspaper publication of URL," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 276(1), pages 338-345.
    5. Large, Jeremy, 2007. "Measuring the resiliency of an electronic limit order book," Journal of Financial Markets, Elsevier, vol. 10(1), pages 1-25, February.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Santitissadeekorn, Naratip & Lloyd, David J.B. & Short, Martin B. & Delahaies, Sylvain, 2020. "Approximate filtering of conditional intensity process for Poisson count data: Application to urban crime," Computational Statistics & Data Analysis, Elsevier, vol. 144(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Steffen Volkenand & Günther Filler & Martin Odening, 2020. "Price Discovery and Market Reflexivity in Agricultural Futures Contracts with Different Maturities," Risks, MDPI, vol. 8(3), pages 1-17, July.
    2. Chiara Di Maria & Antonino Abbruzzo & Gianfranco Lovison, 2022. "Networks as mediating variables: a Bayesian latent space approach," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 31(4), pages 1015-1035, October.
    3. Cristiano Varin & Manuela Cattelan & David Firth, 2016. "Statistical modelling of citation exchange between statistics journals," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 179(1), pages 1-63, January.
    4. Salter-Townshend, Michael & Murphy, Thomas Brendan, 2013. "Variational Bayesian inference for the Latent Position Cluster Model for network data," Computational Statistics & Data Analysis, Elsevier, vol. 57(1), pages 661-671.
    5. Sosa, Juan & Betancourt, Brenda, 2022. "A latent space model for multilayer network data," Computational Statistics & Data Analysis, Elsevier, vol. 169(C).
    6. Joshua Daniel Loyal & Yuguo Chen, 2020. "Statistical Network Analysis: A Review with Applications to the Coronavirus Disease 2019 Pandemic," International Statistical Review, International Statistical Institute, vol. 88(2), pages 419-440, August.
    7. Maxime Morariu-Patrichi & Mikko S. Pakkanen, 2017. "Hybrid marked point processes: characterisation, existence and uniqueness," Papers 1707.06970, arXiv.org, revised Oct 2018.
    8. D. Gospodinov & V. Karakostas & E. Papadimitriou, 2015. "Seismicity rate modeling for prospective stochastic forecasting: the case of 2014 Kefalonia, Greece, seismic excitation," Natural Hazards: Journal of the International Society for the Prevention and Mitigation of Natural Hazards, Springer;International Society for the Prevention and Mitigation of Natural Hazards, vol. 79(2), pages 1039-1058, November.
    9. Laleh Tafakori & Armin Pourkhanali & Riccardo Rastelli, 2022. "Measuring systemic risk and contagion in the European financial network," Empirical Economics, Springer, vol. 63(1), pages 345-389, July.
    10. Schoeneborn, Torsten & Schied, Alexander, 2007. "Liquidation in the Face of Adversity: Stealth Vs. Sunshine Trading, Predatory Trading Vs. Liquidity Provision," MPRA Paper 5548, University Library of Munich, Germany.
    11. Mark S. Handcock & Adrian E. Raftery & Jeremy M. Tantrum, 2007. "Model‐based clustering for social networks," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 170(2), pages 301-354, March.
    12. Barbara Będowska-Sójka, 2021. "Is liquidity wasted? The zero-returns on the Warsaw Stock Exchange," Annals of Operations Research, Springer, vol. 297(1), pages 37-51, February.
    13. Ian E. Fellows & Mark S. Handcock, 2023. "Modeling of networked populations when data is sampled or missing," METRON, Springer;Sapienza Università di Roma, vol. 81(1), pages 21-35, April.
    14. Samrachana Adhikari & Beau Dabbs, 2018. "Social Network Analysis in R: A Software Review," Journal of Educational and Behavioral Statistics, , vol. 43(2), pages 225-253, April.
    15. Large, Jeremy, 2011. "Estimating quadratic variation when quoted prices change by a constant increment," Journal of Econometrics, Elsevier, vol. 160(1), pages 2-11, January.
    16. Kyungsub Lee, 2022. "Application of Hawkes volatility in the observation of filtered high-frequency price process in tick structures," Papers 2207.05939, arXiv.org, revised Sep 2024.
    17. Guang Ouyang & Dipak K. Dey & Panpan Zhang, 2020. "Clique-Based Method for Social Network Clustering," Journal of Classification, Springer;The Classification Society, vol. 37(1), pages 254-274, April.
    18. Huang, Lorick & Khabou, Mahmoud, 2023. "Nonlinear Poisson autoregression and nonlinear Hawkes processes," Stochastic Processes and their Applications, Elsevier, vol. 161(C), pages 201-241.
    19. Ioane Muni Toke & Nakahiro Yoshida, 2020. "Marked point processes and intensity ratios for limit order book modeling," Papers 2001.08442, arXiv.org.
    20. Thanne Mafaziya Nijamdeen & Jean Huge & Hajaniaina Ratsimbazafy & Kodikara Arachchilage Sunanda Kodikara & Farid Dahdouh-Guebas, 2022. "A social network analysis of mangrove management stakeholders in Sri Lanka's Northern Province," ULB Institutional Repository 2013/349602, ULB -- Universite Libre de Bruxelles.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:sistpr:v:16:y:2013:i:1:p:63-80. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.