IDEAS home Printed from https://ideas.repec.org/a/spr/annopr/v248y2017i1d10.1007_s10479-016-2181-9.html
   My bibliography  Save this article

A mixed integer linear program to compress transition probability matrices in Markov chain bootstrapping

Author

Listed:
  • Roy Cerqueti

    (Università degli Studi di Macerata)

  • Paolo Falbo

    (Università degli Studi di Brescia)

  • Cristian Pelizzari

    (Università degli Studi di Brescia)

  • Federica Ricca

    (Sapienza Università di Roma)

  • Andrea Scozzari

    (Università degli Studi Niccolò Cusano - Telematica Roma)

Abstract

Bootstrapping time series is one of the most acknowledged tools to study the statistical properties of an evolutive phenomenon. An important class of bootstrapping methods is based on the assumption that the sampled phenomenon evolves according to a Markov chain. This assumption does not apply when the process takes values in a continuous set, as it frequently happens with time series related to economic and financial phenomena. In this paper we apply the Markov chain theory for bootstrapping continuous-valued processes, starting from a suitable discretization of the support that provides the state space of a Markov chain of order $$k \ge 1$$ k ≥ 1 . Even for small k, the number of rows of the transition probability matrix is generally too large and, in many practical cases, it may incorporate much more information than it is really required to replicate the phenomenon satisfactorily. The paper aims to study the problem of compressing the transition probability matrix while preserving the “law” characterising the process that generates the observed time series, in order to obtain bootstrapped series that maintain the typical features of the observed time series. For this purpose, we formulate a partitioning problem of the set of rows of such a matrix and propose a mixed integer linear program specifically tailored for this particular problem. We also provide an empirical analysis by applying our model to the time series of Spanish and German electricity prices, and we show that, in these medium size real-life instances, bootstrapped time series reproduce the typical features of the ones under observation.

Suggested Citation

  • Roy Cerqueti & Paolo Falbo & Cristian Pelizzari & Federica Ricca & Andrea Scozzari, 2017. "A mixed integer linear program to compress transition probability matrices in Markov chain bootstrapping," Annals of Operations Research, Springer, vol. 248(1), pages 163-187, January.
  • Handle: RePEc:spr:annopr:v:248:y:2017:i:1:d:10.1007_s10479-016-2181-9
    DOI: 10.1007/s10479-016-2181-9
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s10479-016-2181-9
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s10479-016-2181-9?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Stanislav Anatolyev & Andrey Vasnev, 2002. "Markov chain approximation in bootstrapping autoregressions," Economics Bulletin, AccessEcon, vol. 3(19), pages 1-8.
    2. Weron, R & Bierbrauer, M & Trück, S, 2004. "Modeling electricity prices: jump diffusion and regime switching," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 336(1), pages 39-48.
    3. Cerqueti, Roy & Falbo, Paolo & Guastaroba, Gianfranco & Pelizzari, Cristian, 2013. "A Tabu Search heuristic procedure in Markov chain bootstrapping," European Journal of Operational Research, Elsevier, vol. 227(2), pages 367-384.
    4. Hamilton, James D., 1996. "Specification testing in Markov-switching time-series models," Journal of Econometrics, Elsevier, vol. 70(1), pages 127-157, January.
    5. Brock, William & Lakonishok, Josef & LeBaron, Blake, 1992. "Simple Technical Trading Rules and the Stochastic Properties of Stock Returns," Journal of Finance, American Finance Association, vol. 47(5), pages 1731-1764, December.
    6. Ryan Sullivan & Allan Timmermann & Halbert White, 1999. "Data‐Snooping, Technical Trading Rule Performance, and the Bootstrap," Journal of Finance, American Finance Association, vol. 54(5), pages 1647-1691, October.
    7. Cerqueti, Roy & Falbo, Paolo & Pelizzari, Cristian, 2017. "Relevant states and memory in Markov chain bootstrapping and simulation," European Journal of Operational Research, Elsevier, vol. 256(1), pages 163-177.
    8. Huisman, Ronald & Mahieu, Ronald, 2003. "Regime jumps in electricity prices," Energy Economics, Elsevier, vol. 25(5), pages 425-434, September.
    9. Rafal Weron, 2006. "Modeling and Forecasting Electricity Loads and Prices: A Statistical Approach," HSC Books, Hugo Steinhaus Center, Wroclaw University of Science and Technology, number hsbook0601, December.
    10. Jeanne, Olivier & Masson, Paul, 2000. "Currency crises, sunspots and Markov-switching regimes," Journal of International Economics, Elsevier, vol. 50(2), pages 327-350, April.
    11. Saglam, Burcu & Salman, F. Sibel & Sayin, Serpil & Turkay, Metin, 2006. "A mixed-integer programming approach to the clustering problem with an application in customer segmentation," European Journal of Operational Research, Elsevier, vol. 173(3), pages 866-879, September.
    12. repec:ebl:ecbull:v:3:y:2002:i:19:p:1-8 is not listed on IDEAS
    13. D. R. Barr & M. U. Thomas, 1977. "Technical Note—An Eigenvector Condition for Markov Chain Lumpability," Operations Research, INFORMS, vol. 25(6), pages 1028-1031, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Cerqueti, Roy & Falbo, Paolo & Guastaroba, Gianfranco & Pelizzari, Cristian, 2013. "A Tabu Search heuristic procedure in Markov chain bootstrapping," European Journal of Operational Research, Elsevier, vol. 227(2), pages 367-384.
    2. Cerqueti, Roy & Falbo, Paolo & Pelizzari, Cristian, 2017. "Relevant states and memory in Markov chain bootstrapping and simulation," European Journal of Operational Research, Elsevier, vol. 256(1), pages 163-177.
    3. Joanna Janczura & Rafal Weron, 2012. "Inference for Markov-regime switching models of electricity spot prices," HSC Research Reports HSC/12/01, Hugo Steinhaus Center, Wroclaw University of Science and Technology.
    4. Mari, Carlo & Tondini, Daniela, 2010. "Regime switches induced by supply–demand equilibrium: a model for power-price dynamics," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 389(21), pages 4819-4827.
    5. Karakatsani, Nektaria V. & Bunn, Derek W., 2008. "Intra-day and regime-switching dynamics in electricity price formation," Energy Economics, Elsevier, vol. 30(4), pages 1776-1797, July.
    6. Pawel Maryniak & Stefan Trueck & Rafal Weron, 2016. "Carbon pricing, forward risk premiums and pass-through rates in Australian electricity futures markets," HSC Research Reports HSC/16/10, Hugo Steinhaus Center, Wroclaw University of Science and Technology.
    7. Margherita Velucchi, 2009. "Regime switching: Italian financial markets over a century," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 18(1), pages 67-86, March.
    8. Eichler, M. & Türk, D.D.T., 2012. "Fitting semiparametric Markov regime-switching models to electricity spot prices," Research Memorandum 035, Maastricht University, Maastricht Research School of Economics of Technology and Organization (METEOR).
    9. Stephen Machin & Olivier Marie & Sunčica Vujić, 2012. "Youth Crime and Education Expansion," German Economic Review, Verein für Socialpolitik, vol. 13(4), pages 366-384, November.
    10. Pape, Christian & Hagemann, Simon & Weber, Christoph, 2016. "Are fundamentals enough? Explaining price variations in the German day-ahead and intraday power market," Energy Economics, Elsevier, vol. 54(C), pages 376-387.
    11. Janczura, Joanna & Trück, Stefan & Weron, Rafał & Wolff, Rodney C., 2013. "Identifying spikes and seasonal components in electricity spot price data: A guide to robust modeling," Energy Economics, Elsevier, vol. 38(C), pages 96-110.
    12. Mayer, Klaus & Trück, Stefan, 2018. "Electricity markets around the world," Journal of Commodity Markets, Elsevier, vol. 9(C), pages 77-100.
    13. Janczura, Joanna & Weron, Rafal, 2010. "An empirical comparison of alternate regime-switching models for electricity spot prices," Energy Economics, Elsevier, vol. 32(5), pages 1059-1073, September.
    14. Sapio, Alessandro & Spagnolo, Nicola, 2016. "Price regimes in an energy island: Tacit collusion vs. cost and network explanations," Energy Economics, Elsevier, vol. 55(C), pages 157-172.
    15. Misiorek Adam & Trueck Stefan & Weron Rafal, 2006. "Point and Interval Forecasting of Spot Electricity Prices: Linear vs. Non-Linear Time Series Models," Studies in Nonlinear Dynamics & Econometrics, De Gruyter, vol. 10(3), pages 1-36, September.
    16. Eichler, M. & Türk, D., 2013. "Fitting semiparametric Markov regime-switching models to electricity spot prices," Energy Economics, Elsevier, vol. 36(C), pages 614-624.
    17. Sandro Sapio, 2012. "Modeling the distribution of day-ahead electricity returns: a comparison," Quantitative Finance, Taylor & Francis Journals, vol. 12(12), pages 1935-1949, December.
    18. Gianfreda, Angelica & Grossi, Luigi, 2012. "Forecasting Italian electricity zonal prices with exogenous variables," Energy Economics, Elsevier, vol. 34(6), pages 2228-2239.
    19. Mari, Carlo & Cananà, Lucianna, 2012. "Markov switching of the electricity supply curve and power prices dynamics," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 391(4), pages 1481-1488.
    20. Christensen, T.M. & Hurn, A.S. & Lindsay, K.A., 2012. "Forecasting spikes in electricity prices," International Journal of Forecasting, Elsevier, vol. 28(2), pages 400-411.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:annopr:v:248:y:2017:i:1:d:10.1007_s10479-016-2181-9. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.