IDEAS home Printed from https://ideas.repec.org/p/msh/ebswps/2023-10.html
   My bibliography  Save this paper

Conditional Normalization in Time Series Analysis

Author

Listed:
  • Puwasala Gamakumara
  • Edgar Santos-Fernandez
  • Priyanga Dilini Talagala
  • Rob J Hyndman
  • Kerrie Mengersen
  • Catherine Leigh

Abstract

Time series often reflect variation associated with other related variables. Controlling for the effect of these variables is useful when modeling or analysing the time series. We introduce a novel approach to normalize time series data conditional on a set of covariates. We do this by modeling the conditional mean and the conditional variance of the time series with generalized additive models using a set of covariates. The conditional mean and variance are then used to normalize the time series. We illustrate the use of conditionally normalized series using two applications involving river network data. First, we show how these normalized time series can be used to impute missing values in the data. Second, we show how the normalized series can be used to estimate the conditional autocorrelation function and conditional cross-correlation functions via additive models. Finally we use the conditional cross-correlations to estimate the time it takes water to flow between two locations in a river network.

Suggested Citation

  • Puwasala Gamakumara & Edgar Santos-Fernandez & Priyanga Dilini Talagala & Rob J Hyndman & Kerrie Mengersen & Catherine Leigh, 2023. "Conditional Normalization in Time Series Analysis," Monash Econometrics and Business Statistics Working Papers 10/23, Monash University, Department of Econometrics and Business Statistics.
  • Handle: RePEc:msh:ebswps:2023-10
    as

    Download full text from publisher

    File URL: https://www.monash.edu/business/ebs/research/publications/ebs/2023/wp10-2023.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Guillaume Bal & Etienne Rivot & Jean-Luc Baglinière & Jonathan White & Etienne Prévost, 2014. "A Hierarchical Bayesian Model to Quantify Uncertainty of Stream Water Temperature Forecasts," PLOS ONE, Public Library of Science, vol. 9(12), pages 1-24, December.
    2. Catherine Leigh & Sevvandi Kandanaarachchi & James M McGree & Rob J Hyndman & Omar Alsibai & Kerrie Mengersen & Erin E Peterson, 2019. "Predicting sediment and nutrient concentrations from high-frequency water-quality data," PLOS ONE, Public Library of Science, vol. 14(8), pages 1-22, August.
    3. Hyndman, Rob J. & Khandakar, Yeasmin, 2008. "Automatic Time Series Forecasting: The forecast Package for R," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 27(i03).
    4. Simon N. Wood, 2003. "Thin plate regression splines," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 65(1), pages 95-114, February.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Lingbing Feng & Yanlin Shi, 2018. "Forecasting mortality rates: multivariate or univariate models?," Journal of Population Research, Springer, vol. 35(3), pages 289-318, September.
    2. Santos-Fernandez, Edgar & Ver Hoef, Jay M. & Peterson, Erin E. & McGree, James & Isaak, Daniel J. & Mengersen, Kerrie, 2022. "Bayesian spatio-temporal models for stream networks," Computational Statistics & Data Analysis, Elsevier, vol. 170(C).
    3. Amara-Ouali, Yvenn & Fasiolo, Matteo & Goude, Yannig & Yan, Hui, 2023. "Daily peak electrical load forecasting with a multi-resolution approach," International Journal of Forecasting, Elsevier, vol. 39(3), pages 1272-1286.
    4. Daniel R. Kowal & David S. Matteson & David Ruppert, 2019. "Functional Autoregression for Sparsely Sampled Data," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 37(1), pages 97-109, January.
    5. M.L. Nores & M.P. Díaz, 2016. "Bootstrap hypothesis testing in generalized additive models for comparing curves of treatments in longitudinal studies," Journal of Applied Statistics, Taylor & Francis Journals, vol. 43(5), pages 810-826, April.
    6. Gkillas, Konstantinos & Gupta, Rangan & Pierdzioch, Christian, 2020. "Forecasting realized oil-price volatility: The role of financial stress and asymmetric loss," Journal of International Money and Finance, Elsevier, vol. 104(C).
    7. Nahapetyan Yervand, 2019. "The benefits of the Velvet Revolution in Armenia: Estimation of the short-term economic gains using deep neural networks," Central European Economic Journal, Sciendo, vol. 6(53), pages 286-303, January.
    8. Dombi, József & Jónás, Tamás & Tóth, Zsuzsanna Eszter, 2018. "Modeling and long-term forecasting demand in spare parts logistics businesses," International Journal of Production Economics, Elsevier, vol. 201(C), pages 1-17.
    9. Amita Gajewar & Gagan Bansal, 2016. "Revenue Forecasting for Enterprise Products," Papers 1701.06624, arXiv.org.
    10. Tao XIONG & Chongguang LI & Yukun BAO, 2017. "An improved EEMD-based hybrid approach for the short-term forecasting of hog price in China," Agricultural Economics, Czech Academy of Agricultural Sciences, vol. 63(3), pages 136-148.
    11. Pieter van der Spek & Chris Verhoef, 2014. "Balancing Time‐to‐Market and Quality in Embedded Systems," Systems Engineering, John Wiley & Sons, vol. 17(2), pages 166-192, June.
    12. Hyndman, Rob J. & Ahmed, Roman A. & Athanasopoulos, George & Shang, Han Lin, 2011. "Optimal combination forecasts for hierarchical time series," Computational Statistics & Data Analysis, Elsevier, vol. 55(9), pages 2579-2589, September.
    13. Kourentzes, Nikolaos & Petropoulos, Fotios & Trapero, Juan R., 2014. "Improving forecasting by estimating time series structural components across multiple frequencies," International Journal of Forecasting, Elsevier, vol. 30(2), pages 291-302.
    14. Iñaki Galán & Lorena Simón & Elena Boldo & Cristina Ortiz & Rafael Fernández-Cuenca & Cristina Linares & María José Medrano & Roberto Pastor-Barriuso, 2017. "Changes in hospitalizations for chronic respiratory diseases after two successive smoking bans in Spain," PLOS ONE, Public Library of Science, vol. 12(5), pages 1-14, May.
    15. Tendai Makoni & Delson Chikobvu, 2023. "Assessing and Forecasting the Long-Term Impact of the Global Financial Crisis on Manufacturing Sales in South Africa," Economies, MDPI, vol. 11(6), pages 1-17, May.
    16. Fijorek Kamil & Leśniewska Agnieszka, 2012. "Statistical Forecasting of the Indicators of Polish Airport’s Operations," Folia Oeconomica Stetinensia, Sciendo, vol. 11(1), pages 7-7, January.
    17. Alysha M De Livera, 2010. "Automatic forecasting with a modified exponential smoothing state space framework," Monash Econometrics and Business Statistics Working Papers 10/10, Monash University, Department of Econometrics and Business Statistics.
    18. Spiliotis, Evangelos & Makridakis, Spyros & Kaltsounis, Anastasios & Assimakopoulos, Vassilios, 2021. "Product sales probabilistic forecasting: An empirical evaluation using the M5 competition data," International Journal of Production Economics, Elsevier, vol. 240(C).
    19. Miroslav Navratil & Andrea Kolkova, 2019. "Decomposition and Forecasting Time Series in the Business Economy Using Prophet Forecasting Model," Central European Business Review, Prague University of Economics and Business, vol. 2019(4), pages 26-39.
    20. G'abor Petneh'azi & J'ozsef G'all, 2019. "Mortality rate forecasting: can recurrent neural networks beat the Lee-Carter model?," Papers 1909.05501, arXiv.org, revised Oct 2019.

    More about this item

    Keywords

    conditional normalization; missing value imputation; conditional autocorrelation; conditional cross-correlation; lag time estimation; stream data; water quality;
    All these keywords.

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:msh:ebswps:2023-10. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Professor Xibin Zhang (email available below). General contact details of provider: https://edirc.repec.org/data/dxmonau.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.