IDEAS home Printed from https://ideas.repec.org/a/gam/jmathe/v12y2024i15p2396-d1447347.html
   My bibliography  Save this article

A Time-Series Feature-Extraction Methodology Based on Multiscale Overlapping Windows, Adaptive KDE, and Continuous Entropic and Information Functionals

Author

Listed:
  • Antonio Squicciarini

    (GI-TACA, Departamento de Matemática Aplicada a la Ingeniería Industrial, Escuela Técnica Superior de Ingenieros Industriales, Universidad Politécnica de Madrid, 28006 Madrid, Spain)

  • Elio Valero Toranzo

    (Departamento de Matemática Aplicada, Escuela Superior de Ciencias Experimentales y Tecnología, Universidad Rey Juan Carlos, 28933 Madrid, Spain)

  • Alejandro Zarzo

    (GI-TACA, Departamento de Matemática Aplicada a la Ingeniería Industrial, Escuela Técnica Superior de Ingenieros Industriales, Universidad Politécnica de Madrid, 28006 Madrid, Spain)

Abstract

We propose a new methodology to transform a time series into an ordered sequence of any entropic and information functionals, providing a novel tool for data analysis. To achieve this, a new algorithm has been designed to optimize the Probability Density Function (PDF) associated with a time signal in the context of non-parametric Kernel Density Estimation (KDE). We illustrate the applicability of this method for anomaly detection in time signals. Specifically, our approach combines a non-parametric kernel density estimator with overlapping windows of various scales. Regarding the parameters involved in the KDE, it is well-known that bandwidth tuning is crucial for the kernel density estimator. To optimize it for time-series data, we introduce an adaptive solution based on Jensen–Shannon divergence, which adjusts the bandwidth for each window length to balance overfitting and underfitting. This solution selects unique bandwidth parameters for each window scale. Furthermore, it is implemented offline, eliminating the need for online optimization for each time-series window. To validate our methodology, we designed a synthetic experiment using a non-stationary signal generated by the composition of two stationary signals and a modulation function that controls the transitions between a normal and an abnormal state, allowing for the arbitrary design of various anomaly transitions. Additionally, we tested the methodology on real scalp-EEG data to detect epileptic crises. The results show our approach effectively detects and characterizes anomaly transitions. The use of overlapping windows at various scales significantly enhances detection ability, allowing for the simultaneous analysis of phenomena at different scales.

Suggested Citation

  • Antonio Squicciarini & Elio Valero Toranzo & Alejandro Zarzo, 2024. "A Time-Series Feature-Extraction Methodology Based on Multiscale Overlapping Windows, Adaptive KDE, and Continuous Entropic and Information Functionals," Mathematics, MDPI, vol. 12(15), pages 1-21, July.
  • Handle: RePEc:gam:jmathe:v:12:y:2024:i:15:p:2396-:d:1447347
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2227-7390/12/15/2396/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/2227-7390/12/15/2396/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Harvey, Andrew & Oryshchenko, Vitaliy, 2012. "Kernel density estimation for time series data," International Journal of Forecasting, Elsevier, vol. 28(1), pages 3-14.
    2. Martin, M.T. & Plastino, A.R. & Plastino, A., 2000. "Tsallis-like information measures and the analysis of complex signals," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 275(1), pages 262-271.
    3. Matthieu Garcin, 2023. "Complexity measure, kernel density estimation, bandwidth selection, and the efficient market hypothesis," Papers 2305.13123, arXiv.org.
    4. Telesca, Luciano & Lovallo, Michele, 2017. "On the performance of Fisher Information Measure and Shannon entropy estimators," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 484(C), pages 569-576.
    5. Tsallis, Constantino & Mendes, RenioS. & Plastino, A.R., 1998. "The role of constraints within generalized nonextensive statistics," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 261(3), pages 534-554.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ayoub Ammy-Driss & Matthieu Garcin, 2021. "Efficiency of the financial markets during the COVID-19 crisis: time-varying parameters of fractional stable dynamics," Working Papers hal-02903655, HAL.
    2. Naif Alotaibi & A. S. Al-Moisheer & Ibrahim Elbatal & Mansour Shrahili & Mohammed Elgarhy & Ehab M. Almetwally, 2023. "Half Logistic Inverted Nadarajah–Haghighi Distribution under Ranked Set Sampling with Applications," Mathematics, MDPI, vol. 11(7), pages 1-32, April.
    3. Ayoub Ammy-Driss & Matthieu Garcin, 2020. "Efficiency of the financial markets during the COVID-19 crisis: time-varying parameters of fractional stable dynamics," Papers 2007.10727, arXiv.org, revised Nov 2021.
    4. da Silva, Sérgio Luiz Eduardo Ferreira, 2021. "Newton’s cooling law in generalised statistical mechanics," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 565(C).
    5. Gradojevic, Nikola & Gencay, Ramazan, 2008. "Overnight interest rates and aggregate market expectations," Economics Letters, Elsevier, vol. 100(1), pages 27-30, July.
    6. Stosic, Tatijana & Telesca, Luciano & Stosic, Borko, 2021. "Multiparametric statistical and dynamical analysis of angular high-frequency wind speed time series," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 566(C).
    7. Harvey, A., 2021. "Score-driven time series models," Cambridge Working Papers in Economics 2133, Faculty of Economics, University of Cambridge.
    8. Masi, Marco, 2007. "On the extended Kolmogorov–Nagumo information-entropy theory, the q→1/q duality and its possible implications for a non-extensive two-dimensional Ising model," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 377(1), pages 67-78.
    9. Harvey,Andrew C., 2013. "Dynamic Models for Volatility and Heavy Tails," Cambridge Books, Cambridge University Press, number 9781107034723, January.
    10. Nikola Gradojevic & Marko Caric, 2017. "Predicting Systemic Risk with Entropic Indicators," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 36(1), pages 16-25, January.
    11. Deeb, Omar El, 2023. "Entropic spatial auto-correlation of voter uncertainty and voter transitions in parliamentary elections," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 617(C).
    12. Bram van Os, 2023. "Information-Theoretic Time-Varying Density Modeling," Tinbergen Institute Discussion Papers 23-037/III, Tinbergen Institute.
    13. Matsushita, Raul & Brandão, Helena & Nobre, Iuri & Da Silva, Sergio, 2024. "Differential entropy estimation with a Paretian kernel: Tail heaviness and smoothing," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 646(C).
    14. Gayen, Atin & Kumar, M. Ashok, 2021. "Projection theorems and estimating equations for power-law models," Journal of Multivariate Analysis, Elsevier, vol. 184(C).
    15. Ou, Congjie & Huang, Zhifu & Chen, Jincan & El Kaabouchi, A. & Nivanen, L. & Le Méhauté, A. & Wang, Qiuping A., 2009. "A basic problem in the correlations between statistics and thermodynamics," Chaos, Solitons & Fractals, Elsevier, vol. 41(5), pages 2313-2318.
    16. Luciano Telesca & Michele Lovallo & Gianfranco Cardettini & Angelo Aromando & Nicodemo Abate & Monica Proto & Antonio Loperte & Nicola Masini & Rosa Lasaponara, 2023. "Urban and Peri-Urban Vegetation Monitoring Using Satellite MODIS NDVI Time Series, Singular Spectrum Analysis, and Fisher–Shannon Statistical Method," Sustainability, MDPI, vol. 15(14), pages 1-20, July.
    17. Meyer-Gohde, Alexander, 2019. "Generalized entropy and model uncertainty," Journal of Economic Theory, Elsevier, vol. 183(C), pages 312-343.
    18. Fourier, Jean-Baptiste Joseph, 2022. "Indicador Bernardos: un nuevo indicador clave en el análisis del mercado de las criptomonedas y de la conducta humana ante lo desconocido," OSF Preprints 87brk, Center for Open Science.
    19. Pintarelli, María B. & Vericat, Fernando, 2003. "Generalized Hausdorff inverse moment problem," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 324(3), pages 568-588.
    20. Alves, L.G.A. & Ribeiro, H.V. & Santos, M.A.F. & Mendes, R.S. & Lenzi, E.K., 2015. "Solutions for a q-generalized Schrödinger equation of entangled interacting particles," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 429(C), pages 35-44.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jmathe:v:12:y:2024:i:15:p:2396-:d:1447347. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.