IDEAS home Printed from https://ideas.repec.org/a/spr/advdac/v7y2013i4p435-464.html
   My bibliography  Save this article

Energy-based function to evaluate data stream clustering

Author

Listed:
  • Marcelo Albertini
  • Rodrigo Mello

Abstract

Severe constraints imposed by the nature of endless sequences of data collected from unstable phenomena have pushed the understanding and the development of automated analysis strategies, such as data clustering techniques. However, current clustering validation approaches are inadequate to data streams due to they do not properly evaluate representation of behavior changes. This paper proposes a novel function to continuously evaluate data stream clustering inspired in Lyapunov energy functions used by techniques such as the Hopfield artificial neural network and the Bidirectional Associative Memory ( Bam). The proposed function considers three terms: i) the intra-cluster distance, which allows to evaluate cluster compactness; ii) the inter-cluster distance, which reflects cluster separability; and iii) entropy estimation of the clustering model, which permits the evaluation of the level of uncertainty in data streams. A first set of experiments illustrate the proposed function applied to scenarios of continuous evaluation of data stream clustering. Further experiments were conducted to compare this new function to well-established clustering indices and results confirm our proposal reflects the same information obtained with external clustering indices. Copyright Springer-Verlag Berlin Heidelberg 2013

Suggested Citation

  • Marcelo Albertini & Rodrigo Mello, 2013. "Energy-based function to evaluate data stream clustering," Advances in Data Analysis and Classification, Springer;German Classification Society - Gesellschaft für Klassifikation (GfKl);Japanese Classification Society (JCS);Classification and Data Analysis Group of the Italian Statistical Society (CLADAG);International Federation of Classification Societies (IFCS), vol. 7(4), pages 435-464, December.
    • Handle: RePEc:spr:advdac:v:7:y:2013:i:4:p:435-464
    DOI: 10.1007/s11634-013-0145-3
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1007/s11634-013-0145-3
    Download Restriction: Access to full text is restricted to subscribers.
    File URL: https://libkey.io/10.1007/s11634-013-0145-3?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Peter R. Winters, 1960. "Forecasting Sales by Exponentially Weighted Moving Averages," Management Science, INFORMS, vol. 6(3), pages 324-342, April.
    2. Holt, Charles C., 2004. "Forecasting seasonals and trends by exponentially weighted moving averages," International Journal of Forecasting, Elsevier, vol. 20(1), pages 5-10.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Meira, Erick & Cyrino Oliveira, Fernando Luiz & de Menezes, Lilian M., 2022. "Forecasting natural gas consumption using Bagging and modified regularization techniques," Energy Economics, Elsevier, vol. 106(C).
    2. Kosuke Kawakami & Hirokazu Kobayashi & Kazuhide Nakata, 2021. "Seasonal Inventory Management Model for Raw Materials in Steel Industry," Interfaces, INFORMS, vol. 51(4), pages 312-324, July.
    3. Andrea Kolková & Petr Rozehnal, 2022. "Hybrid demand forecasting models: pre-pandemic and pandemic use studies," Equilibrium. Quarterly Journal of Economics and Economic Policy, Institute of Economic Research, vol. 17(3), pages 699-725, September.
    4. Theresa Maria Rausch & Tobias Albrecht & Daniel Baier, 2022. "Beyond the beaten paths of forecasting call center arrivals: on the use of dynamic harmonic regression with predictor variables," Journal of Business Economics, Springer, vol. 92(4), pages 675-706, May.
    5. Ye, Lili & Xie, Naiming & Boylan, John E. & Shang, Zhongju, 2024. "Forecasting seasonal demand for retail: A Fourier time-varying grey model," International Journal of Forecasting, Elsevier, vol. 40(4), pages 1467-1485.
    6. Isra Al-Turaiki & Fahad Almutlaq & Hend Alrasheed & Norah Alballa, 2021. "Empirical Evaluation of Alternative Time-Series Models for COVID-19 Forecasting in Saudi Arabia," IJERPH, MDPI, vol. 18(16), pages 1-19, August.
    7. Maia, André Luis Santiago & de Carvalho, Francisco de A.T., 2011. "Holt’s exponential smoothing and neural network models for forecasting interval-valued time series," International Journal of Forecasting, Elsevier, vol. 27(3), pages 740-759.
    8. Dalton Garcia Borges de Souza & Erivelton Antonio dos Santos & Francisco Tarcísio Alves Júnior & Mariá Cristina Vasconcelos Nascimento, 2021. "On Comparing Cross-Validated Forecasting Models with a Novel Fuzzy-TOPSIS Metric: A COVID-19 Case Study," Sustainability, MDPI, vol. 13(24), pages 1-25, December.
    9. Felipe Santos‐Marquez, 2022. "Spatial beta‐convergence forecasting models: Evidence from municipal homicide rates in Colombia," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 41(2), pages 294-302, March.
    10. Stefan Mihai Petrea & Cristina Zamfir & Ira Adeline Simionov & Alina Mogodan & Florian Marcel Nuţă & Adrian Turek Rahoveanu & Dumitru Nancu & Dragos Sebastian Cristea & Florin Marian Buhociu, 2021. "A Forecasting and Prediction Methodology for Improving the Blue Economy Resilience to Climate Change in the Romanian Lower Danube Euroregion," Sustainability, MDPI, vol. 13(21), pages 1-36, October.
    11. Vesna Karadzic & Bojan Pejovic, 2021. "Inflation Forecasting in the Western Balkans and EU: A Comparison of Holt-Winters, ARIMA and NNAR Models," The AMFITEATRU ECONOMIC journal, Academy of Economic Studies - Bucharest, Romania, vol. 23(57), pages 517-517.
    12. Benedict J. Drasch & Gilbert Fridgen & Lukas Häfner, 2020. "Demand response through automated air conditioning in commercial buildings—a data-driven approach," Business Research, Springer;German Academic Association for Business Research, vol. 13(3), pages 1491-1525, November.
    13. Jan G. De Gooijer & Rob J. Hyndman, 2005. "25 Years of IIF Time Series Forecasting: A Selective Review," Monash Econometrics and Business Statistics Working Papers 12/05, Monash University, Department of Econometrics and Business Statistics.
    14. Filelis - Papadopoulos, Christos K. & Kyziropoulos, Panagiotis E. & Morrison, John P. & O‘Reilly, Philip, 2022. "Modelling and forecasting based on recursive incomplete pseudoinverse matrices," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 197(C), pages 358-376.
    15. Zhou, Shenghan & Hu, Chen & Qiao, Xiaoduo & Chang, Wenbing, 2016. "A forecasting method for Chinese civil planes attendance rate based on vague sets," Chaos, Solitons & Fractals, Elsevier, vol. 89(C), pages 518-526.
    16. Zhen Zeng & Tucker Balch & Manuela Veloso, 2021. "Deep Video Prediction for Time Series Forecasting," Papers 2102.12061, arXiv.org, revised Nov 2021.
    17. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    18. Fieger, Peter & Rice, John, 2016. "Modelling Chinese Inbound Tourism Arrivals into Christchurch," MPRA Paper 75468, University Library of Munich, Germany.
    19. Albrecht, Tobias & Rausch, Theresa Maria & Derra, Nicholas Daniel, 2021. "Call me maybe: Methods and practical implementation of artificial intelligence in call center arrivals’ forecasting," Journal of Business Research, Elsevier, vol. 123(C), pages 267-278.
    20. Feng Xu & Mohamad Sepehri & Jian Hua & Sergey Ivanov & Julius N. Anyu, 2018. "Time-Series Forecasting Models for Gasoline Prices in China," International Journal of Economics and Finance, Canadian Center of Science and Education, vol. 10(12), pages 1-43, December.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:advdac:v:7:y:2013:i:4:p:435-464. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.