IDEAS home Printed from https://ideas.repec.org/a/spr/advdac/v7y2013i4p435-464.html
   My bibliography  Save this article

Energy-based function to evaluate data stream clustering

Author

Listed:
  • Marcelo Albertini
  • Rodrigo Mello

Abstract

Severe constraints imposed by the nature of endless sequences of data collected from unstable phenomena have pushed the understanding and the development of automated analysis strategies, such as data clustering techniques. However, current clustering validation approaches are inadequate to data streams due to they do not properly evaluate representation of behavior changes. This paper proposes a novel function to continuously evaluate data stream clustering inspired in Lyapunov energy functions used by techniques such as the Hopfield artificial neural network and the Bidirectional Associative Memory ( Bam). The proposed function considers three terms: i) the intra-cluster distance, which allows to evaluate cluster compactness; ii) the inter-cluster distance, which reflects cluster separability; and iii) entropy estimation of the clustering model, which permits the evaluation of the level of uncertainty in data streams. A first set of experiments illustrate the proposed function applied to scenarios of continuous evaluation of data stream clustering. Further experiments were conducted to compare this new function to well-established clustering indices and results confirm our proposal reflects the same information obtained with external clustering indices. Copyright Springer-Verlag Berlin Heidelberg 2013

Suggested Citation

  • Marcelo Albertini & Rodrigo Mello, 2013. "Energy-based function to evaluate data stream clustering," Advances in Data Analysis and Classification, Springer;German Classification Society - Gesellschaft für Klassifikation (GfKl);Japanese Classification Society (JCS);Classification and Data Analysis Group of the Italian Statistical Society (CLADAG);International Federation of Classification Societies (IFCS), vol. 7(4), pages 435-464, December.
    • Handle: RePEc:spr:advdac:v:7:y:2013:i:4:p:435-464
    DOI: 10.1007/s11634-013-0145-3
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1007/s11634-013-0145-3
    Download Restriction: Access to full text is restricted to subscribers.
    File URL: https://libkey.io/10.1007/s11634-013-0145-3?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Peter R. Winters, 1960. "Forecasting Sales by Exponentially Weighted Moving Averages," Management Science, INFORMS, vol. 6(3), pages 324-342, April.
    2. Holt, Charles C., 2004. "Forecasting seasonals and trends by exponentially weighted moving averages," International Journal of Forecasting, Elsevier, vol. 20(1), pages 5-10.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Meira, Erick & Cyrino Oliveira, Fernando Luiz & de Menezes, Lilian M., 2022. "Forecasting natural gas consumption using Bagging and modified regularization techniques," Energy Economics, Elsevier, vol. 106(C).
    2. Fieger, Peter & Rice, John, 2016. "Modelling Chinese Inbound Tourism Arrivals into Christchurch," MPRA Paper 75468, University Library of Munich, Germany.
    3. Albrecht, Tobias & Rausch, Theresa Maria & Derra, Nicholas Daniel, 2021. "Call me maybe: Methods and practical implementation of artificial intelligence in call center arrivals’ forecasting," Journal of Business Research, Elsevier, vol. 123(C), pages 267-278.
    4. Kosuke Kawakami & Hirokazu Kobayashi & Kazuhide Nakata, 2021. "Seasonal Inventory Management Model for Raw Materials in Steel Industry," Interfaces, INFORMS, vol. 51(4), pages 312-324, July.
    5. Andrea Kolková & Petr Rozehnal, 2022. "Hybrid demand forecasting models: pre-pandemic and pandemic use studies," Equilibrium. Quarterly Journal of Economics and Economic Policy, Institute of Economic Research, vol. 17(3), pages 699-725, September.
    6. Feng Xu & Mohamad Sepehri & Jian Hua & Sergey Ivanov & Julius N. Anyu, 2018. "Time-Series Forecasting Models for Gasoline Prices in China," International Journal of Economics and Finance, Canadian Center of Science and Education, vol. 10(12), pages 1-43, December.
    7. Theresa Maria Rausch & Tobias Albrecht & Daniel Baier, 2022. "Beyond the beaten paths of forecasting call center arrivals: on the use of dynamic harmonic regression with predictor variables," Journal of Business Economics, Springer, vol. 92(4), pages 675-706, May.
    8. Veiga, Claudimar Pereira da & Veiga, Cássia Rita Pereira da & Puchalski, Weslly & Coelho, Leandro dos Santos & Tortato, Ubiratã, 2016. "Demand forecasting based on natural computing approaches applied to the foodstuff retail segment," Journal of Retailing and Consumer Services, Elsevier, vol. 31(C), pages 174-181.
    9. Hill, Arthur V. & Zhang, Weiyong & Burch, Gerald F., 2015. "Forecasting the forecastability quotient for inventory management," International Journal of Forecasting, Elsevier, vol. 31(3), pages 651-663.
    10. Zhen Zeng & Rachneet Kaur & Suchetha Siddagangappa & Saba Rahimi & Tucker Balch & Manuela Veloso, 2023. "Financial Time Series Forecasting using CNN and Transformer," Papers 2304.04912, arXiv.org.
    11. Maia, André Luis Santiago & de Carvalho, Francisco de A.T., 2011. "Holt's exponential smoothing and neural network models for forecasting interval-valued time series," International Journal of Forecasting, Elsevier, vol. 27(3), pages 740-759, July.
    12. Wang, Zheng-Xin & Wang, Zhi-Wei & Li, Qin, 2020. "Forecasting the industrial solar energy consumption using a novel seasonal GM(1,1) model with dynamic seasonal adjustment factors," Energy, Elsevier, vol. 200(C).
    13. Isra Al-Turaiki & Fahad Almutlaq & Hend Alrasheed & Norah Alballa, 2021. "Empirical Evaluation of Alternative Time-Series Models for COVID-19 Forecasting in Saudi Arabia," IJERPH, MDPI, vol. 18(16), pages 1-19, August.
    14. Marvin Carl May & Alexander Albers & Marc David Fischer & Florian Mayerhofer & Louis Schäfer & Gisela Lanza, 2021. "Queue Length Forecasting in Complex Manufacturing Job Shops," Forecasting, MDPI, vol. 3(2), pages 1-17, May.
    15. Paris A. Mastorocostas & Constantinos S. Hilas & Dimitris N. Varsamis & Stergiani C. Dova, 2016. "Telecommunications call volume forecasting with a block-diagonal recurrent fuzzy neural network," Telecommunication Systems: Modelling, Analysis, Design and Management, Springer, vol. 63(1), pages 15-25, September.
    16. Sabaj, Ernil & Kahveci, Mustafa, 2018. "Forecasting tax revenues in an emerging economy: The case of Albania," MPRA Paper 84404, University Library of Munich, Germany.
    17. Maia, André Luis Santiago & de Carvalho, Francisco de A.T., 2011. "Holt’s exponential smoothing and neural network models for forecasting interval-valued time series," International Journal of Forecasting, Elsevier, vol. 27(3), pages 740-759.
    18. Dalton Garcia Borges de Souza & Erivelton Antonio dos Santos & Francisco Tarcísio Alves Júnior & Mariá Cristina Vasconcelos Nascimento, 2021. "On Comparing Cross-Validated Forecasting Models with a Novel Fuzzy-TOPSIS Metric: A COVID-19 Case Study," Sustainability, MDPI, vol. 13(24), pages 1-25, December.
    19. Felipe Santos‐Marquez, 2022. "Spatial beta‐convergence forecasting models: Evidence from municipal homicide rates in Colombia," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 41(2), pages 294-302, March.
    20. Rice, William L. & Park, So Young & Pan, Bing & Newman, Peter, 2019. "Forecasting campground demand in US national parks," Annals of Tourism Research, Elsevier, vol. 75(C), pages 424-438.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:advdac:v:7:y:2013:i:4:p:435-464. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.