IDEAS home Printed from https://ideas.repec.org/a/gam/jeners/v11y2018i8p2007-d161450.html
   My bibliography  Save this article

Stream Data Cleaning for Dynamic Line Rating Application

Author

Listed:
  • Hassan M. Nemati

    (Center for Applied Intelligent Systems Research, Halmstad University, SE-30118 Halmstad, Sweden
    Current address: Center for Applied Intelligent Systems Research, Halmstad University, P.O. Box 823, 30118 Halmstad, Sweden.)

  • A. Laso

    (Department of Electrical and Energy Engineering, University of Cantabria, 39005 Santander, Spain)

  • M. Manana

    (Department of Electrical and Energy Engineering, University of Cantabria, 39005 Santander, Spain)

  • Anita Sant'Anna

    (Center for Applied Intelligent Systems Research, Halmstad University, SE-30118 Halmstad, Sweden)

  • Sławomir Nowaczyk

    (Center for Applied Intelligent Systems Research, Halmstad University, SE-30118 Halmstad, Sweden)

Abstract

The maximum current that an overhead transmission line can continuously carry depends on external weather conditions, most commonly obtained from real-time streaming weather sensors. The accuracy of the sensor data is very important in order to avoid problems such as overheating. Furthermore, faulty sensor readings may cause operators to limit or even stop the energy production from renewable sources in radial networks. This paper presents a method for detecting and replacing sequences of consecutive faulty data originating from streaming weather sensors. The method is based on a combination of (a) a set of constraints obtained from derivatives in consecutive data, and (b) association rules that are automatically generated from historical data. In smart grids, a large amount of historical data from different weather stations are available but rarely used. In this work, we show that mining and analyzing this historical data provides valuable information that can be used for detecting and replacing faulty sensor readings. We compare the result of the proposed method against the exponentially weighted moving average and vector autoregression models. Experiments on data sets with real and synthetic errors demonstrate the good performance of the proposed method for monitoring weather sensors.

Suggested Citation

  • Hassan M. Nemati & A. Laso & M. Manana & Anita Sant'Anna & Sławomir Nowaczyk, 2018. "Stream Data Cleaning for Dynamic Line Rating Application," Energies, MDPI, vol. 11(8), pages 1-16, August.
  • Handle: RePEc:gam:jeners:v:11:y:2018:i:8:p:2007-:d:161450
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/1996-1073/11/8/2007/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/1996-1073/11/8/2007/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Anna, Petrenko, 2016. "Мaркування готової продукції як складова частина інформаційного забезпечення маркетингової діяльності підприємств овочепродуктового підкомплексу," Agricultural and Resource Economics: International Scientific E-Journal, Agricultural and Resource Economics: International Scientific E-Journal, vol. 2(01), March.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Vivian Welch & Christine M. Mathew & Panteha Babelmorad & Yanfei Li & Elizabeth T. Ghogomu & Johan Borg & Monserrat Conde & Elizabeth Kristjansson & Anne Lyddiatt & Sue Marcus & Jason W. Nickerson & K, 2021. "Health, social care and technological interventions to improve functional ability of older adults living at home: An evidence and gap map," Campbell Systematic Reviews, John Wiley & Sons, vol. 17(3), September.
    2. Erkmen Giray Aslim, 2019. "The Relationship Between Health Insurance and Early Retirement: Evidence from the Affordable Care Act," Eastern Economic Journal, Palgrave Macmillan;Eastern Economic Association, vol. 45(1), pages 112-140, January.
    3. Nihan Akyelken, 2017. "Mobility-Related Economic Exclusion: Accessibility and Commuting Patterns in Industrial Zones in Turkey," Social Inclusion, Cogitatio Press, vol. 5(4), pages 175-182.
    4. Dreher, Axel & Fuchs, Andreas & Langlotz, Sarah, 2019. "The effects of foreign aid on refugee flows," European Economic Review, Elsevier, vol. 112(C), pages 127-147.
    5. Georg Feigl & Markus Marterbauer & Miriam Rehm & Matthias Schnetzer & Sepp Zuckerstätter & Lars Nørvang Andersen & Thea Nissen & Signe Dahl & Peter Hohlfeld & Benjamin Lojak & Achim Truger & Andrew Wa, 2016. "The Elusive Recovery," SciencePo Working papers Main hal-03459084, HAL.
      • Georg Feigl & Markus Marterbauer & Miriam Rehm & Matthias Schnetzer & Sepp Zuckerstätter & Lars Nørvang Andersen & Thea Nissen & Signe Dahl & Peter Hohlfeld & Benjamin Lojak & Achim Truger & Andrew Wa, 2016. "The Elusive Recovery," PSE-Ecole d'économie de Paris (Postprint) hal-03459084, HAL.
      • Georg Feigl & Markus Marterbauer & Miriam Rehm & Matthias Schnetzer & Sepp Zuckerstätter & Lars Nørvang Andersen & Thea Nissen & Signe Dahl & Peter Hohlfeld & Benjamin Lojak & Thomas Theobald & Achim , 2016. "The Elusive Recovery," PSE Working Papers hal-03612850, HAL.
      • Georg Feigl & Markus Marterbauer & Miriam Rehm & Matthias Schnetzer & Sepp Zuckerstätter & Lars Nørvang Andersen & Thea Nissen & Signe Dahl & Peter Hohlfeld & Benjamin Lojak & Achim Truger & Andrew Wa, 2016. "The Elusive Recovery," Post-Print hal-03459084, HAL.
      • Georg Feigl & Markus Marterbauer & Miriam Rehm & Matthias Schnetzer & Sepp Zuckerstätter & Lars Nørvang Andersen & Thea Nissen & Signe Dahl & Peter Hohlfeld & Benjamin Lojak & Thomas Theobald & Achim , 2016. "The Elusive Recovery," Working Papers hal-03612850, HAL.
      • Georg Feigl & Markus Marterbauer & Miriam Rehm & Matthias Schnetzer & Sepp Zuckerstätter & Lars Nørvang Andersen & Thea Nissen & Signe Dahl & Peter Hohlfeld & Benjamin Lojak & Thomas Theobald & Achim , 2016. "The Elusive Recovery," SciencePo Working papers Main hal-03612850, HAL.
      • Georg Feigl & Markus Marterbauer & Miriam Rehm & Matthias Schnetzer & Sepp Zuckerstätter & Lars Nørvang Andersen & Thea Nissen & Signe Dahl & Peter Hohlfeld & Benjamin Lojak & Thomas Theobald & Achim , 2016. "The Elusive Recovery," PSE-Ecole d'économie de Paris (Postprint) hal-03612850, HAL.
    6. Billari, Francesco C. & Giuntella, Osea & Stella, Luca, 2018. "Broadband internet, digital temptations, and sleep," Journal of Economic Behavior & Organization, Elsevier, vol. 153(C), pages 58-76.
    7. Ekaterina Aleksandrova & Kristian Behrens & Maria Kuznetsova, 2020. "Manufacturing (co)agglomeration in a transition country: Evidence from Russia," Journal of Regional Science, Wiley Blackwell, vol. 60(1), pages 88-128, January.
    8. Werner Eichhorst & Ulf Rinne, 2017. "Digital Challenges for the Welfare State," CESifo Forum, ifo Institute - Leibniz Institute for Economic Research at the University of Munich, vol. 18(04), pages 03-08, December.
    9. Grazzini, Jakob & Richiardi, Matteo G. & Tsionas, Mike, 2017. "Bayesian estimation of agent-based models," Journal of Economic Dynamics and Control, Elsevier, vol. 77(C), pages 26-47.
    10. Bruno Biais & Fany Declerck & Sophie Moinas, 2016. "Who supplies liquidity, how and when?," BIS Working Papers 563, Bank for International Settlements.
    11. Chen, Cheng & Senga, Tatsuro & Sun, Chang & Zhang, Hongyong, 2023. "Uncertainty, imperfect information, and expectation formation over the firm’s life cycle," Journal of Monetary Economics, Elsevier, vol. 140(C), pages 60-77.
    12. Julie Vinck & Idunn Brekke, 2019. "Gender and education inequalities in parental employment when having a young child with increased care needs: Belgium and Norway compared," Working Papers 1904, Herman Deleeck Centre for Social Policy, University of Antwerp.
    13. Alvarez, Camila H. & Evans, Clare Rosenfeld, 2021. "Intersectional environmental justice and population health inequalities: A novel approach," Social Science & Medicine, Elsevier, vol. 269(C).
    14. Michal Gluszak & Remigiusz Gawlik & Malgorzata Zieba, 2019. "Smart and Green Buildings Features in the Decision-Making Hierarchy of Office Space Tenants: An Analytic Hierarchy Process Study," Administrative Sciences, MDPI, vol. 9(3), pages 1-16, July.
    15. Shisong Jiang, 2021. "“When Paradigms Are Out of Place”: Embracing Eclecticism in Legal Scholarship by Academic Turns," Laws, MDPI, vol. 10(4), pages 1-16, October.
    16. Ilde Rizzo & Anna Mignosa (ed.), 2013. "Handbook on the Economics of Cultural Heritage," Books, Edward Elgar Publishing, number 14326.
    17. repec:spo:wpmain:info:hdl:2441/50jd34uldo9jioklc7b0dpu4ej is not listed on IDEAS
    18. Stefano Bianchini & Giulio Bottazzi & Federico Tamagni, 2017. "What does (not) characterize persistent corporate high-growth?," Small Business Economics, Springer, vol. 48(3), pages 633-656, March.
    19. Natalia Danzer & Martin Halla & Nicole Schneeweis & Martina Zweimüller, 2022. "Parental Leave, (In)formal Childcare, and Long-Term Child Outcomes," Journal of Human Resources, University of Wisconsin Press, vol. 57(6), pages 1826-1884.
    20. Krzysztof Karbownik & Anthony Wray, 2019. "Long-Run Consequences of Exposure to Natural Disasters," Journal of Labor Economics, University of Chicago Press, vol. 37(3), pages 949-1007.
    21. Mayda, Anna Maria & Ortega, Francesc & Peri, Giovanni & Shih, Kevin & Sparber, Chad, 2018. "The effect of the H-1B quota on the employment and selection of foreign-born labor," European Economic Review, Elsevier, vol. 108(C), pages 105-128.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jeners:v:11:y:2018:i:8:p:2007-:d:161450. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.