IDEAS home Printed from https://ideas.repec.org/a/igg/jdwm00/v17y2021i4p29-47.html
   My bibliography  Save this article

ETL Logs Under a Pattern-Oriented Approach

Author

Listed:
  • Bruno Oliveira

    (CIICESI, ESTG, Politécnico do Porto, Portugal)

  • Óscar Oliveira

    (CIICESI, School of Management and Technology, Porto Polytechnic, Portugal)

  • Orlando Belo

    (ALGORITMI R&D Centre, University of Minho, Portugal)

Abstract

Considering extract-transform-load (ETL) as a complex and evolutionary process, development teams must conscientiously and rigorously create log strategies for retrieving the most value of the information that can be gathered from the events that occur through the ETL workflow. Efficient logging strategies must be structured so that metrics, logs, and alerts can, beyond their troubleshooting capabilities, provide insights about the system. This paper presents a configurable and flexible ETL component for creating logging mechanisms in ETL workflows. A pattern-oriented approach is followed as a way to abstract ETL activities and enable its mapping to physical primitives that can be interpreted by ETL commercial tools.

Suggested Citation

  • Bruno Oliveira & Óscar Oliveira & Orlando Belo, 2021. "ETL Logs Under a Pattern-Oriented Approach," International Journal of Data Warehousing and Mining (IJDWM), IGI Global, vol. 17(4), pages 29-47, October.
    • Handle: RePEc:igg:jdwm00:v:17:y:2021:i:4:p:29-47
    as

    Download full text from publisher

    File URL: http://services.igi-global.com/resolvedoi/resolve.aspx?doi=10.4018/IJDWM.2021100102
    Download Restriction: no
    ---><---

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:igg:jdwm00:v:17:y:2021:i:4:p:29-47. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    We have no bibliographic references for this item. You can help adding them by using this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Journal Editor (email available below). General contact details of provider: https://www.igi-global.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.