IDEAS home Printed from https://ideas.repec.org/a/gam/jdataj/v5y2020i2p50-d367592.html
   My bibliography  Save this article

Data Wrangling in Database Systems: Purging of Dirty Data

Author

Listed:
  • Otmane Azeroual

    (German Center for Higher Education Research and Science Studies (DZHW), Schützenstraße 6a, Berlin 10117, Germany)

Abstract

Researchers need to be able to integrate ever-increasing amounts of data into their institutional databases, regardless of the source, format, or size of the data. It is then necessary to use the increasing diversity of data to derive greater value from data for their organization. The processing of electronic data plays a central role in modern society. Data constitute a fundamental part of operational processes in companies and scientific organizations. In addition, they form the basis for decisions. Bad data quality can negatively affect decisions and have a negative impact on results. The quality of the data is crucial. This includes the new theme of data wrangling, sometimes referred to as data munging or data crunching, to find the dirty data and to transform and clean them. The aim of data wrangling is to prepare a lot of raw data in their original state so that they can be used for further analysis steps. Only then can knowledge be obtained that may bring added value. This paper shows how the data wrangling process works and how it can be used in database systems to clean up data from heterogeneous data sources during their acquisition and integration.

Suggested Citation

  • Otmane Azeroual, 2020. "Data Wrangling in Database Systems: Purging of Dirty Data," Data, MDPI, vol. 5(2), pages 1-9, June.
    • Handle: RePEc:gam:jdataj:v:5:y:2020:i:2:p:50-:d:367592
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2306-5729/5/2/50/pdf
    Download Restriction: no
    File URL: https://www.mdpi.com/2306-5729/5/2/50/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Azeroual, Otmane & Saake, Gunter & Schallehn, Eike, 2018. "Analyzing data quality issues in research information systems via data profiling," International Journal of Information Management, Elsevier, vol. 41(C), pages 50-56.
    2. Boris Otto & Yang W. Lee & Ismael Caballero, 2011. "Information and data quality in networked business," Electronic Markets, Springer;IIM University of St. Gallen, vol. 21(2), pages 79-81, June.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Otmane Azeroual & Joachim Schöpfel & Dragan Ivanovic, 2020. "Influence of Information Quality via Implemented German RCD Standard in Research Information Systems," Data, MDPI, vol. 5(2), pages 1-10, March.
    2. Han Meng & Xiaoyu Qi & Gang Mei, 2024. "A Deep Learning Approach for Stochastic Structural Plane Generation Based on Denoising Diffusion Probabilistic Models," Mathematics, MDPI, vol. 12(13), pages 1-22, June.
    3. Rainer Alt, 2021. "Electronic Markets on digital platforms and AI," Electronic Markets, Springer;IIM University of St. Gallen, vol. 31(2), pages 233-241, June.
    4. Otmane Azeroual & Gunter Saake & Mohammad Abuosba & Joachim Schöpfel, 2020. "Data Quality as a Critical Success Factor for User Acceptance of Research Information Systems," Data, MDPI, vol. 5(2), pages 1-13, April.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jdataj:v:5:y:2020:i:2:p:50-:d:367592. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.