IDEAS home Printed from https://ideas.repec.org/a/eee/infome/v3y2009i2p102-123.html
   My bibliography  Save this article

Automatic evaluation of digital libraries with 5SQual

Author

Listed:
  • Moreira, Bárbara L.
  • Gonçalves, Marcos André
  • Laender, Alberto H.F.
  • Fox, Edward A.

Abstract

Digital libraries (DLs) are complex information systems which can present changes in their structure, content, and services. These complexities and dynamics make system maintenance a non-trivial task, since it requires periodical evaluation of the different DL components. Generally, these evaluations are customized per system and are performed only when problems occur and administrator intervention is required. This work aims to change the situation. We present 5SQual, a tool which provides ways to perform automatic and configurable evaluations of some of the most important DL components, among them, digital objects, metadata, and services. The tool implements diverse numeric indicators that are associated with eight quality dimensions described in the 5S quality model. Its generic architecture was developed to be applicable to various DLs and scenarios. In sum, the main contributions of this work include: (i) the design and implementation of 5SQual, a tool that validates a theoretical DL quality model; (ii) the demonstration of the applicability of the tool in several usage scenarios; and (iii) the evaluation (with usability specialists) of its graphical interface specially designed to guide the configuration of 5SQual evaluations. We also present the results of interviews conducted with administrators of real DLs regarding their expectations and opinions about 5SQual.

Suggested Citation

  • Moreira, Bárbara L. & Gonçalves, Marcos André & Laender, Alberto H.F. & Fox, Edward A., 2009. "Automatic evaluation of digital libraries with 5SQual," Journal of Informetrics, Elsevier, vol. 3(2), pages 102-123.
    • Handle: RePEc:eee:infome:v:3:y:2009:i:2:p:102-123
    DOI: 10.1016/j.joi.2008.12.003
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S1751157708000734
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.joi.2008.12.003?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Henry Small, 1973. "Co‐citation in the scientific literature: A new measure of the relationship between two documents," Journal of the American Society for Information Science, Association for Information Science & Technology, vol. 24(4), pages 265-269, July.
    2. M. M. Kessler, 1963. "Bibliographic coupling between scientific papers," American Documentation, Wiley Blackwell, vol. 14(1), pages 10-25, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Guan-Can Yang & Gang Li & Chun-Ya Li & Yun-Hua Zhao & Jing Zhang & Tong Liu & Dar-Zen Chen & Mu-Hsuan Huang, 2015. "Using the comprehensive patent citation network (CPC) to evaluate patent value," Scientometrics, Springer;Akadémiai Kiadó, vol. 105(3), pages 1319-1346, December.
    2. Rey-Long Liu, 2017. "A new bibliographic coupling measure with descriptive capability," Scientometrics, Springer;Akadémiai Kiadó, vol. 110(2), pages 915-935, February.
    3. Lilian Cervo Cabrera & Carlos Eduardo Caldarelli & Marcia Regina Gabardo Camara, 2020. "Mapping collaboration in international coffee certification research," Scientometrics, Springer;Akadémiai Kiadó, vol. 124(3), pages 2597-2618, September.
    4. Gangan Prathap & Somenath Mukherjee, 2020. "Letter to the Editor: Comments on the paper of Batagelj—on fractional approach to analysis of linked networks," Scientometrics, Springer;Akadémiai Kiadó, vol. 124(3), pages 2717-2722, September.
    5. Chris W. Belter, 2013. "A bibliometric analysis of NOAA’s Office of Ocean Exploration and Research," Scientometrics, Springer;Akadémiai Kiadó, vol. 95(2), pages 629-644, May.
    6. Ding, Ying, 2011. "Community detection: Topological vs. topical," Journal of Informetrics, Elsevier, vol. 5(4), pages 498-514.
    7. Manta Eduard Mihai & Davidescu Adriana Ana Maria & Geambasu Maria Cristina & Florescu Margareta Stela, 2023. "Exploring the research area of direct taxation. An empirical analysis based on bibliometric analysis results," Management & Marketing, Sciendo, vol. 18(s1), pages 355-383, December.
    8. Yu-Wei Chang & Mu-Hsuan Huang & Chiao-Wen Lin, 2015. "Evolution of research subjects in library and information science based on keyword, bibliographical coupling, and co-citation analyses," Scientometrics, Springer;Akadémiai Kiadó, vol. 105(3), pages 2071-2087, December.
    9. Raymundo das Neves Machado & Benjamín Vargas-Quesada & Jacqueline Leta, 2016. "Intellectual structure in stem cell research: exploring Brazilian scientific articles from 2001 to 2010," Scientometrics, Springer;Akadémiai Kiadó, vol. 106(2), pages 525-537, February.
    10. Ying Huang & Wolfgang Glänzel & Lin Zhang, 2021. "Tracing the development of mapping knowledge domains," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(7), pages 6201-6224, July.
    11. Raphaël Maucuer & Alexandre Renaud & Sébastien Ronteau & Laurent Muzellec, 2022. "What can we learn from marketers? A bibliometric analysis of the marketing literature on business model research," Post-Print hal-03718522, HAL.
    12. Masaki Eto, 2013. "Evaluations of context-based co-citation searching," Scientometrics, Springer;Akadémiai Kiadó, vol. 94(2), pages 651-673, February.
    13. Irene Monasterolo & Roberto Pasqualino & Anthony C. Janetos & Aled Jones, 2016. "Sustainable and Inclusive Food Systems through the Lenses of a Complex System Thinking Approach—A Bibliometric Review," Agriculture, MDPI, vol. 6(3), pages 1-13, September.
    14. Toshiyuki Hasumi & Mei-Shiu Chiu, 2022. "Online mathematics education as bio-eco-techno process: bibliometric analysis using co-authorship and bibliographic coupling," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(8), pages 4631-4654, August.
    15. Michel Zitt, 2015. "Meso-level retrieval: IR-bibliometrics interplay and hybrid citation-words methods in scientific fields delineation," Scientometrics, Springer;Akadémiai Kiadó, vol. 102(3), pages 2223-2245, March.
    16. Perianes-Rodriguez, Antonio & Waltman, Ludo & van Eck, Nees Jan, 2016. "Constructing bibliometric networks: A comparison between full and fractional counting," Journal of Informetrics, Elsevier, vol. 10(4), pages 1178-1195.
    17. Jarneving, Bo, 2007. "Bibliographic coupling and its application to research-front and other core documents," Journal of Informetrics, Elsevier, vol. 1(4), pages 287-307.
    18. João Paulo Coelho Ribeiro & Fábio Duarte & Ana Paula Matias Gama, 2022. "Does microfinance foster the development of its clients? A bibliometric analysis and systematic literature review," Financial Innovation, Springer;Southwestern University of Finance and Economics, vol. 8(1), pages 1-35, December.
    19. Batista-Canino, Rosa M. & Santana-Hernández, Lidia & Medina-Brito, Pino, 2024. "A holistic literature review on entrepreneurial Intention: A scientometric approach," Journal of Business Research, Elsevier, vol. 174(C).
    20. Xiaojun Hu & Ronald Rousseau & Jin Chen, 2012. "Structural indicators in citation networks," Scientometrics, Springer;Akadémiai Kiadó, vol. 91(2), pages 451-460, May.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:infome:v:3:y:2009:i:2:p:102-123. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/joi .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.