IDEAS home Printed from https://ideas.repec.org/a/bla/jamist/v64y2013i4p745-770.html
   My bibliography  Save this article

A systematic review of interactive information retrieval evaluation studies, 1967–2006

Author

Listed:
  • Diane Kelly
  • Cassidy R. Sugimoto

Abstract

With the increasing number and diversity of search tools available, interest in the evaluation of search systems, particularly from a user perspective, has grown among researchers. More researchers are designing and evaluating interactive information retrieval (IIR) systems and beginning to innovate in evaluation methods. Maturation of a research specialty relies on the ability to replicate research, provide standards for measurement and analysis, and understand past endeavors. This article presents a historical overview of 40 years of IIR evaluation studies using the method of systematic review. A total of 2,791 journal and conference units were manually examined and 127 articles were selected for analysis in this study, based on predefined inclusion and exclusion criteria. These articles were systematically coded using features such as author, publication date, sources and references, and properties of the research method used in the articles, such as number of subjects, tasks, corpora, and measures. Results include data describing the growth of IIR studies over time, the most frequently occurring and cited authors and sources, and the most common types of corpora and measures used. An additional product of this research is a bibliography of IIR evaluation research that can be used by students, teachers, and those new to the area. To the authors' knowledge, this is the first historical, systematic characterization of the IIR evaluation literature, including the documentation of methods and measures used by researchers in this specialty.

Suggested Citation

  • Diane Kelly & Cassidy R. Sugimoto, 2013. "A systematic review of interactive information retrieval evaluation studies, 1967–2006," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 64(4), pages 745-770, April.
    • Handle: RePEc:bla:jamist:v:64:y:2013:i:4:p:745-770
    DOI: 10.1002/asi.22799
    as

    Download full text from publisher

    File URL: https://doi.org/10.1002/asi.22799
    Download Restriction: no
    File URL: https://libkey.io/10.1002/asi.22799?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Aurora González-Teruel & Gregorio González-Alcaide & Maite Barrios & María-Francisca Abad-García, 2015. "Mapping recent information behavior research: an analysis of co-authorship and co-citation networks," Scientometrics, Springer;Akadémiai Kiadó, vol. 103(2), pages 687-705, May.
    2. Ahsan Ullah & Kanwal Ameen, 2021. "Relating research growth, authorship patterns and publishing outlets: a bibliometric study of LIS articles produced by Pakistani authors," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(9), pages 8029-8047, September.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:jamist:v:64:y:2013:i:4:p:745-770. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    We have no bibliographic references for this item. You can help adding them by using this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: http://www.asis.org .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.