IDEAS home Printed from https://ideas.repec.org/a/bla/jamest/v47y1996i7p568-583.html
   My bibliography  Save this article

Rethinking online monitoring methods for information retrieval systems: From search product to search process

Author

Listed:
  • Christine L. Borgman
  • Sandra G. Hirsh
  • John Hiller

Abstract

Searching information retrieval systems is a highly interactive, iterative process that cannot be understood simply by comparing the output of a search session (the “search product”) to a query stated in advance. In this article, we examine evaluation goals and methods for studying information retrieval behavior, drawing examples from our own research and that of others. We limit our review to research that employs online monitoring, also known as transaction log analysis. Online monitoring is one of few methods that can capture detailed data on the search process at a reasonable cost; these data can be used to build quantitative models or to support qualitative interpretations of quantitative results. Monitoring is a data collection technique rather than a research design, and can be employed in experimental or field studies, whether alone or combined with other data collection methods. Based on the research questions of interest, the researcher must determine what variables to collect from each data source, which to treat as independent variables to manipulate, and which to treat as dependent variables to observe effects. Studies of searching behavior often treat search task and searcher characteristics as independent variables and may manipulate other independent variables specific to the research questions addressed. Search outcomes, time, and search paths frequently are treated as dependent variables. We discuss each of these sets of variables, illustrating them with sample results from the literature and from our own research. Our examples are drawn from the Science Library Catalog project, a 7‐year study of children's searching behavior on an experimental retrieval system. We close with a brief discussion of the implications of these results for the design of information retrieval systems. © 1996 John Wiley & Sons, Inc.

Suggested Citation

  • Christine L. Borgman & Sandra G. Hirsh & John Hiller, 1996. "Rethinking online monitoring methods for information retrieval systems: From search product to search process," Journal of the American Society for Information Science, Association for Information Science & Technology, vol. 47(7), pages 568-583, July.
  • Handle: RePEc:bla:jamest:v:47:y:1996:i:7:p:568-583
    DOI: 10.1002/(SICI)1097-4571(199607)47:73.0.CO;2-S
    as

    Download full text from publisher

    File URL: https://doi.org/10.1002/(SICI)1097-4571(199607)47:73.0.CO;2-S
    Download Restriction: no

    File URL: https://libkey.io/10.1002/(SICI)1097-4571(199607)47:73.0.CO;2-S?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Radislav Jovovic, 2006. "Information Technologies: Driving Force Of New Economy," Montenegrin Journal of Economics, Economic Laboratory for Transition Research (ELIT), vol. 2(4), pages 147-156.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:jamest:v:47:y:1996:i:7:p:568-583. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    We have no bibliographic references for this item. You can help adding them by using this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: http://www.asis.org .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.