IDEAS home Printed from https://ideas.repec.org/a/oup/rseval/v22y2012i1p30-40.html
   My bibliography  Save this article

Applying the criteria indicators and metrics evaluation method on ICT research: The HUMBOLDT project

Author

Listed:
  • Zaheer Khan
  • David Ludlow
  • Joachim Rix

Abstract

Evaluating an Information Technology (IT) based research and development project from an end-user's perspective is necessary in order to discover whether or not the outcomes of the project are successful. However, it is not straightforward to design and implement a generic user evaluation methodology that can be applied to a large-scale collaborative integrated research and development project. In this article, we share our experience based on the research evaluation carried out in a large-scale integrated ICT research project--The HUMBOLDT project. The project develops IT tools and services for cross-border geospatial data harmonization, which are applied to nine different application scenarios. A novel user-oriented evaluation methodology, namely--Criteria Indicators and Metrics (CIM)--is defined and utilized for the evaluation of the project research outcomes. The user evaluation results reveal the extent to which the research and development objectives of the project are achieved, and also demonstrate the benefits and limitations of the evaluation methodology. The results of this article can be usefully applied to other collaborative research projects in a variety of domains. Copyright The Author 2012. Published by Oxford University Press. All rights reserved. For Permissions, please email: journals.permissions@oup.com, Oxford University Press.

Suggested Citation

  • Zaheer Khan & David Ludlow & Joachim Rix, 2012. "Applying the criteria indicators and metrics evaluation method on ICT research: The HUMBOLDT project," Research Evaluation, Oxford University Press, vol. 22(1), pages 30-40, December.
    • Handle: RePEc:oup:rseval:v:22:y:2012:i:1:p:30-40
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1093/reseval/rvs037
    Download Restriction: Access to full text is restricted to subscribers.
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:oup:rseval:v:22:y:2012:i:1:p:30-40. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    We have no bibliographic references for this item. You can help adding them by using this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Oxford University Press (email available below). General contact details of provider: https://academic.oup.com/rev .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.