IDEAS home Printed from https://ideas.repec.org/a/spr/scient/v128y2023i6d10.1007_s11192-022-04539-8.html
   My bibliography  Save this article

Use of accounting concepts to study research: return on investment in XSEDE, a US cyberinfrastructure service

Author

Listed:
  • Craig A. Stewart

    (University of Illinois at Urbana-Champaign
    Indiana University)

  • Claudia M. Costa

    (Indiana University)

  • Julie A. Wernert

    (Indiana University)

  • Winona Snapp-Childs

    (Indiana University)

  • Marques Bland

    (University of Texas at Austin)

  • Philip Blood

    (Carnegie Mellon University)

  • Terry Campbell

    (Indiana University)

  • Peter Couvares

    (California Institute of Technology)

  • Jeremy Fischer

    (Indiana University)

  • David Y. Hancock

    (Indiana University)

  • David L. Hart

    (University Corporation for Atmospheric Research)

  • Harmony Jankowski

    (Indiana University)

  • Richard Knepper

    (Cornell University)

  • Donald F. McMullen

    (Indiana University)

  • Susan Mehringer

    (Cornell University)

  • Marlon Pierce

    (Indiana University)

  • Gary Rogers

    (University of Tennessee at Knoxville)

  • Robert S. Sinkovits

    (University of California San Diego)

  • John Towns

    (University of Illinois at Urbana-Champaign)

Abstract

This paper uses accounting concepts—particularly the concept of Return on Investment (ROI)—to reveal the quantitative value of scientific research pertaining to a major US cyberinfrastructure project (XSEDE—the eXtreme Science and Engineering Discovery Environment). XSEDE provides operational and support services for advanced information technology systems, cloud systems, and supercomputers supporting non-classified US research, with an average budget for XSEDE of US$20M+ per year over the period studied (2014–2021). To assess the financial effectiveness of these services, we calculated a proxy for ROI, and converted quantitative measures of XSEDE service delivery into financial values using costs for service from the US marketplace. We calculated two estimates of ROI: a Conservative Estimate, functioning as a lower bound and using publicly available data for a lower valuation of XSEDE services; and a Best Available Estimate, functioning as a more accurate estimate, but using some unpublished valuation data. Using the largest dataset assembled for analysis of ROI for a cyberinfrastructure project, we found a Conservative Estimate of ROI of 1.87, and a Best Available Estimate of ROI of 3.24. Through accounting methods, we show that XSEDE services offer excellent value to the US government, that the services offered uniquely by XSEDE (that is, not otherwise available for purchase) were the most valuable to the facilitation of US research activities, and that accounting-based concepts hold great value for understanding the mechanisms of scientific research generally.

Suggested Citation

  • Craig A. Stewart & Claudia M. Costa & Julie A. Wernert & Winona Snapp-Childs & Marques Bland & Philip Blood & Terry Campbell & Peter Couvares & Jeremy Fischer & David Y. Hancock & David L. Hart & Harm, 2023. "Use of accounting concepts to study research: return on investment in XSEDE, a US cyberinfrastructure service," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(6), pages 3225-3255, June.
    • Handle: RePEc:spr:scient:v:128:y:2023:i:6:d:10.1007_s11192-022-04539-8
    DOI: 10.1007/s11192-022-04539-8
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11192-022-04539-8
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11192-022-04539-8?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Amy Apon & Linh Ngo & Michael Payne & Paul Wilson, 2015. "Assessing the effect of high performance computing capabilities on academic research output," Empirical Economics, Springer, vol. 48(1), pages 283-312, February.
    2. Richard Knepper & Katy Börner, 2016. "Comparing the Consumption of CPU Hours with Scientific Output for the Extreme Science and Engineering Discovery Environment (XSEDE)," PLOS ONE, Public Library of Science, vol. 11(6), pages 1-14, June.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Kneip, Alois & Simar, Léopold & Wilson, Paul W., 2022. "Conical FDH Estimators of General Technologies, with Applications to Returns to Scale and Malmquist Productivity Indices," LIDAM Discussion Papers ISBA 2022024, Université catholique de Louvain, Institute of Statistics, Biostatistics and Actuarial Sciences (ISBA).
    2. Léopold Simar & Paul W. Wilson, 2023. "Another look at productivity growth in industrialized countries," Journal of Productivity Analysis, Springer, vol. 60(3), pages 257-272, December.
    3. Wilson, Paul W., 2018. "Dimension reduction in nonparametric models of production," European Journal of Operational Research, Elsevier, vol. 267(1), pages 349-367.

    More about this item

    Keywords

    XSEDE; TeraGrid; Cyberinfrastructure; Supercomputing; HPC; eScience; Return on Investment; Cost efficiency; Cloud computing in research; COVID-19;
    All these keywords.

    JEL classification:

    • I23 - Health, Education, and Welfare - - Education - - - Higher Education; Research Institutions
    • M15 - Business Administration and Business Economics; Marketing; Accounting; Personnel Economics - - Business Administration - - - IT Management
    • O31 - Economic Development, Innovation, Technological Change, and Growth - - Innovation; Research and Development; Technological Change; Intellectual Property Rights - - - Innovation and Invention: Processes and Incentives
    • O32 - Economic Development, Innovation, Technological Change, and Growth - - Innovation; Research and Development; Technological Change; Intellectual Property Rights - - - Management of Technological Innovation and R&D
    • O38 - Economic Development, Innovation, Technological Change, and Growth - - Innovation; Research and Development; Technological Change; Intellectual Property Rights - - - Government Policy

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:scient:v:128:y:2023:i:6:d:10.1007_s11192-022-04539-8. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.