IDEAS home Printed from https://ideas.repec.org/a/spr/compst/v18y2003i1d10.1007_s001800300134.html
   My bibliography  Save this article

Assessing the reliability of web-based statistical software

Author

Listed:
  • A. M. Kitchen

    (Utah State University)

  • R. Drachenberg

    (Utah State University)

  • J. Symanzik

    (Utah State University)

Abstract

Summary Statistical reference datasets from the National Institute of Standards and Technology were used to evaluate the accuracy and precision of two web-based statistical packages, WebStat (found at http://www.stat.sc.edu/webstat/) and Statlets (found at http://www.statlets.com/statletsindex.htm). This evaluation revealed that both packages performed reasonably well in the analysis of lower difficulty datasets, with decreasing accuracy as difficulty increases. The decrease in accuracy for datasets of higher difficulty can often be contributed to the dataset storage format (which seems to be single precision in Statlets and is double precision in WebStat). For most statistical analysis needs, the level of accuracy found in Web-Stat and Statlets would likely be unsatisfactory. Limitations of the packages are discussed and comparisons of accuracy with commercially available statistical packages are presented. WebStat and Statlets are user-friendly packages that are amenable to use as teaching tools. Thus we advise that the statistics packages we evaluated be restricted to use in teaching situations. They should not be used for the analysis of datasets with higher difficulty levels.

Suggested Citation

  • A. M. Kitchen & R. Drachenberg & J. Symanzik, 2003. "Assessing the reliability of web-based statistical software," Computational Statistics, Springer, vol. 18(1), pages 107-122, March.
    • Handle: RePEc:spr:compst:v:18:y:2003:i:1:d:10.1007_s001800300134
    DOI: 10.1007/s001800300134
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s001800300134
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s001800300134?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Sawitzki, Gunther, 1994. "Testing numerical reliability of data analysis systems," Computational Statistics & Data Analysis, Elsevier, vol. 18(2), pages 269-286, September.
    2. McCullough, B D, 1999. "Econometric Software Reliability: EViews, LIMDEP, SHAZAM and TSP," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 14(2), pages 191-202, March-Apr.
    3. H. D. Vinod, 2000. "Review of GAUSS for Windows, including its numerical accuracy," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 15(2), pages 211-220.
    4. West, Webster & Ogden, Todd, 1997. "Statistical Analysis with Webstat, a Java applet for the World Wide Web," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 2(i03).
    5. Sawitzki, Gunther, 1994. "Report on the Numerical Reliability of Data Analysis Systems," Computational Statistics & Data Analysis, Elsevier, vol. 18(2), pages 289-301, September.
    6. H. D. Vinod & B. D. McCullough, 1999. "The Numerical Reliability of Econometric Software," Journal of Economic Literature, American Economic Association, vol. 37(2), pages 633-665, June.
    7. Simon, Stephen D. & Lesage, James P., 1989. "Assessing the accuracy of ANOVA calculations in statistical software," Computational Statistics & Data Analysis, Elsevier, vol. 8(3), pages 325-332, November.
    8. H. D. Vinod & B. D. McCullough, 1999. "Corrigenda: The Numerical Reliability of Econometric Software," Journal of Economic Literature, American Economic Association, vol. 37(4), pages 1565-1565, December.
    9. Schmelzer, S. & Kötter, T. & Klinke, S. & Härdle, Wolfgang, 1996. "A New Generation of a Statistical Computing Environment on the Net," SFB 373 Discussion Papers 1996,52, Humboldt University of Berlin, Interdisciplinary Research Project 373: Quantification and Simulation of Economic Processes.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Keeling, Kellie B. & Pavur, Robert J., 2007. "A comparative study of the reliability of nine statistical software packages," Computational Statistics & Data Analysis, Elsevier, vol. 51(8), pages 3811-3831, May.
    2. A. Yalta & A. Yalta, 2010. "Should Economists Use Open Source Software for Doing Research?," Computational Economics, Springer;Society for Computational Economics, vol. 35(4), pages 371-394, April.
    3. McCullough, B.D. & Heiser, David A., 2008. "On the accuracy of statistical procedures in Microsoft Excel 2007," Computational Statistics & Data Analysis, Elsevier, vol. 52(10), pages 4570-4578, June.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. A. Yalta & A. Yalta, 2010. "Should Economists Use Open Source Software for Doing Research?," Computational Economics, Springer;Society for Computational Economics, vol. 35(4), pages 371-394, April.
    2. Oluwarotimi O. Odeh & Allen M. Featherstone & Jason S. Bergtold, 2010. "Reliability of Statistical Software," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 92(5), pages 1472-1489.
    3. McCullough, B. D., 2000. "Is it safe to assume that software is accurate?," International Journal of Forecasting, Elsevier, vol. 16(3), pages 349-357.
    4. Yalta, A. Talha & Jenal, Olaf, 2009. "On the importance of verifying forecasting results," International Journal of Forecasting, Elsevier, vol. 25(1), pages 62-73.
    5. A. Talha Yalta & A. Yasemin Yalta, 2007. "GRETL 1.6.0 and its numerical accuracy," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 22(4), pages 849-854.
    6. Reagle, Derrick P. & Vinod, H. D., 2003. "Inference for negativist theory using numerically computed rejection regions," Computational Statistics & Data Analysis, Elsevier, vol. 42(3), pages 491-512, March.
    7. Jason S. Bergtold & Krishna P. Pokharel & Allen M. Featherstone & Lijia Mo, 2018. "On the examination of the reliability of statistical software for estimating regression models with discrete dependent variables," Computational Statistics, Springer, vol. 33(2), pages 757-786, June.
    8. Bergtold, Jason S. & Pokharel, Krishna & Featherstone, Allen, 2015. "On the Examination of the Reliability of Statistical Software for Estimating Logistic Regression Models," 2015 AAEA & WAEA Joint Annual Meeting, July 26-28, San Francisco, California 205643, Agricultural and Applied Economics Association.
    9. Charles G. Renfro, 2009. "The Practice of Econometric Theory," Advanced Studies in Theoretical and Applied Econometrics, Springer, number 978-3-540-75571-5.
    10. Ooms, M., 2008. "Trends in Applied Econometrics Software Development 1985-2008, an analysis of Journal of Applied Econometrics research articles, software reviews, data and code," Serie Research Memoranda 0021, VU University Amsterdam, Faculty of Economics, Business Administration and Econometrics.
    11. Gilles Teyssière, 2005. "Structural time series modelling with STAMP 6.02," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 20(4), pages 571-577, May.
    12. Ignacio Díaz-Emparanza & Petr Mariel & María Victoria Esteban (ed.), 2009. "Econometrics with gretl. Proceedings of the gretl Conference 2009," UPV/EHU Books, Universidad del País Vasco - Facultad de Ciencias Económicas y Empresariales, edition 1, number 01, June.
    13. A. Talha Yalta & A. Yasemin Yalta, 2009. "Wilkinson Tests and gretl," EHUCHAPS, in: Ignacio Díaz-Emparanza & Petr Mariel & María Victoria Esteban (ed.), Econometrics with gretl. Proceedings of the gretl Conference 2009, edition 1, chapter 16, pages 243-251, Universidad del País Vasco - Facultad de Ciencias Económicas y Empresariales.
    14. D. McCullough, B. & Wilson, Berry, 2002. "On the accuracy of statistical procedures in Microsoft Excel 2000 and Excel XP," Computational Statistics & Data Analysis, Elsevier, vol. 40(4), pages 713-721, October.
    15. Sébastien Laurent & Luc Bauwens & Jeroen V. K. Rombouts, 2006. "Multivariate GARCH models: a survey," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 21(1), pages 79-109.
    16. Lars Vilhuber, 2024. "Report of the AEA Data Editor," AEA Papers and Proceedings, American Economic Association, vol. 114, pages 878-890, May.
    17. F. Javier Mencía & Enrique Sentana, 2004. "Estimation and Testing of Dynamic Models with Generalised Hyperbolic Innovations," Working Papers wp2004_0411, CEMFI.
    18. Jeffrey S. Zax, 2002. "Comment on “Estimating the Extent of Racially Polarized Voting in Multicandidate Contests†by Bernard Grofman and Michael Migalski," Sociological Methods & Research, , vol. 31(1), pages 75-86, August.
    19. Mencía, Javier & Sentana, Enrique, 2009. "Multivariate location-scale mixtures of normals and mean-variance-skewness portfolio allocation," Journal of Econometrics, Elsevier, vol. 153(2), pages 105-121, December.
    20. Vinod, H. D., 2001. "Care and feeding of reproducible econometrics," Journal of Econometrics, Elsevier, vol. 100(1), pages 87-88, January.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:compst:v:18:y:2003:i:1:d:10.1007_s001800300134. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.