IDEAS home Printed from https://ideas.repec.org/a/eee/jomega/v29y2001i5p391-404.html
   My bibliography  Save this article

Detecting errors in data: clarification of the impact of base rate expectations and incentives

Author

Listed:
  • Klein, Barbara D.

Abstract

Organizational databases have a significant rate of data errors and detecting and correcting these errors can be problematic. This paper builds on a stream of research demonstrating that users of these databases can detect data errors under certain circumstances. A theory of error detection and research on the effect of base rate expectations in probabilistic judgement tasks are applied to the development of two propositions about error detection. It is argued that expectations about the base rate of errors in data affect error detection performance when they are developed through direct experience and that incentives affect error detection performance. The two research propositions are tested in a laboratory experiment. Experience-based expectations about the base rate of errors and incentives are found to affect error detection performance.

Suggested Citation

  • Klein, Barbara D., 2001. "Detecting errors in data: clarification of the impact of base rate expectations and incentives," Omega, Elsevier, vol. 29(5), pages 391-404, October.
    • Handle: RePEc:eee:jomega:v:29:y:2001:i:5:p:391-404
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0305-0483(01)00029-9
    Download Restriction: Full text for ScienceDirect subscribers only
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Donald P. Ballou & Harold L. Pazer, 1985. "Modeling Data and Process Quality in Multi-Input, Multi-Output Information Systems," Management Science, INFORMS, vol. 31(2), pages 150-162, February.
    2. David M. Grether, 1980. "Bayes Rule as a Descriptive Model: The Representativeness Heuristic," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 95(3), pages 537-557.
    3. Ballou, Donald P & Pazer, Harold L, 1987. "Cost/quality tradeoffs for control procedures in information systems," Omega, Elsevier, vol. 15(6), pages 509-521.
    4. Donald P. Ballou & Harold L. Pazer, 1982. "The Impact of Inspector Fallibility on the Inspection Policy in Serial Production Systems," Management Science, INFORMS, vol. 28(4), pages 387-399, April.
    5. Marie Christine Roy & F. Javier Lerch, 1996. "Overcoming Ineffective Mental Representations in Base-Rate Problems," Information Systems Research, INFORMS, vol. 7(2), pages 233-247, June.
    6. Barbara D. Klein, 1997. "How Do Actuaries Use Data Containing Errors?: Models of Error Detection and Error Correction," Information Resources Management Journal (IRMJ), IGI Global, vol. 10(4), pages 27-36, October.
    7. Butt, Jl, 1988. "Frequency Judgments In An Auditing-Related Task," Journal of Accounting Research, Wiley Blackwell, vol. 26(2), pages 315-330.
    8. Parasuraman, A., 1981. "Hang on to the marketing concept!," Business Horizons, Elsevier, vol. 24(5), pages 38-40.
    9. Anil Gaba & Robert L. Winkler, 1992. "Implications of Errors in Survey Data: A Bayesian Model," Management Science, INFORMS, vol. 38(7), pages 913-925, July.
    10. Donald P. Ballou & Harold L. Pazer, 1995. "Designing Information Systems to Optimize the Accuracy-Timeliness Tradeoff," Information Systems Research, INFORMS, vol. 6(1), pages 51-72, March.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Benjamin Enke & Uri Gneezy & Brian Hall & David Martin & Vadim Nelidov & Theo Offerman & Jeroen van de Ven, 2020. "Cognitive Biases: Mistakes or Missing Stakes?," CESifo Working Paper Series 8168, CESifo.
    2. Stephan Leitner, 2014. "A simulation analysis of interactions among intended biases in costing systems and their effects on the accuracy of decision-influencing information," Central European Journal of Operations Research, Springer;Slovak Society for Operations Research;Hungarian Operational Research Society;Czech Society for Operations Research;Österr. Gesellschaft für Operations Research (ÖGOR);Slovenian Society Informatika - Section for Operational Research;Croatian Operational Research Society, vol. 22(1), pages 113-138, March.
    3. Sundararaghavan, P.S. & Kunnathur, Anand & Fang, Xiao, 2010. "Sequencing questions to ferret out terrorists: Models and heuristics," Omega, Elsevier, vol. 38(1-2), pages 12-19, February.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Donald Ballou & Richard Wang & Harold Pazer & Giri Kumar Tayi, 1998. "Modeling Information Manufacturing Systems to Determine Information Product Quality," Management Science, INFORMS, vol. 44(4), pages 462-484, April.
    2. Klein, B. D. & Rossin, D. F., 1999. "Data quality in neural network models: effect of error rate and magnitude of error on predictive accuracy," Omega, Elsevier, vol. 27(5), pages 569-582, October.
    3. Daniel J. Benjamin, 2018. "Errors in Probabilistic Reasoning and Judgment Biases," NBER Working Papers 25200, National Bureau of Economic Research, Inc.
    4. Jingran Wang & Yi Liu & Peigong Li & Zhenxing Lin & Stavros Sindakis & Sakshi Aggarwal, 2024. "Overview of Data Quality: Examining the Dimensions, Antecedents, and Impacts of Data Quality," Journal of the Knowledge Economy, Springer;Portland International Center for Management of Engineering and Technology (PICMET), vol. 15(1), pages 1159-1178, March.
    5. Xiao, Yu & Lu, Louis Y.Y. & Liu, John S. & Zhou, Zhili, 2014. "Knowledge diffusion path analysis of data quality literature: A main path analysis," Journal of Informetrics, Elsevier, vol. 8(3), pages 594-605.
    6. Bettina Distel & Holger Koelmann & Ralf Plattfaut & Jörg Becker, 2022. "Watch who you trust! A structured literature review to build a typology of e-government risks," Information Systems and e-Business Management, Springer, vol. 20(4), pages 789-818, December.
    7. Roman Lukyanenko & Jeffrey Parsons & Yolanda F. Wiersma, 2014. "The IQ of the Crowd: Understanding and Improving Information Quality in Structured User-Generated Content," Information Systems Research, INFORMS, vol. 25(4), pages 669-689, December.
    8. Lurås, Hilde, 2009. "A healthy lifestyle: The product of opportunities and preferences," HERO Online Working Paper Series 2001:11, University of Oslo, Health Economics Research Programme.
    9. Dohmen, Thomas & Falk, Armin & Huffman, David & Marklein, Felix & Sunde, Uwe, 2009. "Biased probability judgment: Evidence of incidence and relationship to economic outcomes from a representative sample," Journal of Economic Behavior & Organization, Elsevier, vol. 72(3), pages 903-915, December.
    10. Al-Kandari Noriah M. & Lahiri Partha, 2016. "Prediction of a Function of Misclassified Binary Data," Statistics in Transition New Series, Statistics Poland, vol. 17(3), pages 429-447, September.
    11. Lex Borghans & Bas ter Weel, 2008. "Understanding the Technology of Computer Technology Diffusion: Explaining Computer Adoption Patterns and Implications for the Wage Structure," Journal of Income Distribution, Ad libros publications inc., vol. 17(3-4), pages 37-70, September.
    12. Maria R. Ibanez & Michael W. Toffel, 2020. "How Scheduling Can Bias Quality Assessment: Evidence from Food-Safety Inspections," Management Science, INFORMS, vol. 66(6), pages 2396-2416, June.
    13. David M. Frankel, 2008. "Adaptive Expectations And Stock Market Crashes," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 49(2), pages 595-619, May.
    14. Risto Silvola & Janne Harkonen & Olli Vilppola & Hanna Kropsu-Vehkapera & Harri Haapasalo, 2016. "Data quality assessment and improvement," International Journal of Business Information Systems, Inderscience Enterprises Ltd, vol. 22(1), pages 62-81.
    15. Markus Schöbel & Jörg Rieskamp & Rafael Huber, 2016. "Social Influences in Sequential Decision Making," PLOS ONE, Public Library of Science, vol. 11(1), pages 1-23, January.
    16. David L. Dickinson & Eugenio Caleb Garbuio, 2020. "The Influence of Dietary Patterns on Outcomes in a Bayesian Choice Task," Working Papers 21-01, Department of Economics, Appalachian State University.
    17. Jason Shachat & Anand Srinivasan, 2022. "Informational Price Cascades and Non-Aggregation of Asymmetric Information in Experimental Asset Markets," Journal of Behavioral Finance, Taylor & Francis Journals, vol. 23(4), pages 388-407, November.
    18. Dohmen, T.J. & Falk, A. & Huffman, D. & Marklein, F. & Sunde, U., 2009. "The non-use of Bayes rule: representative evidence on bounded rationality," Research Memorandum 038, Maastricht University, Maastricht Research School of Economics of Technology and Organization (METEOR).
    19. Nicolas Jacquemet & Alexander James & Stéphane Luchini & Jason Shogren, 2011. "Social Psychology and Environmental Economics: A New Look at ex ante Corrections of Biased Preference Evaluation," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 48(3), pages 413-433, March.
    20. Goeree, Jacob K. & Offerman, Theo, 2003. "Winner's curse without overbidding," European Economic Review, Elsevier, vol. 47(4), pages 625-644, August.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jomega:v:29:y:2001:i:5:p:391-404. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/375/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.