IDEAS home Printed from https://ideas.repec.org/a/wly/isacfm/v2y1993i2p81-99.html
   My bibliography  Save this article

Evaluating Expert Systems in a Financial Domain: A Study Demonstrating Issues in Case Selection, Validation Standards and Evaluator Bias

Author

Listed:
  • Carol E. Brown
  • Norma L. Nielson
  • Mary Ellen Phillips

Abstract

This article describes and generalizes a validation study of four commercially available personal financial planning expert systems and the rationale for the research methodology used. Our evaluation of these systems adds to the understanding of verification and validation issues related to case selection, validation standards and evaluator bias. The article describes the systems, their domain and the empirical method—field tests using hypothetical cases—and relates that method to the literature. Comparing same‐task systems combines multiple system perspectives and multiple models. Our methodology did efficiently and effectively identify conflicting terminology, omissions and system weaknesses but was inadequate for comparing the complex plan recommendations. The results re‐emphasize the importance of continual knowledge base updating, formal system testing and the need for external evaluation. The results also show the value of comparing multiple, same‐task systems.

Suggested Citation

  • Carol E. Brown & Norma L. Nielson & Mary Ellen Phillips, 1993. "Evaluating Expert Systems in a Financial Domain: A Study Demonstrating Issues in Case Selection, Validation Standards and Evaluator Bias," Intelligent Systems in Accounting, Finance and Management, John Wiley & Sons, Ltd., vol. 2(2), pages 81-99, April.
    • Handle: RePEc:wly:isacfm:v:2:y:1993:i:2:p:81-99
    DOI: 10.1002/j.1099-1174.1993.tb00035.x
    as

    Download full text from publisher

    File URL: https://doi.org/10.1002/j.1099-1174.1993.tb00035.x
    Download Restriction: no
    File URL: https://libkey.io/10.1002/j.1099-1174.1993.tb00035.x?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Gene Rowe & George Wright, 1993. "Expert Systems in Insurance: A Review and Analysis," Intelligent Systems in Accounting, Finance and Management, John Wiley & Sons, Ltd., vol. 2(2), pages 129-145, April.
    2. Carol E. Brown, 1992. "Analysis of Accounting Expert Systems Citations: An Alternative Accounting Classification Scheme," Intelligent Systems in Accounting, Finance and Management, John Wiley & Sons, Ltd., vol. 1(3), pages 221-231, September.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. George Wright & Gene Rowe, 1993. "Expert Systems in the UK Life Insurance Industry: Current Status and Future Trends," Intelligent Systems in Accounting, Finance and Management, John Wiley & Sons, Ltd., vol. 2(2), pages 113-127, April.
    2. George Wright & Fergus Bolger & Gene Rowe, 2002. "An Empirical Test of the Relative Validity of Expert and Lay Judgments of Risk," Risk Analysis, John Wiley & Sons, vol. 22(6), pages 1107-1122, December.
    3. Carol E. Brown & Uma G. Gupta, 1994. "Applying Case‐Based Reasoning to the Accounting Domain," Intelligent Systems in Accounting, Finance and Management, John Wiley & Sons, Ltd., vol. 3(3), pages 205-221, August.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wly:isacfm:v:2:y:1993:i:2:p:81-99. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: http://www.interscience.wiley.com/jpages/1099-1174/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.