IDEAS home Printed from https://ideas.repec.org/a/eee/jomega/v30y2002i5p381-392.html
   My bibliography  Save this article

Influence of user participation on DSS use and decision accuracy

Author

Listed:
  • Lawrence, Michael
  • Goodwin, Paul
  • Fildes, Robert

Abstract

The paper reports a study of the impact on user satisfaction and forecast accuracy of user involvement in the design of a forecasting decision support system (FDSS). Two versions of an FDSS were tested via a laboratory study. Version 1, allowed the user control over all aspects of the system including the "look" of various screen elements and, most importantly, the model to be used could be selected (and tested) from a number of alternative forecasting models provided within the FDSS. In contrast, Version 2 did not allow the user to modify the "look" of the screen, and also provided no opportunity for model selection: this feature was carried out optimally by the FDSS. The user was told the advantage of optimal model selection. Both versions finished by asking the user to either accept the forecast (displayed as a point on the time-series graph) or to modify it via the mouse if unhappy with it. Results showed a much greater satisfaction with the forecasts provided by Version 1, confirming the importance of user involvement. Users of Version 1, in about half the cases, selected poor models with high forecast error. Where a model close to optimal was selected, the accuracy of Version 1 users greatly outperformed low involvement Version 2 users. Overall, however, the accuracy of the final forecasts for users of Version 1 was slightly inferior to that of users of Version 2. Measurements of ease of use and usefulness showed no real differences between the two versions.

Suggested Citation

  • Lawrence, Michael & Goodwin, Paul & Fildes, Robert, 2002. "Influence of user participation on DSS use and decision accuracy," Omega, Elsevier, vol. 30(5), pages 381-392, October.
    • Handle: RePEc:eee:jomega:v:30:y:2002:i:5:p:381-392
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0305-0483(02)00048-8
    Download Restriction: Full text for ScienceDirect subscribers only
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Goodwin, Paul & Wright, George, 1993. "Improving judgmental time series forecasting: A review of the guidance provided by research," International Journal of Forecasting, Elsevier, vol. 9(2), pages 147-161, August.
    2. Igbaria, M & Guimaraes, T, 1994. "Empirically testing the outcomes of user involvement in DSS development," Omega, Elsevier, vol. 22(2), pages 157-172, March.
    3. Arkes, Hal R. & Dawes, Robyn M. & Christensen, Caryn, 1986. "Factors influencing the use of a decision rule in a probabilistic task," Organizational Behavior and Human Decision Processes, Elsevier, vol. 37(1), pages 93-110, February.
    4. Davis, Fred D. & Kottemann, Jeffrey E., 1995. "Determinants of Decision Rule Use in a Production Planning Task," Organizational Behavior and Human Decision Processes, Elsevier, vol. 63(2), pages 145-157, August.
    5. Lawrence, Michael & Sim, William, 1999. "Prototyping a financial DSS," Omega, Elsevier, vol. 27(4), pages 445-450, August.
    6. Lawrence, Michael & O'Connor, Marcus & Edmundson, Bob, 2000. "A field study of sales forecasting accuracy and processes," European Journal of Operational Research, Elsevier, vol. 122(1), pages 151-160, April.
    7. Peter B. Seddon, 1997. "A Respecification and Extension of the DeLone and McLean Model of IS Success," Information Systems Research, INFORMS, vol. 8(3), pages 240-253, September.
    8. James E. Hunton & Kenneth H. Price, 1997. "Effects of the User Participation Process and Task Meaningfulness on Key Information System Outcomes," Management Science, INFORMS, vol. 43(6), pages 797-812, June.
    9. Watson, Moira C., 1996. "Forecasting in the Scottish electronics industry," International Journal of Forecasting, Elsevier, vol. 12(3), pages 361-371, September.
    10. Fildes, Robert, 1992. "The evaluation of extrapolative forecasting methods," International Journal of Forecasting, Elsevier, vol. 8(1), pages 81-98, June.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    2. De Baets, Shari & Harvey, Nigel, 2020. "Using judgment to select and adjust forecasts from statistical models," European Journal of Operational Research, Elsevier, vol. 284(3), pages 882-895.
    3. Goodwin, Paul & Fildes, Robert & Lawrence, Michael & Nikolopoulos, Konstantinos, 2007. "The process of using a forecasting support system," International Journal of Forecasting, Elsevier, vol. 23(3), pages 391-404.
    4. Adam Seth Litwin, 2011. "Technological Change at Work: The Impact of Employee Involvement on the Effectiveness of Health Information Technology," ILR Review, Cornell University, ILR School, vol. 64(5), pages 863-888, October.
    5. Önkal, Dilek & Lawrence, Michael & Zeynep SayIm, K., 2011. "Influence of differentiated roles on group forecasting accuracy," International Journal of Forecasting, Elsevier, vol. 27(1), pages 50-68, January.
    6. Lee, Wing Yee & Goodwin, Paul & Fildes, Robert & Nikolopoulos, Konstantinos & Lawrence, Michael, 2007. "Providing support for the use of analogies in demand forecasting tasks," International Journal of Forecasting, Elsevier, vol. 23(3), pages 377-390.
    7. Arvan, Meysam & Fahimnia, Behnam & Reisi, Mohsen & Siemsen, Enno, 2019. "Integrating human judgement into quantitative forecasting methods: A review," Omega, Elsevier, vol. 86(C), pages 237-252.
    8. Önkal, Dilek & Lawrence, Michael & Zeynep Sayım, K., 2011. "Influence of differentiated roles on group forecasting accuracy," International Journal of Forecasting, Elsevier, vol. 27(1), pages 50-68.
    9. Önkal, Dilek & Zeynep Sayım, K. & Lawrence, Michael, 2012. "Wisdom of group forecasts: Does role-playing play a role?," Omega, Elsevier, vol. 40(6), pages 693-702.
    10. Franses, Philip Hans & Legerstee, Rianne, 2013. "Do statistical forecasting models for SKU-level data benefit from including past expert knowledge?," International Journal of Forecasting, Elsevier, vol. 29(1), pages 80-87.
    11. Lawrence, Michael & Goodwin, Paul & O'Connor, Marcus & Onkal, Dilek, 2006. "Judgmental forecasting: A review of progress over the last 25 years," International Journal of Forecasting, Elsevier, vol. 22(3), pages 493-518.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Welch, Eric & Bretschneider, Stuart & Rohrbaugh, John, 1998. "Accuracy of judgmental extrapolation of time series data: Characteristics, causes, and remediation strategies for forecasting," International Journal of Forecasting, Elsevier, vol. 14(1), pages 95-110, March.
    2. Arvan, Meysam & Fahimnia, Behnam & Reisi, Mohsen & Siemsen, Enno, 2019. "Integrating human judgement into quantitative forecasting methods: A review," Omega, Elsevier, vol. 86(C), pages 237-252.
    3. Lawrence, Michael & Sim, William, 1999. "Prototyping a financial DSS," Omega, Elsevier, vol. 27(4), pages 445-450, August.
    4. Harvey, Nigel & Bolger, Fergus, 1996. "Graphs versus tables: Effects of data presentation format on judgemental forecasting," International Journal of Forecasting, Elsevier, vol. 12(1), pages 119-137, March.
    5. Kathleen M. Sutcliffe & Gerry McNamara, 2001. "Controlling Decision-Making Practice in Organizations," Organization Science, INFORMS, vol. 12(4), pages 484-501, August.
    6. Goodwin, Paul & Lawton, Richard, 2003. "Debiasing forecasts: how useful is the unbiasedness test?," International Journal of Forecasting, Elsevier, vol. 19(3), pages 467-475.
    7. Perera, H. Niles & Hurley, Jason & Fahimnia, Behnam & Reisi, Mohsen, 2019. "The human factor in supply chain forecasting: A systematic review," European Journal of Operational Research, Elsevier, vol. 274(2), pages 574-600.
    8. Leitner, Johannes & Leopold-Wildburger, Ulrike, 2011. "Experiments on forecasting behavior with several sources of information - A review of the literature," European Journal of Operational Research, Elsevier, vol. 213(3), pages 459-469, September.
    9. Goodwin, Paul, 2000. "Correct or combine? Mechanically integrating judgmental forecasts with statistical methods," International Journal of Forecasting, Elsevier, vol. 16(2), pages 261-275.
    10. Pollock, Andrew C. & Macaulay, Alex & Onkal-Atay, Dilek & Wilkie-Thomson, Mary E., 1999. "Evaluating predictive performance of judgemental extrapolations from simulated currency series," European Journal of Operational Research, Elsevier, vol. 114(2), pages 281-293, April.
    11. Diamantopoulos, Adamantios & Winklhofer, Heidi, 2003. "Export sales forecasting by UK firms: Technique utilization and impact on forecast accuracy," Journal of Business Research, Elsevier, vol. 56(1), pages 45-54, January.
    12. Kalchschmidt, Matteo, 2012. "Best practices in demand forecasting: Tests of universalistic, contingency and configurational theories," International Journal of Production Economics, Elsevier, vol. 140(2), pages 782-793.
    13. Abolghasemi, Mahdi & Hurley, Jason & Eshragh, Ali & Fahimnia, Behnam, 2020. "Demand forecasting in the presence of systematic events: Cases in capturing sales promotions," International Journal of Production Economics, Elsevier, vol. 230(C).
    14. Lin, Vera Shanshan & Goodwin, Paul & Song, Haiyan, 2014. "Accuracy and bias of experts’ adjusted forecasts," Annals of Tourism Research, Elsevier, vol. 48(C), pages 156-174.
    15. Lawrence, Michael & Goodwin, Paul & O'Connor, Marcus & Onkal, Dilek, 2006. "Judgmental forecasting: A review of progress over the last 25 years," International Journal of Forecasting, Elsevier, vol. 22(3), pages 493-518.
    16. J. J. Po-An Hsieh & Arun Rai & Sean Xin Xu, 2011. "Extracting Business Value from IT: A Sensemaking Perspective of Post-Adoptive Use," Management Science, INFORMS, vol. 57(11), pages 2018-2039, November.
    17. Abdesamad Zouine & Pierre Fenies, 2014. "The Critical Success Factors Of The ERP System Project: A Meta-Analysis Methodology," Post-Print hal-01419785, HAL.
    18. Dwiza Riana & Achmad Nizar Hidayanto & Sri Hadianti & Darmawan Napitupulu, 2021. "Integrative Factors of E-Health Laboratory Adoption: A Case of Indonesia," Future Internet, MDPI, vol. 13(2), pages 1-27, January.
    19. Garcia-Ferrer, Antonio & Bujosa-Brun, Marcos, 2000. "Forecasting OECD industrial turning points using unobserved components models with business survey data," International Journal of Forecasting, Elsevier, vol. 16(2), pages 207-227.
    20. Fildes, Robert & Goodwin, Paul & Lawrence, Michael & Nikolopoulos, Konstantinos, 2009. "Effective forecasting and judgmental adjustments: an empirical evaluation and strategies for improvement in supply-chain planning," International Journal of Forecasting, Elsevier, vol. 25(1), pages 3-23.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jomega:v:30:y:2002:i:5:p:381-392. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/375/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.