IDEAS home Printed from https://ideas.repec.org/a/sae/medema/v32y2012i6p840-850.html
   My bibliography  Save this article

How Well Do Commonly Used Data Presentation Formats Support Comparative Effectiveness Evaluations?

Author

Listed:
  • James G. Dolan
  • Feng Qian
  • Peter J. Veazie

Abstract

Background. Good decisions depend on an accurate understanding of the comparative effectiveness of decision alternatives. The best way to convey data needed to support these comparisons is unknown. Objective. To determine how well 5 commonly used data presentation formats convey comparative effectiveness information. Methods. The study was an Internet survey using a factorial design. Participants consisted of 279 members of an online survey panel. Study participants compared outcomes associated with 3 hypothetical screening test options relative to 5 possible outcomes with probabilities ranging from 2 per 5000 (0.04%) to 500 per 1000 (50%). Data presentation formats included a table, a “magnified†bar chart, a risk scale, a frequency diagram, and an icon array. Outcomes included the number of correct ordinal judgments regarding the more likely of 2 outcomes, the ratio of perceived versus actual relative likelihoods of the paired outcomes, the intersubject consistency of responses, and perceived clarity. Results. The mean number of correct ordinal judgments was 12 of 15 (80%), with no differences among data formats. On average, there was a 3.3-fold difference between perceived and actual likelihood ratios (95% confidence interval = 3.0–3.6). Comparative judgments based on flowcharts, icon arrays, and tables were all significantly more accurate and consistent than those based on risk scales and bar charts ( P

Suggested Citation

  • James G. Dolan & Feng Qian & Peter J. Veazie, 2012. "How Well Do Commonly Used Data Presentation Formats Support Comparative Effectiveness Evaluations?," Medical Decision Making, , vol. 32(6), pages 840-850, November.
    • Handle: RePEc:sae:medema:v:32:y:2012:i:6:p:840-850
    DOI: 10.1177/0272989X12445284
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.1177/0272989X12445284
    Download Restriction: no
    File URL: https://libkey.io/10.1177/0272989X12445284?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Neil D. Weinstein & Peter M. Sandman, 1993. "Some Criteria for Evaluating Risk Messages," Risk Analysis, John Wiley & Sons, vol. 13(1), pages 103-114, February.
    2. Vivianne H. M. Visschers & Ree M. Meertens & Wim W. F. Passchier & Nanne N. K. De Vries, 2009. "Probability Information in Risk Communication: A Review of the Research Literature," Risk Analysis, John Wiley & Sons, vol. 29(2), pages 267-287, February.
    3. Rebecca Hess & Vivianne H.M. Visschers & Michael Siegrist & Carmen Keller, 2011. "How do people perceive graphical risk communication? The role of subjective numeracy," Journal of Risk Research, Taylor & Francis Journals, vol. 14(1), pages 47-61, January.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Lyndal J. Trevena & Carissa Bonner & Yasmina Okan & Ellen Peters & Wolfgang Gaissmaier & Paul K. J. Han & Elissa Ozanne & Danielle Timmermans & Brian J. Zikmund-Fisher, 2021. "Current Challenges When Using Numbers in Patient Decision Aids: Advanced Concepts," Medical Decision Making, , vol. 41(7), pages 834-847, October.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Jantsje M. Mol & W. J. Wouter Botzen & Julia E. Blasch & Hans de Moel, 2020. "Insights into Flood Risk Misperceptions of Homeowners in the Dutch River Delta," Risk Analysis, John Wiley & Sons, vol. 40(7), pages 1450-1468, July.
    2. repec:cup:judgdm:v:9:y:2014:i:5:p:420-432 is not listed on IDEAS
    3. Bryan L. Williams & Sylvia Brown & Michael Greenberg & Mokbul A. Kahn, 1999. "Risk Perception in Context: The Savannah River Site Stakeholder Study," Risk Analysis, John Wiley & Sons, vol. 19(6), pages 1019-1035, December.
    4. Eric R. Stone & Wändi Bruine de Bruin & Abigail M. Wilkins & Emily M. Boker & Jacqueline MacDonald Gibson, 2017. "Designing Graphs to Communicate Risks: Understanding How the Choice of Graphical Format Influences Decision Making," Risk Analysis, John Wiley & Sons, vol. 37(4), pages 612-628, April.
    5. Warut Khern-am-nuai & Matthew J. Hashim & Alain Pinsonneault & Weining Yang & Ninghui Li, 2023. "Augmenting Password Strength Meter Design Using the Elaboration Likelihood Model: Evidence from Randomized Experiments," Information Systems Research, INFORMS, vol. 34(1), pages 157-177, March.
    6. Timmons, Shane & Robertson, Deirdre & Lunn, Pete, 2022. "Combining nudges and boosts to increase precautionary saving: A large-scale field experiment," Papers WP722, Economic and Social Research Institute (ESRI).
    7. Carmen Keller & Christina Kreuzmair & Rebecca Leins-Hess & Michael Siegrist, 2014. "Numeric and graphic risk information processing of high and low numerates in the intuitive and deliberative decision modes: An eye-tracker study," Judgment and Decision Making, Society for Judgment and Decision Making, vol. 9(5), pages 420-432, September.
    8. Tanja Perko & Baldwin van Gorp & Catrinel Turcanu & Peter Thijssen & Benny Carle, 2013. "Communication in Nuclear Emergency Preparedness: A Closer Look at Information Reception," Risk Analysis, John Wiley & Sons, vol. 33(11), pages 1987-2001, November.
    9. Nancy A. Connelly & Barbara A. Knuth, 1998. "Evaluating Risk Communication: Examining Target Audience Perceptions About Four Presentation Formats for Fish Consumption Health Advisory Information," Risk Analysis, John Wiley & Sons, vol. 18(5), pages 649-659, October.
    10. repec:cup:judgdm:v:12:y:2017:i:2:p:128-139 is not listed on IDEAS
    11. Joseph Daron & Susanne Lorenz & Andrea Taylor & Suraje Dessai, 2021. "Communicating future climate projections of precipitation change," Climatic Change, Springer, vol. 166(1), pages 1-20, May.
    12. Chris M. R. Smerecnik & Ilse Mesters & Loes T. E. Kessels & Robert A. C. Ruiter & Nanne K. De Vries & Hein De Vries, 2010. "Understanding the Positive Effects of Graphical Risk Information on Comprehension: Measuring Attention Directed to Written, Tabular, and Graphical Risk Information," Risk Analysis, John Wiley & Sons, vol. 30(9), pages 1387-1398, September.
    13. Nathaniel J. S. Ashby, 2017. "Numeracy predicts preference consistency: Deliberative search heuristics increase choice consistency for choices from description and experience," Judgment and Decision Making, Society for Judgment and Decision Making, vol. 12(2), pages 128-139, March.
    14. Lyndal J. Trevena & Carissa Bonner & Yasmina Okan & Ellen Peters & Wolfgang Gaissmaier & Paul K. J. Han & Elissa Ozanne & Danielle Timmermans & Brian J. Zikmund-Fisher, 2021. "Current Challenges When Using Numbers in Patient Decision Aids: Advanced Concepts," Medical Decision Making, , vol. 41(7), pages 834-847, October.
    15. Hao‐Che Wu & Michael K. Lindell & Carla S. Prater & Charles D. Samuelson, 2014. "Effects of Track and Threat Information on Judgments of Hurricane Strike Probability," Risk Analysis, John Wiley & Sons, vol. 34(6), pages 1025-1039, June.
    16. Tatyana Kushner & Angelyn Fairchild & F. Reed Johnson & Bruce E. Sands & Uma Mahadevan & Sreedhar Subramanian & Ashwin Ananthakrishnan & Christina Ha & Meenakshi Bewtra, 2022. "Women’s Willingness to Accept Risks of Medication for Inflammatory Bowel Disease During Pregnancy," The Patient: Patient-Centered Outcomes Research, Springer;International Academy of Health Preference Research, vol. 15(3), pages 353-365, May.
    17. Xi Wang & Liang Tang & Linan Zhang & Jie Zheng, 2022. "Initial Stage of the COVID-19 Pandemic: A Perspective on Health Risk Communications in the Restaurant Industry," IJERPH, MDPI, vol. 19(19), pages 1-20, September.
    18. Carissa Bonner & Jesse Jansen & Ben R. Newell & Les Irwig & Armando Teixeira-Pinto & Paul Glasziou & Jenny Doust & Shannon McKinn & Kirsten McCaffery, 2015. "Is the “Heart Age†Concept Helpful or Harmful Compared to Absolute Cardiovascular Disease Risk? An Experimental Study," Medical Decision Making, , vol. 35(8), pages 967-978, November.
    19. Claire M. White & Michaela Gummerum & Yaniv Hanoch, 2015. "Adolescents’ and Young Adults’ Online Risk Taking: The Role of Gist and Verbatim Representations," Risk Analysis, John Wiley & Sons, vol. 35(8), pages 1407-1422, August.
    20. Branden B. Johnson, 2003. "Communicating Air Quality Information: Experimental Evaluation of Alternative Formats," Risk Analysis, John Wiley & Sons, vol. 23(1), pages 91-103, February.
    21. Aleksandr Sinayev & Ellen Peters & Martin Tusler & Liana Fraenkel, 2015. "Presenting Numeric Information with Percentages and Descriptive Risk Labels," Medical Decision Making, , vol. 35(8), pages 937-947, November.
    22. Donald W. Hine & Kirsten Clarke & Anthony D. G. Marks & Methuen I. Morgan, 2019. "Feelings About Fracking: Using the Affect Heuristic to Understand Opposition to Coal Seam Gas Production," Risk Analysis, John Wiley & Sons, vol. 39(3), pages 586-598, March.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:medema:v:32:y:2012:i:6:p:840-850. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.