IDEAS home Printed from https://ideas.repec.org/a/eee/eejocm/v52y2024ics1755534524000265.html
   My bibliography  Save this article

Level overlap and level color coding revisited: Improved attribute attendance and higher choice consistency in discrete choice experiments

Author

Listed:
  • Jonker, Marcel F.

Abstract

Previous work has identified attribute level overlap and level color coding as effective and attractive strategies to reduce task complexity and improve behavioral efficiency in discrete choice experiments (DCEs). However, the simultaneous and combined impact of level overlap and level color coding on attribute non-attendance and choice consistency has not yet been investigated. To address this limitation and to strengthen the available evidence base, this paper re-analyzed an existing randomized controlled DCE from the Netherlands (N = 2,731) and analyzed a new randomized controlled DCE conducted in the United Kingdom (N = 3,084) using heteroskedastic attribute non-attendance mixed logit models. Both randomized controlled experiments were based on a relatively complex instrument with 5 attributes with 5 levels each and the results from both experiments were remarkably similar. In the base-case study arms without level overlap and color coding, only about half of the attributes are attended to. Level color coding as a stand-alone strategy improves attribute attendance but reduces respondents' choice consistency. In contrast, level overlap as a stand-alone strategy improves attribute attendance while simultaneously increasing respondents' choice consistency. The combination of level overlap and color coding is even more effective: it results in approximately full attribute attendance and a 30% increase in respondents' choice consistency. Experimental designs with level overlap are therefore recommended as a default design strategy and level color coding recommended to further increase respondents’ behavioral efficiency in complex DCEs.

Suggested Citation

  • Jonker, Marcel F., 2024. "Level overlap and level color coding revisited: Improved attribute attendance and higher choice consistency in discrete choice experiments," Journal of choice modelling, Elsevier, vol. 52(C).
    • Handle: RePEc:eee:eejocm:v:52:y:2024:i:c:s1755534524000265
    DOI: 10.1016/j.jocm.2024.100494
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S1755534524000265
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.jocm.2024.100494?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Marcel F. Jonker & Arthur E. Attema & Bas Donkers & Elly A. Stolk & Matthijs M. Versteegh, 2017. "Are Health State Valuations from the General Public Biased? A Test of Health State Reference Dependency Using Self‐assessed Health and an Efficient Discrete Choice Experiment," Health Economics, John Wiley & Sons, Ltd., vol. 26(12), pages 1534-1547, December.
    2. Esther Bekker-Grob & Bas Donkers & Marcel Jonker & Elly Stolk, 2015. "Sample Size Requirements for Discrete-Choice Experiments in Healthcare: a Practical Guide," The Patient: Patient-Centered Outcomes Research, Springer;International Academy of Health Preference Research, vol. 8(5), pages 373-384, October.
    3. Johnson, F. Reed & Ozdemir, Semra & Phillips, Kathryn A., 2010. "Effects of simplifying choice tasks on estimates of taste heterogeneity in stated-choice surveys," Social Science & Medicine, Elsevier, vol. 70(2), pages 183-190, January.
    4. Jorien Veldwijk & Stella Maria Marceta & Joffre Dan Swait & Stefan Adriaan Lipman & Esther Wilhelmina Bekker-Grob, 2023. "Taking the Shortcut: Simplifying Heuristics in Discrete Choice Experiments," The Patient: Patient-Centered Outcomes Research, Springer;International Academy of Health Preference Research, vol. 16(4), pages 301-315, July.
    5. Caussade, Sebastián & Ortúzar, Juan de Dios & Rizzi, Luis I. & Hensher, David A., 2005. "Assessing the influence of design dimensions on stated choice experiment estimates," Transportation Research Part B: Methodological, Elsevier, vol. 39(7), pages 621-640, August.
    6. C. M. Dieteren & I. Bonfrer & W. B. F. Brouwer & J. Exel, 2023. "Public preferences for policies promoting a healthy diet: a discrete choice experiment," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 24(9), pages 1429-1440, December.
    7. Himmler, Sebastian & Soekhai, Vikas & van Exel, Job & Brouwer, Werner, 2021. "What works better for preference elicitation among older people? Cognitive burden of discrete choice experiment and case 2 best-worst scaling in an online setting," Journal of choice modelling, Elsevier, vol. 38(C).
    8. Anna Nicolet & Clémence Perraudin & Joël Wagner & Ingrid Gilles & Nicolas Krucien & Isabelle Peytremann-Bridevaux & Joachim Marti, 2022. "Patient and Public Preferences for Coordinated Care in Switzerland: Development of a Discrete Choice Experiment," The Patient: Patient-Centered Outcomes Research, Springer;International Academy of Health Preference Research, vol. 15(4), pages 485-496, July.
    9. Brendan Mulhern & Richard Norman & Koonal Shah & Nick Bansback & Louise Longworth & Rosalie Viney, 2018. "How Should Discrete Choice Experiments with Duration Choice Sets Be Presented for the Valuation of Health States?," Medical Decision Making, , vol. 38(3), pages 306-318, April.
    10. Himmler, Sebastian & Jonker, Marcel & van Krugten, Frédérique & Hackert, Mariska & van Exel, Job & Brouwer, Werner, 2022. "Estimating an anchored utility tariff for the well-being of older people measure (WOOP) for the Netherlands," Social Science & Medicine, Elsevier, vol. 301(C).
    11. Marcel F. Jonker & Bas Donkers & Esther de Bekker‐Grob & Elly A. Stolk, 2019. "Attribute level overlap (and color coding) can reduce task complexity, improve choice consistency, and decrease the dropout rate in discrete choice experiments," Health Economics, John Wiley & Sons, Ltd., vol. 28(3), pages 350-363, March.
    12. Riccardo Scarpa & Timothy J. Gilbride & Danny Campbell & David A. Hensher, 2009. "Modelling attribute non-attendance in choice experiments for rural landscape valuation," European Review of Agricultural Economics, Oxford University Press and the European Agricultural and Applied Economics Publications Foundation, vol. 36(2), pages 151-174, June.
    13. Luiz Flavio Andrade & Kristina Ludwig & Juan Manuel Ramos Goni & Mark Oppe & Gérard Pouvourville, 2020. "A French Value Set for the EQ-5D-5L," PharmacoEconomics, Springer, vol. 38(4), pages 413-425, April.
    14. DeShazo, J. R. & Fermo, German, 2002. "Designing Choice Sets for Stated Preference Methods: The Effects of Complexity on Choice Consistency," Journal of Environmental Economics and Management, Elsevier, vol. 44(1), pages 123-143, July.
    15. Roselinde Kessels & Peter Goos & Bradley Jones & Martina Vandebroek, 2011. "Rejoinder: the usefulness of Bayesian optimal designs for discrete choice experiments," Applied Stochastic Models in Business and Industry, John Wiley & Sons, vol. 27(3), pages 197-203, May.
    16. John Rose & Michiel Bliemer, 2013. "Sample size requirements for stated choice experiments," Transportation, Springer, vol. 40(5), pages 1021-1041, September.
    17. Stephane Hess & Amanda Stathopoulos & Danny Campbell & Vikki O’Neill & Sebastian Caussade, 2013. "It’s not that I don’t care, I just don’t care very much: confounding between attribute non-attendance and taste heterogeneity," Transportation, Springer, vol. 40(3), pages 583-607, May.
    18. David A. Hensher, 2006. "How do respondents process stated choice experiments? Attribute consideration under varying information load," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 21(6), pages 861-878.
    19. Meyerhoff, Jürgen & Oehlmann, Malte, 2023. "The performance of full versus partial profile choice set designs in environmental valuation," Ecological Economics, Elsevier, vol. 204(PA).
    20. Samson Yaekob Assele & Michel Meulders & Helena Michiels & Nanou Flamant & Martina Vandebroek, 2023. "The Effect of Information Provision and Color Coding in Product Labeling on the Preference for Meat Substitutes," Sustainability, MDPI, vol. 15(22), pages 1-20, November.
    21. Finch, Aureliano Paolo & Meregaglia, Michela & Ciani, Oriana & Roudijk, Bram & Jommi, Claudio, 2022. "An EQ-5D-5L value set for Italy using videoconferencing interviews and feasibility of a new mode of administration," Social Science & Medicine, Elsevier, vol. 292(C).
    22. Hensher, David A. & Rose, John M., 2009. "Simplifying choice through attribute preservation or non-attendance: Implications for willingness to pay," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 45(4), pages 583-590, July.
    23. Tara Maddala & Kathryn A. Phillips & F. Reed Johnson, 2003. "An experiment on simplifying conjoint analysis designs for measuring preferences," Health Economics, John Wiley & Sons, Ltd., vol. 12(12), pages 1035-1047, December.
    24. Jordan J. Louviere & Towhidul Islam & Nada Wasi & Deborah Street & Leonie Burgess, 2008. "Designing Discrete Choice Experiments: Do Optimal Designs Come at a Price?," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 35(2), pages 360-375, March.
    25. Roselinde Kessels & Bradley Jones & Peter Goos & Martina Vandebroek, 2011. "The usefulness of Bayesian optimal designs for discrete choice experiments," Applied Stochastic Models in Business and Industry, John Wiley & Sons, vol. 27(3), pages 173-188, May.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Richard Yao & Riccardo Scarpa & John Rose & James Turner, 2015. "Experimental Design Criteria and Their Behavioural Efficiency: An Evaluation in the Field," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 62(3), pages 433-455, November.
    2. Yang, Jui-Chen & Johnson, F. Reed & Kilambi, Vikram & Mohamed, Ateesha F., 2015. "Sample size and utility-difference precision in discrete-choice experiments: A meta-simulation approach," Journal of choice modelling, Elsevier, vol. 16(C), pages 50-57.
    3. Mara Thiene & Riccardo Scarpa & Jordan Louviere, 2015. "Addressing Preference Heterogeneity, Multiple Scales and Attribute Attendance with a Correlated Finite Mixing Model of Tap Water Choice," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 62(3), pages 637-656, November.
    4. Greiner, Romy & Bliemer, Michiel & Ballweg, Julie, 2014. "Design considerations of a choice experiment to estimate likely participation by north Australian pastoralists in contractual biodiversity conservation," Journal of choice modelling, Elsevier, vol. 10(C), pages 34-45.
    5. Marcel F. Jonker & Bas Donkers & Esther de Bekker‐Grob & Elly A. Stolk, 2019. "Attribute level overlap (and color coding) can reduce task complexity, improve choice consistency, and decrease the dropout rate in discrete choice experiments," Health Economics, John Wiley & Sons, Ltd., vol. 28(3), pages 350-363, March.
    6. Glenk, Klaus & Meyerhoff, Jürgen & Colombo, Sergio & Faccioli, Michela, 2024. "Enhancing the face validity of choice experiments: A simple diagnostic check," Ecological Economics, Elsevier, vol. 221(C).
    7. Robert J. Johnston & Kevin J. Boyle & Wiktor (Vic) Adamowicz & Jeff Bennett & Roy Brouwer & Trudy Ann Cameron & W. Michael Hanemann & Nick Hanley & Mandy Ryan & Riccardo Scarpa & Roger Tourangeau & Ch, 2017. "Contemporary Guidance for Stated Preference Studies," Journal of the Association of Environmental and Resource Economists, University of Chicago Press, vol. 4(2), pages 319-405.
    8. Weller, Priska & Oehlmann, Malte & Mariel, Petr & Meyerhoff, Jürgen, 2014. "Stated and inferred attribute non-attendance in a design of designs approach," Journal of choice modelling, Elsevier, vol. 11(C), pages 43-56.
    9. David Hensher & Andrew Collins & William Greene, 2013. "Accounting for attribute non-attendance and common-metric aggregation in a probabilistic decision process mixed multinomial logit model: a warning on potential confounding," Transportation, Springer, vol. 40(5), pages 1003-1020, September.
    10. Grammatikopoulou, Ioanna & Pouta, Eija & Artell, Janne, 2019. "Heterogeneity and attribute non-attendance in preferences for peatland conservation," Forest Policy and Economics, Elsevier, vol. 104(C), pages 45-55.
    11. Elizabeth Kinter & Thomas Prior & Christopher Carswell & John Bridges, 2012. "A Comparison of Two Experimental Design Approaches in Applying Conjoint Analysis in Patient-Centered Outcomes Research," The Patient: Patient-Centered Outcomes Research, Springer;International Academy of Health Preference Research, vol. 5(4), pages 279-294, December.
    12. Bujosa Bestard, Angel & Riera Font, Antoni, 2021. "Attribute range effects: Preference anomaly or unexplained variance?," Journal of choice modelling, Elsevier, vol. 41(C).
    13. Palhazi Cuervo, Daniel & Kessels, Roselinde & Goos, Peter & Sörensen, Kenneth, 2016. "An integrated algorithm for the optimal design of stated choice experiments with partial profiles," Transportation Research Part B: Methodological, Elsevier, vol. 93(PA), pages 648-669.
    14. Mohd Zuhair & Ram Babu Roy, 2022. "Eliciting relative preferences for the attributes of health insurance schemes among rural consumers in India," International Journal of Health Economics and Management, Springer, vol. 22(4), pages 443-458, December.
    15. Moser, Riccarda & Raffaelli, Roberta, 2014. "Does attribute cut-off elicitation affect choice consistency? Contrasting hypothetical and real-money choice experiments," Journal of choice modelling, Elsevier, vol. 11(C), pages 16-29.
    16. Kemper, Nathan & Popp, Jennie & Nayga, Jr., Rodolfo M. & Bazzani, Claudia, . "A Query Approach to Modeling Attendance to Attributes in Discrete Choice Experiments," Journal of Agricultural and Resource Economics, Western Agricultural Economics Association, vol. 49(2).
    17. Scarpa, Riccardo & Rose, John M., 2008. "Design efficiency for non-market valuation with choice modelling: how to measure it, what to report and why," Australian Journal of Agricultural and Resource Economics, Australian Agricultural and Resource Economics Society, vol. 52(3), pages 1-30.
    18. van Cranenburgh, Sander & Collins, Andrew T., 2019. "New software tools for creating stated choice experimental designs efficient for regret minimisation and utility maximisation decision rules," Journal of choice modelling, Elsevier, vol. 31(C), pages 104-123.
    19. Que, Sisi & Awuah-Offei, Kwame & Weidner, Nathan & Wang, Yumin, 2017. "Discrete choice experiment validation: A resource project case study," Journal of choice modelling, Elsevier, vol. 22(C), pages 39-50.
    20. Thao Thai & Michiel Bliemer & Gang Chen & Jean Spinks & Sonja de New & Emily Lancsar, 2023. "Comparison of a full and partial choice set design in a labeled discrete choice experiment," Health Economics, John Wiley & Sons, Ltd., vol. 32(6), pages 1284-1304, June.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:eejocm:v:52:y:2024:i:c:s1755534524000265. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/journal-of-choice-modelling .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.