IDEAS home Printed from https://ideas.repec.org/a/eee/eejocm/v52y2024ics1755534524000253.html
   My bibliography  Save this article

Varying choice set sizes in discrete choice experiments

Author

Listed:
  • Akinc, Deniz
  • Street, Deborah J.
  • Vandebroek, Martina

Abstract

Whereas the number of alternatives per choice set in a labeled discrete choice experiment is often determined by the number of available labels, the choice set size in unlabeled choice experiments can be set more freely by the researcher. Determining the number of alternatives that will both yield enough information about the preferences and not overload the choice task for the respondents is, however, not an easy task. If the number of choice sets is restricted, the statistical efficiency of the designed experiment can be increased by increasing the number of alternatives per choice set. On the other hand, large choice sets are complex to deal with and could therefore lead to early fatigue and/or a plethora of screening heuristics that are hard to model. Moreover, although there is no compelling reason to keep the choice set size fixed in unlabeled discrete choice experiments, designs with varying choice set sizes have scarcely been studied. In this paper, we compute and investigate efficient designs with varying choice set sizes. We show that such designs can also be very efficient and we conjecture that such choice experiments are less monotonous for the respondents making it more likely that they will remain attentive. We report on two choice experiments that we conducted to check whether this assertion is correct. We compare designs with equal choice set sizes, with increasing choice set sizes and with random choice set sizes. The post-survey questions indicate that varying choice set sizes are indeed appreciated by the respondents while not reducing the statistical information obtained.

Suggested Citation

  • Akinc, Deniz & Street, Deborah J. & Vandebroek, Martina, 2024. "Varying choice set sizes in discrete choice experiments," Journal of choice modelling, Elsevier, vol. 52(C).
  • Handle: RePEc:eee:eejocm:v:52:y:2024:i:c:s1755534524000253
    DOI: 10.1016/j.jocm.2024.100493
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S1755534524000253
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.jocm.2024.100493?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Bliemer, Michiel C.J. & Rose, John M., 2010. "Construction of experimental designs for mixed logit models allowing for correlation across choice observations," Transportation Research Part B: Methodological, Elsevier, vol. 44(6), pages 720-734, July.
    2. David Hensher, 2006. "Revealing Differences in Willingness to Pay due to the Dimensionality of Stated Choice Designs: An Initial Assessment," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 34(1), pages 7-44, May.
    3. Molloy, Joseph & Becker, Felix & Schmid, Basil & Axhausen, Kay W., 2021. "mixl: An open-source R package for estimating complex choice models on large datasets," Journal of choice modelling, Elsevier, vol. 39(C).
    4. Park, Jeong-Yeol & Jang, SooCheong (Shawn), 2013. "Confused by too many choices? Choice overload in tourism," Tourism Management, Elsevier, vol. 35(C), pages 1-12.
    5. DeShazo, J. R. & Fermo, German, 2002. "Designing Choice Sets for Stated Preference Methods: The Effects of Complexity on Choice Consistency," Journal of Environmental Economics and Management, Elsevier, vol. 44(1), pages 123-143, July.
    6. Keller, Kevin Lane & Staelin, Richard, 1987. "Effects of Quality and Quantity of Information on Decision Effectiveness," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 14(2), pages 200-213, September.
    7. Caussade, Sebastián & Ortúzar, Juan de Dios & Rizzi, Luis I. & Hensher, David A., 2005. "Assessing the influence of design dimensions on stated choice experiment estimates," Transportation Research Part B: Methodological, Elsevier, vol. 39(7), pages 621-640, August.
    8. Vikas Soekhai & Esther W. Bekker-Grob & Alan R. Ellis & Caroline M. Vass, 2019. "Discrete Choice Experiments in Health Economics: Past, Present and Future," PharmacoEconomics, Springer, vol. 37(2), pages 201-226, February.
    9. Chanjin Chung & Tracy Boyer & Sungill Han, 2011. "How many choice sets and alternatives are optimal? Consistency in choice experiments," Agribusiness, John Wiley & Sons, Ltd., vol. 27(1), pages 114-125, Winter.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Jürgen Meyerhoff & Malte Oehlmann & Priska Weller, 2015. "The Influence of Design Dimensions on Stated Choices in an Environmental Context," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 61(3), pages 385-407, July.
    2. Marcel F. Jonker & Bas Donkers & Esther de Bekker‐Grob & Elly A. Stolk, 2019. "Attribute level overlap (and color coding) can reduce task complexity, improve choice consistency, and decrease the dropout rate in discrete choice experiments," Health Economics, John Wiley & Sons, Ltd., vol. 28(3), pages 350-363, March.
    3. Weng, Weizhe & Morrison, Mark D. & Boyle, Kevin J. & Boxall, Peter C. & Rose, John, 2021. "Effects of the number of alternatives in public good discrete choice experiments," Ecological Economics, Elsevier, vol. 182(C).
    4. Windle, Jill & Rolfe, John, 2014. "Valuation framing and attribute scope variation in a choice experiment to asses the impacts of changing land use from agriculture to mining," 2014 Conference (58th), February 4-7, 2014, Port Macquarie, Australia 165888, Australian Agricultural and Resource Economics Society.
    5. Elizabeth Kinter & Thomas Prior & Christopher Carswell & John Bridges, 2012. "A Comparison of Two Experimental Design Approaches in Applying Conjoint Analysis in Patient-Centered Outcomes Research," The Patient: Patient-Centered Outcomes Research, Springer;International Academy of Health Preference Research, vol. 5(4), pages 279-294, December.
    6. Bujosa Bestard, Angel & Riera Font, Antoni, 2021. "Attribute range effects: Preference anomaly or unexplained variance?," Journal of choice modelling, Elsevier, vol. 41(C).
    7. Kosenius, Anna-Kaisa, 2013. "Preference discontinuity in choice experiment: Determinants and implications," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 45(C), pages 138-145.
    8. Ms. Chie Aoyagi & Alistair Munro, 2019. "Guilt, Gender, and Work-Life Balance in Japan: A Choice Experiment," IMF Working Papers 2019/261, International Monetary Fund.
    9. Rolfe, John & Windle, Jill, 2012. "Testing benefit transfer of reef protection values between local case studies: The Great Barrier Reef in Australia," Ecological Economics, Elsevier, vol. 81(C), pages 60-69.
    10. Mickael Bech & Trine Kjaer & Jørgen Lauridsen, 2011. "Does the number of choice sets matter? Results from a web survey applying a discrete choice experiment," Health Economics, John Wiley & Sons, Ltd., vol. 20(3), pages 273-286, March.
    11. Rose, John M. & Hensher, David A. & Caussade, Sebastian & Ortúzar, Juan de Dios & Jou, Rong-Chang, 2009. "Identifying differences in willingness to pay due to dimensionality in stated choice experiments: a cross country analysis," Journal of Transport Geography, Elsevier, vol. 17(1), pages 21-29.
    12. Rolfe, John & Bennett, Jeff, 2009. "The impact of offering two versus three alternatives in choice modelling experiments," Ecological Economics, Elsevier, vol. 68(4), pages 1140-1148, February.
    13. Yang, Jui-Chen & Johnson, F. Reed & Kilambi, Vikram & Mohamed, Ateesha F., 2015. "Sample size and utility-difference precision in discrete-choice experiments: A meta-simulation approach," Journal of choice modelling, Elsevier, vol. 16(C), pages 50-57.
    14. Scarpa, Riccardo & Rose, John M., 2008. "Design efficiency for non-market valuation with choice modelling: how to measure it, what to report and why," Australian Journal of Agricultural and Resource Economics, Australian Agricultural and Resource Economics Society, vol. 52(3), pages 1-30.
    15. Turlo, Sergey & Fina, Matteo & Kasinger, Johannes & Laghaie, Arash & Otter, Thomas, 2025. "Discrete choice in marketing through the lens of rational inattention," Other publications TiSEM 24894409-70a9-4920-9d3c-b, Tilburg University, School of Economics and Management.
    16. Vishva Danthurebandara & Jie Yu & Martina Vandebroek, 2015. "Designing choice experiments by optimizing the complexity level to individual abilities," Quantitative Marketing and Economics (QME), Springer, vol. 13(1), pages 1-26, March.
    17. Rolfe, John & Windle, Jill, 2010. "Valuing environmental improvements in the Great Barrier Reef: Ecological and preference heterogeneity in local area case studies," Research Reports 95052, Australian National University, Environmental Economics Research Hub.
    18. Thao Thai & Michiel Bliemer & Gang Chen & Jean Spinks & Sonja de New & Emily Lancsar, 2023. "Comparison of a full and partial choice set design in a labeled discrete choice experiment," Health Economics, John Wiley & Sons, Ltd., vol. 32(6), pages 1284-1304, June.
    19. Liao, Feixiong & Tian, Qiong & Arentze, Theo & Huang, Hai-Jun & Timmermans, Harry J.P., 2020. "Travel preferences of multimodal transport systems in emerging markets: The case of Beijing," Transportation Research Part A: Policy and Practice, Elsevier, vol. 138(C), pages 250-266.
    20. Windle, Jill & Rolfe, John, 2010. "Restricted versus unrestricted choice in labelled choice experiments: exploring the tradeoffs of expanding choice dimensions," Research Reports 95072, Australian National University, Environmental Economics Research Hub.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:eejocm:v:52:y:2024:i:c:s1755534524000253. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/journal-of-choice-modelling .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.