IDEAS home Printed from https://ideas.repec.org/a/eee/eejocm/v40y2021ics1755534521000373.html
   My bibliography  Save this article

Joint modelling of choice and rating data: Theory and examples

Author

Listed:
  • Webb, Edward J.D.
  • Hess, Stephane

Abstract

In many cases, ordinal data, for example rating objects on a scale from 1 to 5, is observed only for those objects that have been chosen from a set of discrete alternatives, with no ratings for unchosen objects. An example is customer ratings of goods sold by online retailers. The joint modelling of choice and rating is made difficult by the missing ratings for unchosen alternatives. A method of jointly modelling choice and rating data termed a choice-ordered logit (COL) model is presented. Two types of COL model are defined: two-step, which places a positive probability on the chosen alternative not having the highest rating, and one-step, where the highest rated alternative is always chosen. Three case studies exemplifying the use of COL models are given. One uses simulated data and two use data from discrete choice experiments. It is shown that COL models can produce robust estimates. Two-step models provided a better fit than one-step, and most participants seemed to use two-step decision-making. However, a sizeable minority used one-step decision-making in one case study. It is argued that COL models have benefits over standard approaches, in particular adding information on strength-of-preference to discrete choices.

Suggested Citation

  • Webb, Edward J.D. & Hess, Stephane, 2021. "Joint modelling of choice and rating data: Theory and examples," Journal of choice modelling, Elsevier, vol. 40(C).
    • Handle: RePEc:eee:eejocm:v:40:y:2021:i:c:s1755534521000373
    DOI: 10.1016/j.jocm.2021.100304
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S1755534521000373
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.jocm.2021.100304?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Stephane Hess, 2014. "Latent class structures: taste heterogeneity and beyond," Chapters, in: Stephane Hess & Andrew Daly (ed.), Handbook of Choice Modelling, chapter 14, pages 311-330, Edward Elgar Publishing.
    2. Bansback, Nick & Brazier, John & Tsuchiya, Aki & Anis, Aslam, 2012. "Using a discrete choice experiment to estimate health state utility values," Journal of Health Economics, Elsevier, vol. 31(1), pages 306-318.
    3. Beck, Matthew J. & Rose, John M. & Hensher, David A., 2013. "Consistently inconsistent: The role of certainty, acceptability and scale in choice," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 56(C), pages 81-93.
    4. Brendan Mulhern & Nick Bansback & Arne Risa Hole & Aki Tsuchiya, 2017. "Using Discrete Choice Experiments with Duration to Model EQ-5D-5L Health State Preferences," Medical Decision Making, , vol. 37(3), pages 285-297, April.
    5. Vikas Soekhai & Esther W. Bekker-Grob & Alan R. Ellis & Caroline M. Vass, 2019. "Discrete Choice Experiments in Health Economics: Past, Present and Future," PharmacoEconomics, Springer, vol. 37(2), pages 201-226, February.
    6. Nancy J. Devlin & Koonal K. Shah & Yan Feng & Brendan Mulhern & Ben van Hout, 2018. "Valuing health‐related quality of life: An EQ‐5D‐5L value set for England," Health Economics, John Wiley & Sons, Ltd., vol. 27(1), pages 7-22, January.
    7. David A. Hensher & John M. Rose, 2012. "The Influence of Alternative Acceptability, Attribute Thresholds and Choice Response Certainty on Automobile Purchase Preferences," Journal of Transport Economics and Policy, University of Bath, vol. 46(3), pages 451-468, September.
    8. Train,Kenneth E., 2009. "Discrete Choice Methods with Simulation," Cambridge Books, Cambridge University Press, number 9780521766555.
    9. Fifer, Simon & Rose, John M., 2016. "Can you ever be certain? Reducing hypothetical bias in stated choice experiments via respondent reported choice certaintyAuthor-Name: Beck, Matthew J," Transportation Research Part B: Methodological, Elsevier, vol. 89(C), pages 149-167.
    10. Matteo Mattmann & Ivana Logar & Roy Brouwer, 2019. "Choice certainty, consistency, and monotonicity in discrete choice experiments," Journal of Environmental Economics and Policy, Taylor & Francis Journals, vol. 8(2), pages 109-127, April.
    11. Hess, Stephane & Palma, David, 2019. "Apollo: A flexible, powerful and customisable freeware package for choice model estimation and application," Journal of choice modelling, Elsevier, vol. 32(C), pages 1-1.
    12. Monic Sun, 2012. "How Does the Variance of Product Ratings Matter?," Management Science, INFORMS, vol. 58(4), pages 696-707, April.
    13. Rose, John M. & Beck, Matthew J. & Hensher, David A., 2015. "The joint estimation of respondent-reported certainty and acceptability with choice," Transportation Research Part A: Policy and Practice, Elsevier, vol. 71(C), pages 141-152.
    14. Regier, Dean A. & Watson, Verity & Burnett, Heather & Ungar, Wendy J., 2014. "Task complexity and response certainty in discrete choice experiments: An application to drug treatments for juvenile idiopathic arthritis," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 50(C), pages 40-49.
    15. Wendy W. Moe & David A. Schweidel, 2012. "Online Product Opinions: Incidence, Evaluation, and Evolution," Marketing Science, INFORMS, vol. 31(3), pages 372-386, May.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Mokas, Ilias & Lizin, Sebastien & Brijs, Tom & Witters, Nele & Malina, Robert, 2021. "Can immersive virtual reality increase respondents’ certainty in discrete choice experiments? A comparison with traditional presentation formats," Journal of Environmental Economics and Management, Elsevier, vol. 109(C).
    2. Edward J. D. Webb & John O’Dwyer & David Meads & Paul Kind & Penny Wright, 2020. "Transforming discrete choice experiment latent scale values for EQ-5D-3L using the visual analogue scale," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 21(5), pages 787-800, July.
    3. Haghani, Milad & Sarvi, Majid, 2018. "Hypothetical bias and decision-rule effect in modelling discrete directional choices," Transportation Research Part A: Policy and Practice, Elsevier, vol. 116(C), pages 361-388.
    4. Regier, Dean A. & Sicsic, Jonathan & Watson, Verity, 2019. "Choice certainty and deliberative thinking in discrete choice experiments. A theoretical and empirical investigation," Journal of Economic Behavior & Organization, Elsevier, vol. 164(C), pages 235-255.
    5. Roy Brouwer & Solomon Tarfasa, 2020. "Testing hypothetical bias in a framed field experiment," Canadian Journal of Agricultural Economics/Revue canadienne d'agroeconomie, Canadian Agricultural Economics Society/Societe canadienne d'agroeconomie, vol. 68(3), pages 343-357, September.
    6. Enni Ruokamo & Mikołaj Czajkowski & Nick Hanley & Artti Juutinen & Rauli Svento, 2016. "Linking perceived choice complexity with scale heterogeneity in discrete choice experiments: home heating in Finland," Working Papers 2016-30, Faculty of Economic Sciences, University of Warsaw.
    7. John Buckell & Vrinda Vasavada & Sarah Wordsworth & Dean A. Regier & Matthew Quaife, 2022. "Utility maximization versus regret minimization in health choice behavior: Evidence from four datasets," Health Economics, John Wiley & Sons, Ltd., vol. 31(2), pages 363-381, February.
    8. Fraser, Iain & Balcombe, Kelvin & Williams, Louis & McSorley, Eugene, 2021. "Preference stability in discrete choice experiments. Some evidence using eye-tracking," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 94(C).
    9. Hensher, David A. & Ho, Chinh, 2015. "The role of perceived acceptability of alternatives in identifying and assessing choice set processing strategies in stated choice settings: The case of road pricing reform," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 83(C), pages 225-237.
    10. Fifer, Simon & Rose, John M., 2016. "Can you ever be certain? Reducing hypothetical bias in stated choice experiments via respondent reported choice certaintyAuthor-Name: Beck, Matthew J," Transportation Research Part B: Methodological, Elsevier, vol. 89(C), pages 149-167.
    11. Spencer, Anne & Rivero-Arias, Oliver & Wong, Ruth & Tsuchiya, Aki & Bleichrodt, Han & Edwards, Rhiannon Tudor & Norman, Richard & Lloyd, Andrew & Clarke, Philip, 2022. "The QALY at 50: One story many voices," Social Science & Medicine, Elsevier, vol. 296(C).
    12. Kim, Sung Hoo & Mokhtarian, Patricia L., 2023. "Finite mixture (or latent class) modeling in transportation: Trends, usage, potential, and future directions," Transportation Research Part B: Methodological, Elsevier, vol. 172(C), pages 134-173.
    13. Kunwar, Samrat B. & Bohara, Alok K. & Thacher, Jennifer, 2020. "Public preference for river restoration in the Danda Basin, Nepal: A choice experiment study," Ecological Economics, Elsevier, vol. 175(C).
    14. Sergio Colombo & Wiktor Budziński & Mikołaj Czajkowski & Klaus Glenk, 2022. "The relative performance of ex‐ante and ex‐post measures to mitigate hypothetical and strategic bias in a stated preference study," Journal of Agricultural Economics, Wiley Blackwell, vol. 73(3), pages 845-873, September.
    15. Genie, Mesfin G. & Ryan, Mandy & Krucien, Nicolas, 2021. "To pay or not to pay? Cost information processing in the valuation of publicly funded healthcare," Social Science & Medicine, Elsevier, vol. 276(C).
    16. Milad Haghani & Michiel C. J. Bliemer & John M. Rose & Harmen Oppewal & Emily Lancsar, 2021. "Hypothetical bias in stated choice experiments: Part II. Macro-scale analysis of literature and effectiveness of bias mitigation methods," Papers 2102.02945, arXiv.org.
    17. Hess, Stephane & Lancsar, Emily & Mariel, Petr & Meyerhoff, Jürgen & Song, Fangqing & van den Broek-Altenburg, Eline & Alaba, Olufunke A. & Amaris, Gloria & Arellana, Julián & Basso, Leonardo J. & Ben, 2022. "The path towards herd immunity: Predicting COVID-19 vaccination uptake through results from a stated choice study across six continents," Social Science & Medicine, Elsevier, vol. 298(C).
    18. Onozaka, Yuko & Honkanen, Pirjo & Altintzoglou, Themistoklis, 2023. "Sustainability, perceived quality and country of origin of farmed salmon: Impact on consumer choices in the USA, France and Japan," Food Policy, Elsevier, vol. 117(C).
    19. Oehlmann, Malte & Glenk, Klaus & Lloyd-Smith, Patrick & Meyerhoff, Jürgen, 2021. "Quantifying landscape externalities of renewable energy development: Implications of attribute cut-offs in choice experiments," Resource and Energy Economics, Elsevier, vol. 65(C).
    20. Tinessa, Fiore & Marzano, Vittorio & Papola, Andrea, 2020. "Mixing distributions of tastes with a Combination of Nested Logit (CoNL) kernel: Formulation and performance analysis," Transportation Research Part B: Methodological, Elsevier, vol. 141(C), pages 1-23.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:eejocm:v:40:y:2021:i:c:s1755534521000373. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/journal-of-choice-modelling .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.