IDEAS home Printed from https://ideas.repec.org/a/kap/transp/v50y2023i6d10.1007_s11116-022-10312-w.html
   My bibliography  Save this article

Response willingness in consecutive travel surveys: an investigation based on the National Household Travel Survey using a sample selection model

Author

Listed:
  • Xinyi Wang

    (Georgia Institute of Technology)

  • F. Atiyya Shaw

    (University of Michigan, Ann Arbor)

  • Patricia L. Mokhtarian

    (Georgia Institute of Technology)

  • Kari E. Watkins

    (University of California, Davis)

Abstract

Declining survey response rates have increased the costs of travel survey recruitment. Recruiting respondents based on their expressed willingness to participate in future surveys, obtained from a preceding survey, is a potential solution but may exacerbate sample biases. In this study, we analyze the self-selection biases of survey respondents recruited from the 2017 U.S. National Household Travel Survey (NHTS), who had agreed to be contacted again for follow-up surveys. We apply a probit with sample selection (PSS) model to analyze (1) respondents’ willingness to participate in a follow-up survey (the selection model) and (2) their actual response behavior once contacted (the outcome model). Results verify the existence of self-selection biases, which are related to survey burden, sociodemographic characteristics, travel behavior, and item non-response to sensitive variables. We find that age, homeownership, and medical conditions have opposing effects on respondents’ willingness to participate and their actual survey participation. The PSS model is then validated using a hold-out sample and applied to the NHTS samples from various geographic regions to predict follow-up survey participation. Effect size indicators for differences between predicted and actual (population) distributions of select sociodemographic and travel-related variables suggest that the resulting samples may be most biased along age and education dimensions. Further, we summarized six model performance measures based on the PSS model structure. Overall, this study provides insight into self-selection biases in respondents recruited from preceding travel surveys. Model results can help researchers better understand and address such biases, while the nuanced application of various model measures lays a foundation for appropriate comparison across sample selection models.

Suggested Citation

  • Xinyi Wang & F. Atiyya Shaw & Patricia L. Mokhtarian & Kari E. Watkins, 2023. "Response willingness in consecutive travel surveys: an investigation based on the National Household Travel Survey using a sample selection model," Transportation, Springer, vol. 50(6), pages 2339-2373, December.
    • Handle: RePEc:kap:transp:v:50:y:2023:i:6:d:10.1007_s11116-022-10312-w
    DOI: 10.1007/s11116-022-10312-w
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11116-022-10312-w
    File Function: Abstract
    Download Restriction: Access to full text is restricted to subscribers.
    File URL: https://libkey.io/10.1007/s11116-022-10312-w?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. James J. Heckman, 1976. "The Common Structure of Statistical Models of Truncation, Sample Selection and Limited Dependent Variables and a Simple Estimator for Such Models," NBER Chapters, in: Annals of Economic and Social Measurement, Volume 5, number 4, pages 475-492, National Bureau of Economic Research, Inc.
    2. Van de Ven, Wynand P. M. M. & Van Praag, Bernard M. S., 1981. "The demand for deductibles in private health insurance : A probit model with sample selection," Journal of Econometrics, Elsevier, vol. 17(2), pages 229-252, November.
    3. Xinyu (Jason) Cao, 2009. "Disentangling the influence of neighborhood type and self-selection on driving behavior: an application of sample selection model," Transportation, Springer, vol. 36(2), pages 207-222, March.
    4. Neufeld, Amanda J. & Mokhtarian, Patricia L., 2012. "A Survey of Multitasking by Northern California Commuters: Description of the Data Collection Process," Institute of Transportation Studies, Working Paper Series qt9f49x4h8, Institute of Transportation Studies, UC Davis.
    5. Andrew Collins & John Rose & Stephane Hess, 2012. "Interactive stated choice surveys: a study of air travel behaviour," Transportation, Springer, vol. 39(1), pages 55-79, January.
    6. James Heckman & Justin L. Tobias & Edward Vytlacil, 2001. "Four Parameters of Interest in the Evaluation of Social Programs," Southern Economic Journal, John Wiley & Sons, vol. 68(2), pages 210-223, October.
    7. Parady, Giancarlos & Ory, David & Walker, Joan, 2021. "The overreliance on statistical goodness-of-fit and under-reliance on model validation in discrete choice models: A review of validation practices in the transportation academic literature," Journal of choice modelling, Elsevier, vol. 38(C).
    8. Sun, Hao & Wang, Hai & Wan, Zhixi, 2019. "Model and analysis of labor supply for ride-sharing platforms in the presence of sample self-selection and endogeneity," Transportation Research Part B: Methodological, Elsevier, vol. 125(C), pages 76-93.
    9. Shaw, F. Atiyya & Wang, Xinyi & Mokhtarian, Patricia L. & Watkins, Kari E., 2021. "Supplementing transportation data sources with targeted marketing data: Applications, integration, and internal validation," Transportation Research Part A: Policy and Practice, Elsevier, vol. 149(C), pages 150-169.
    10. Circella, Giovanni & Tiedeman, Kate & Handy, Susan & Alemi, Farzad & Mokhtarian, Patricia, 2016. "What Affects Millennials’ Mobility? Part I: Investigating the Environmental Concerns, Lifestyles, Mobility-Related Attitudes and Adoption of Technology of Young Adults in California," Institute of Transportation Studies, Working Paper Series qt6wm51523, Institute of Transportation Studies, UC Davis.
    11. James Heckman & Justin L. Tobias & Edward Vytlacil, 2001. "Four Parameters of Interest in the Evaluation of Social Programs," Southern Economic Journal, John Wiley & Sons, vol. 68(2), pages 210-223, October.
    12. Couper, Mick P. & Kapteyn, Arie & Schonlau, Matthias & Winter, Joachim, 2007. "Noncoverage and nonresponse in an Internet survey," Munich Reprints in Economics 20093, University of Munich, Department of Economics.
    13. V. Kerry Smith & Kelli L. Larson & Abigail York, 2020. "Using quality signaling to enhance survey response rates," Applied Economics Letters, Taylor & Francis Journals, vol. 27(11), pages 951-954, June.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Watanabe, Hajime & Maruyama, Takuya, 2024. "A Bayesian sample selection model with a binary outcome for handling residential self-selection in individual car ownership," Journal of choice modelling, Elsevier, vol. 51(C).
    2. Sloczynski, Tymon, 2018. "A General Weighted Average Representation of the Ordinary and Two-Stage Least Squares Estimands," IZA Discussion Papers 11866, Institute of Labor Economics (IZA).
    3. Xinyu (Jason) Cao, 2009. "Disentangling the influence of neighborhood type and self-selection on driving behavior: an application of sample selection model," Transportation, Springer, vol. 36(2), pages 207-222, March.
    4. Mogstad, Magne & Torgovitsky, Alexander & Walters, Christopher R., 2024. "Policy evaluation with multiple instrumental variables," Journal of Econometrics, Elsevier, vol. 243(1).
    5. Justin L. Tobias, 2003. "Are Returns to Schooling Concentrated Among the Most Able? A Semiparametric Analysis of the Ability–earnings Relationships," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 65(1), pages 1-29, February.
    6. Charles Raux & Ayana Lamatkhanova & Lény Grassot, 2021. "Does the built environment shape commuting? The case of Lyon (France)," Post-Print halshs-03010833, HAL.
    7. Tymon S{l}oczy'nski, 2018. "Interpreting OLS Estimands When Treatment Effects Are Heterogeneous: Smaller Groups Get Larger Weights," Papers 1810.01576, arXiv.org, revised May 2020.
    8. repec:mth:jas888:v:7:y:2019:i:1:p:82-102 is not listed on IDEAS
    9. Charles Raux & Ayana Lamatkhanova & Lény Grassot, 2020. "Does the built environment shape commuting? The case of Lyon (France)," Working Papers halshs-03010833, HAL.
    10. Alain Carpentier & Céline Nauges & Arnaud Reynaud & Alban Thomas, 2006. "Effets de la délégation sur le prix de l'eau potable en France. Une analyse à partir de la littérature sur les « effets de traitement »," Economie & Prévision, La Documentation Française, vol. 0(3), pages 1-19.
    11. van Herick, David & Mokhtarian, Patricia L., 2021. "Quantifying the share of total apparent effect that is genuinely due to a treatment: A comparison of methods," Research in Transportation Economics, Elsevier, vol. 90(C).
    12. Bhat, Chandra R. & Eluru, Naveen, 2009. "A copula-based approach to accommodate residential self-selection effects in travel behavior modeling," Transportation Research Part B: Methodological, Elsevier, vol. 43(7), pages 749-765, August.
    13. Sung Hoo Kim & Patricia L. Mokhtarian, 2024. "A note on the sample selection (switching regression) model and treatment effects for a log-transformed outcome variable, in the context of residential self-selection," Transportation, Springer, vol. 51(5), pages 1723-1757, October.
    14. Justin L. Tobias & Mingliang Li, 2003. "A finite-sample hierarchical analysis of wage variation across public high schools: evidence from the NLSY and high school and beyond," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 18(3), pages 315-336.
    15. Joshua D. Angrist, 2004. "Treatment effect heterogeneity in theory and practice," Economic Journal, Royal Economic Society, vol. 114(494), pages 52-83, March.
    16. Lindelow, Magnus, 2002. "Health care demand in rural Mozambique," FCND discussion papers 126, International Food Policy Research Institute (IFPRI).
    17. André Dumas Tsambou & Lionie Mafang & Thierno Malick Diallo & Benjamin Fomba Kamga, 2024. "Impact of job training program on employment outcomes in Senegal," SN Business & Economics, Springer, vol. 4(8), pages 1-33, August.
    18. Yan Liu, 2022. "Policy Learning under Endogeneity Using Instrumental Variables," Papers 2206.09883, arXiv.org, revised Mar 2024.
    19. Mark G. Duggan & Melissa Schettini Kearney, 2007. "The impact of child SSI enrollment on household outcomes," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 26(4), pages 861-886.
    20. Bhat, Chandra R. & Astroza, Sebastian & Sidharthan, Raghuprasad & Alam, Mohammad Jobair Bin & Khushefati, Waleed H., 2014. "A joint count-continuous model of travel behavior with selection based on a multinomial probit residential density choice model," Transportation Research Part B: Methodological, Elsevier, vol. 68(C), pages 31-51.
    21. A. Smith, Jeffrey & E. Todd, Petra, 2005. "Does matching overcome LaLonde's critique of nonexperimental estimators?," Journal of Econometrics, Elsevier, vol. 125(1-2), pages 305-353.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:kap:transp:v:50:y:2023:i:6:d:10.1007_s11116-022-10312-w. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.