IDEAS home Printed from https://ideas.repec.org/a/spr/psycho/v88y2023i3d10.1007_s11336-023-09906-9.html
   My bibliography  Save this article

Incorporating Functional Response Time Effects into a Signal Detection Theory Model

Author

Listed:
  • Sun-Joo Cho

    (Vanderbilt University)

  • Sarah Brown-Schmidt

    (Vanderbilt University)

  • Paul De Boeck

    (The Ohio State University and KU Leuven)

  • Matthew Naveiras

    (Vanderbilt University)

  • Si On Yoon

    (University of Iowa)

  • Aaron Benjamin

    (University of Illinois at Urbana-Champaign)

Abstract

Signal detection theory (SDT; Tanner & Swets in Psychological Review 61:401–409, 1954) is a dominant modeling framework used for evaluating the accuracy of diagnostic systems that seek to distinguish signal from noise in psychology. Although the use of response time data in psychometric models has increased in recent years, the incorporation of response time data into SDT models remains a relatively underexplored approach to distinguishing signal from noise. Functional response time effects are hypothesized in SDT models, based on findings from other related psychometric models with response time data. In this study, an SDT model is extended to incorporate functional response time effects using smooth functions and to include all sources of variability in SDT model parameters across trials, participants, and items in the experimental data. The extended SDT model with smooth functions is formulated as a generalized linear mixed-effects model and implemented in the gamm4 R package. The extended model is illustrated using recognition memory data to understand how conversational language is remembered. Accuracy of parameter estimates and the importance of modeling variability in detecting the experimental condition effects and functional response time effects are shown in conditions similar to the empirical data set via a simulation study. In addition, the type 1 error rate of the test for a smooth function of response time is evaluated.

Suggested Citation

  • Sun-Joo Cho & Sarah Brown-Schmidt & Paul De Boeck & Matthew Naveiras & Si On Yoon & Aaron Benjamin, 2023. "Incorporating Functional Response Time Effects into a Signal Detection Theory Model," Psychometrika, Springer;The Psychometric Society, vol. 88(3), pages 1056-1086, September.
    • Handle: RePEc:spr:psycho:v:88:y:2023:i:3:d:10.1007_s11336-023-09906-9
    DOI: 10.1007/s11336-023-09906-9
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11336-023-09906-9
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11336-023-09906-9?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Inhan Kang & Paul Boeck & Roger Ratcliff, 2022. "Modeling Conditional Dependence of Response Accuracy and Response Time with the Diffusion Item Response Theory Model," Psychometrika, Springer;The Psychometric Society, vol. 87(2), pages 725-748, June.
    2. Simon N. Wood, 2013. "On p-values for smooth components of an extended generalized additive model," Biometrika, Biometrika Trust, vol. 100(1), pages 221-228.
    3. Florin Vaida & Suzette Blanchard, 2005. "Conditional Akaike information for mixed-effects models," Biometrika, Biometrika Trust, vol. 92(2), pages 351-370, June.
    4. Simon N. Wood & Natalya Pya & Benjamin Säfken, 2016. "Smoothing Parameter and Model Selection for General Smooth Models," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 111(516), pages 1548-1563, October.
    5. Giampiero Marra & Simon N. Wood, 2012. "Coverage Properties of Confidence Intervals for Generalized Additive Model Components," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 39(1), pages 53-74, March.
    6. Wim van der Linden, 2007. "A Hierarchical Framework for Modeling Speed and Accuracy on Test Items," Psychometrika, Springer;The Psychometric Society, vol. 72(3), pages 287-308, September.
    7. Chen, Haiqin & De Boeck, Paul & Grady, Matthew & Yang, Chien-Lin & Waldschmidt, David, 2018. "Curvilinear dependency of response accuracy on response time in cognitive tests," Intelligence, Elsevier, vol. 69(C), pages 16-23.
    8. Simon N. Wood, 2006. "Low-Rank Scale-Invariant Tensor Product Smooths for Generalized Additive Mixed Models," Biometrics, The International Biometric Society, vol. 62(4), pages 1025-1036, December.
    9. Bates, Douglas & Mächler, Martin & Bolker, Ben & Walker, Steve, 2015. "Fitting Linear Mixed-Effects Models Using lme4," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 67(i01).
    10. Jeffrey Rouder & Jun Lu & Dongchu Sun & Paul Speckman & Richard Morey & Moshe Naveh-Benjamin, 2007. "Signal Detection Models with Random Participant and Item Effects," Psychometrika, Springer;The Psychometric Society, vol. 72(4), pages 621-642, December.
    11. Maria Bolsinova & Paul Boeck & Jesper Tijmstra, 2017. "Modelling Conditional Dependence Between Response Time and Accuracy," Psychometrika, Springer;The Psychometric Society, vol. 82(4), pages 1126-1148, December.
    12. Simon N. Wood, 2004. "Stable and Efficient Multiple Smoothing Parameter Estimation for Generalized Additive Models," Journal of the American Statistical Association, American Statistical Association, vol. 99, pages 673-686, January.
    13. Kang, Inhan & De Boeck, Paul & Partchev, Ivailo, 2022. "A randomness perspective on intelligence processes," Intelligence, Elsevier, vol. 91(C).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Øystein Sørensen & Anders M. Fjell & Kristine B. Walhovd, 2023. "Longitudinal Modeling of Age-Dependent Latent Traits with Generalized Additive Latent and Mixed Models," Psychometrika, Springer;The Psychometric Society, vol. 88(2), pages 456-486, June.
    2. Inhan Kang & Minjeong Jeon & Ivailo Partchev, 2023. "A Latent Space Diffusion Item Response Theory Model to Explore Conditional Dependence between Responses and Response Times," Psychometrika, Springer;The Psychometric Society, vol. 88(3), pages 830-864, September.
    3. Antonio Musolesi & Hervé Cardot, 2017. "Modeling temporal treatment effects with zero inflated semi-parametric regression models: the case of local development policies in France," Working Papers 2017036, University of Ferrara, Department of Economics.
    4. Kang, Inhan & De Boeck, Paul & Partchev, Ivailo, 2022. "A randomness perspective on intelligence processes," Intelligence, Elsevier, vol. 91(C).
    5. Georgios Gioldasis & Antonio Musolesi & Michel Simioni, 2020. "Model uncertainty, nonlinearities and out-of-sample comparison: evidence from international technology diffusion," Working Papers hal-02790523, HAL.
    6. Inhan Kang & Paul Boeck & Roger Ratcliff, 2022. "Modeling Conditional Dependence of Response Accuracy and Response Time with the Diffusion Item Response Theory Model," Psychometrika, Springer;The Psychometric Society, vol. 87(2), pages 725-748, June.
    7. Longhi, Christian & Musolesi, Antonio & Baumont, Catherine, 2014. "Modeling structural change in the European metropolitan areas during the process of economic integration," Economic Modelling, Elsevier, vol. 37(C), pages 395-407.
    8. Marra, Giampiero & Radice, Rosalba, 2017. "Bivariate copula additive models for location, scale and shape," Computational Statistics & Data Analysis, Elsevier, vol. 112(C), pages 99-113.
    9. Giampiero Marra & Rosalba Radice & Till Bärnighausen & Simon N. Wood & Mark E. McGovern, 2017. "A Simultaneous Equation Approach to Estimating HIV Prevalence With Nonignorable Missing Responses," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 112(518), pages 484-496, April.
    10. Georgios Gioldasis & Antonio Musolesi & Michel Simioni, 2020. "Model uncertainty, nonlinearities and out-of-sample comparison: evidence from international technology diffusion," SEEDS Working Papers 0120, SEEDS, Sustainability Environmental Economics and Dynamics Studies, revised Jan 2020.
    11. Sylvie Charlot & Riccardo Crescenzi & Antonio Musolesi, 2014. "Augmented and Unconstrained: revisiting the Regional Knowledge Production Function," SEEDS Working Papers 2414, SEEDS, Sustainability Environmental Economics and Dynamics Studies, revised Aug 2014.
    12. David C. Broadstock & Shunsuke Managi & Roman Matousek & Nickolaos G. Tzeremes, 2019. "Does doing “good” always translate into doing “well”? An eco‐efficiency perspective," Business Strategy and the Environment, Wiley Blackwell, vol. 28(6), pages 1199-1217, September.
    13. Marra, Giampiero & Wyszynski, Karol, 2016. "Semi-parametric copula sample selection models for count responses," Computational Statistics & Data Analysis, Elsevier, vol. 104(C), pages 110-129.
    14. Inhan Kang & Dylan Molenaar & Roger Ratcliff, 2023. "A Modeling Framework to Examine Psychological Processes Underlying Ordinal Responses and Response Times of Psychometric Data," Psychometrika, Springer;The Psychometric Society, vol. 88(3), pages 940-974, September.
    15. Audrey C. Luo & Valerie J. Sydnor & Adam Pines & Bart Larsen & Aaron F. Alexander-Bloch & Matthew Cieslak & Sydney Covitz & Andrew A. Chen & Nathalia Bianchini Esper & Eric Feczko & Alexandre R. Franc, 2024. "Functional connectivity development along the sensorimotor-association axis enhances the cortical hierarchy," Nature Communications, Nature, vol. 15(1), pages 1-16, December.
    16. Th'eo Durandard & Matteo Camboni, 2024. "Comparative Statics for Optimal Stopping Problems in Nonstationary Environments," Papers 2402.06999, arXiv.org, revised Jul 2024.
    17. Simon N. Wood & Natalya Pya & Benjamin Säfken, 2016. "Smoothing Parameter and Model Selection for General Smooth Models," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 111(516), pages 1548-1563, October.
    18. E. Zanini & E. Eastoe & M. J. Jones & D. Randell & P. Jonathan, 2020. "Flexible covariate representations for extremes," Environmetrics, John Wiley & Sons, Ltd., vol. 31(5), August.
    19. Cantoni, Eva & Jacot, Nadège & Ghisletta, Paolo, 2024. "Review and comparison of measures of explained variation and model selection in linear mixed-effects models," Econometrics and Statistics, Elsevier, vol. 29(C), pages 150-168.
    20. Adam R. Pines & Bart Larsen & Zaixu Cui & Valerie J. Sydnor & Maxwell A. Bertolero & Azeez Adebimpe & Aaron F. Alexander-Bloch & Christos Davatzikos & Damien A. Fair & Ruben C. Gur & Raquel E. Gur & H, 2022. "Dissociable multi-scale patterns of development in personalized brain networks," Nature Communications, Nature, vol. 13(1), pages 1-15, December.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:psycho:v:88:y:2023:i:3:d:10.1007_s11336-023-09906-9. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.