IDEAS home Printed from https://ideas.repec.org/a/sae/somere/v53y2024i3p1319-1349.html
   My bibliography  Save this article

The Design and Optimality of Survey Counts: A Unified Framework Via the Fisher Information Maximizer

Author

Listed:
  • Xin Guo
  • Qiang Fu

Abstract

Grouped and right-censored (GRC) counts have been used in a wide range of attitudinal and behavioural surveys yet they cannot be readily analyzed or assessed by conventional statistical models. This study develops a unified regression framework for the design and optimality of GRC counts in surveys. To process infinitely many grouping schemes for the optimum design, we propose a new two-stage algorithm, the Fisher Information Maximizer (FIM), which utilizes estimates from generalized linear models to find a global optimal grouping scheme among all possible N -group schemes. After we define, decompose, and calculate different types of regressor-specific design errors, our analyses from both simulation and empirical examples suggest that: 1) the optimum design of GRC counts is able to reduce the grouping error to zero, 2) the performance of modified Poisson estimators using GRC counts can be comparable to that of Poisson regression, and 3) the optimum design is usually able to achieve the same estimation efficiency with a smaller sample size.

Suggested Citation

  • Xin Guo & Qiang Fu, 2024. "The Design and Optimality of Survey Counts: A Unified Framework Via the Fisher Information Maximizer," Sociological Methods & Research, , vol. 53(3), pages 1319-1349, August.
    • Handle: RePEc:sae:somere:v:53:y:2024:i:3:p:1319-1349
    DOI: 10.1177/00491241221113877
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.1177/00491241221113877
    Download Restriction: no
    File URL: https://libkey.io/10.1177/00491241221113877?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Daniel B. Hall, 2000. "Zero-Inflated Poisson and Binomial Regression with Random Effects: A Case Study," Biometrics, The International Biometric Society, vol. 56(4), pages 1030-1039, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Luiz Paulo Fávero & Joseph F. Hair & Rafael de Freitas Souza & Matheus Albergaria & Talles V. Brugni, 2021. "Zero-Inflated Generalized Linear Mixed Models: A Better Way to Understand Data Relationships," Mathematics, MDPI, vol. 9(10), pages 1-28, May.
    2. Cho, Daegon & Hwang, Youngdeok & Park, Jongwon, 2018. "More buzz, more vibes: Impact of social media on concert distribution," Journal of Economic Behavior & Organization, Elsevier, vol. 156(C), pages 103-113.
    3. Greene, William, 2007. "Functional Form and Heterogeneity in Models for Count Data," Foundations and Trends(R) in Econometrics, now publishers, vol. 1(2), pages 113-218, August.
    4. Yanling Li & Zita Oravecz & Shuai Zhou & Yosef Bodovski & Ian J. Barnett & Guangqing Chi & Yuan Zhou & Naomi P. Friedman & Scott I. Vrieze & Sy-Miin Chow, 2022. "Bayesian Forecasting with a Regime-Switching Zero-Inflated Multilevel Poisson Regression Model: An Application to Adolescent Alcohol Use with Spatial Covariates," Psychometrika, Springer;The Psychometric Society, vol. 87(2), pages 376-402, June.
    5. Yanlin Tang & Liya Xiang & Zhongyi Zhu, 2014. "Risk Factor Selection in Rate Making: EM Adaptive LASSO for Zero‐Inflated Poisson Regression Models," Risk Analysis, John Wiley & Sons, vol. 34(6), pages 1112-1127, June.
    6. Damgaard, Christian, 2008. "Modelling pin-point plant cover data along an environmental gradient," Ecological Modelling, Elsevier, vol. 214(2), pages 404-410.
    7. Soutik Ghosal & Timothy S. Lau & Jeremy Gaskins & Maiying Kong, 2020. "A hierarchical mixed effect hurdle model for spatiotemporal count data and its application to identifying factors impacting health professional shortages," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 69(5), pages 1121-1144, November.
    8. Liu, Juxin & Ma, Yanyuan & Johnstone, Jill, 2020. "A goodness-of-fit test for zero-inflated Poisson mixed effects models in tree abundance studies," Computational Statistics & Data Analysis, Elsevier, vol. 144(C).
    9. Robert Richardson, 2022. "Spatial Generalized Linear Models with Non-Gaussian Translation Processes," Journal of Agricultural, Biological and Environmental Statistics, Springer;The International Biometric Society;American Statistical Association, vol. 27(1), pages 4-21, March.
    10. Ren, Haiying & Zhao, Yuhui, 2021. "Technology opportunity discovery based on constructing, evaluating, and searching knowledge networks," Technovation, Elsevier, vol. 101(C).
    11. Aldo M. Garay & Victor H. Lachos & Heleno Bolfarine, 2015. "Bayesian estimation and case influence diagnostics for the zero-inflated negative binomial regression model," Journal of Applied Statistics, Taylor & Francis Journals, vol. 42(6), pages 1148-1165, June.
    12. Sellers, Kimberly F. & Raim, Andrew, 2016. "A flexible zero-inflated model to address data dispersion," Computational Statistics & Data Analysis, Elsevier, vol. 99(C), pages 68-80.
    13. Tousifur Rahman & Partha Jyoti Hazarika & M. Masoom Ali & Manash Pratim Barman, 2022. "Three-Inflated Poisson Distribution and its Application in Suicide Cases of India During Covid-19 Pandemic," Annals of Data Science, Springer, vol. 9(5), pages 1103-1127, October.
    14. Li, Yan & Jiao, Yan, 2013. "Modeling seabird bycatch in the U.S. Atlantic pelagic longline fishery: Fixed year effect versus random year effect," Ecological Modelling, Elsevier, vol. 260(C), pages 36-41.
    15. Cristian Roner & Claudia Di Caterina & Davide Ferrari, 2021. "Exponential Tilting for Zero-inflated Interval Regression with Applications to Cyber Security Survey Data," BEMPS - Bozen Economics & Management Paper Series BEMPS85, Faculty of Economics and Management at the Free University of Bozen.
    16. Jane Osburn, 2011. "A Latent Variable Approach to Examining the Effects of HR Policies on the Inter- and Intra-Establishment Wage and Employment Structure: A Study of Two Precision Manufacturing Industries," Working Papers 451, U.S. Bureau of Labor Statistics.
    17. Sileshi, Gudeta & Hailu, Girma & Nyadzi, Gerson I., 2009. "Traditional occupancy–abundance models are inadequate for zero-inflated ecological count data," Ecological Modelling, Elsevier, vol. 220(15), pages 1764-1775.
    18. Yang, Yan & Simpson, Douglas, 2010. "Unified computational methods for regression analysis of zero-inflated and bound-inflated data," Computational Statistics & Data Analysis, Elsevier, vol. 54(6), pages 1525-1534, June.
    19. Kathryn M. Irvine & T. J. Rodhouse & Ilai N. Keren, 2016. "Extending Ordinal Regression with a Latent Zero-Augmented Beta Distribution," Journal of Agricultural, Biological and Environmental Statistics, Springer;The International Biometric Society;American Statistical Association, vol. 21(4), pages 619-640, December.
    20. Camila Pareja Yale & Hugo Tsugunobu Yoshida Yoshizaki & Luiz Paulo Fávero, 2022. "A New Zero-Inflated Negative Binomial Multilevel Model for Forecasting the Demand of Disaster Relief Supplies in the State of Sao Paulo, Brazil," Mathematics, MDPI, vol. 10(22), pages 1-11, November.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:somere:v:53:y:2024:i:3:p:1319-1349. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.