IDEAS home Printed from https://ideas.repec.org/a/wly/apecpp/v45y2023i3p1292-1331.html
   My bibliography  Save this article

On the robustness/replication of econometric analyses from nonlinear models using various commonplace software packages

Author

Listed:
  • Oral Capps

Abstract

Because replicability is an important part of every scientific endeavor, this research deals with comparing and contrasting parameter estimates, standard errors, and p‐values from the estimation of five commonly encountered nonlinear models in applied econometrics. Commonplace software packages indigenous to econometrics and statistics are used, namely EVIEWS 11.0, SAS 9.4, Stata 17, and R 4.1.2 in five replication exercises to determine potential differences, if any, in empirical results. The hypothesis that mainstream software packages generate different empirical results in the estimation of nonlinear models is confirmed for the polynomial distributed lag (PDL) model and the GARCH(1,1) model. For the probit model and the Barten synthetic demand system model, the differences in parameter estimates, standard errors, and p‐values are less evident across the four commonly used software packages. For the Tobit model, the respective sets of parameter estimates, standard errors, and p‐values are nearly identical across the respective software packages. Economic analysts should not just accept estimation results uncritically, but instead, conduct sensitivity analyses involving the use of at least two software packages. The agricultural economics profession should adopt this recommendation as standard practice.

Suggested Citation

  • Oral Capps, 2023. "On the robustness/replication of econometric analyses from nonlinear models using various commonplace software packages," Applied Economic Perspectives and Policy, John Wiley & Sons, vol. 45(3), pages 1292-1331, September.
    • Handle: RePEc:wly:apecpp:v:45:y:2023:i:3:p:1292-1331
    DOI: 10.1002/aepp.13367
    as

    Download full text from publisher

    File URL: https://doi.org/10.1002/aepp.13367
    Download Restriction: no
    File URL: https://libkey.io/10.1002/aepp.13367?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Capps, Oral & Bessler, David A. & Williams, Gary W., 2016. "The Ramifications of Nearly Going Dark: A Natural Experiment in the Case of U.S. Generic Orange Juice Advertising," Agricultural and Resource Economics Review, Cambridge University Press, vol. 45(1), pages 68-97, April.
    2. Capps, Oral & Bessler, David A. & Williams, Gary W., 2016. "The Ramifications of Nearly Going Dark: A Natural Experiment in the Case of U.S. Generic Orange Juice Advertising," Agricultural and Resource Economics Review, Cambridge University Press, vol. 45(1), pages 68-97, April.
    3. Capps, Oral Jr. & Gvillo, Rejeana Marie, 2020. "Economic and Sociodemographic Drivers Associated with the Decision to Purchase Food Items and Nonalcoholic Beverages from Vending Machines in the United States," Journal of Food Distribution Research, Food Distribution Research Society, vol. 51(3), November.
    4. Veall, Michael R & Zimmermann, Klaus F, 1996. "Pseudo-R-[superscript 2] Measures for Some Common Limited Dependent Variable Models," Journal of Economic Surveys, Wiley Blackwell, vol. 10(3), pages 241-259, September.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Capps, O., . "Targeted Advertising and Promotion Campaigns_A Case Study of the National Pork Board," Journal of Agribusiness, Agricultural Economics Association of Georgia, vol. 38(1).
    2. Batie, Cicely M. & Dennis, Elliott J. & Lubben, Bradley D., 2020. "Do state-level agricultural promotion programs increase agricultural output? The case of the Livestock Friendly County designation program in Nebraska," 2020 Annual Meeting, July 26-28, Kansas City, Missouri 304399, Agricultural and Applied Economics Association.
    3. Shew, Aaron M. & Nalley, Lawton L. & Durand-Morat, Alvaro & Meredith, Kylie & Parajuli, Ranjan & Thoma, Greg & Henry, Christopher G., 2021. "Holistically valuing public investments in agricultural water conservation," Agricultural Water Management, Elsevier, vol. 252(C).
    4. Lovejoy, Kristin, 2012. "Mobility Fulfillment Among Low-car Households: Implications for Reducing Auto Dependence in the United States," Institute of Transportation Studies, Working Paper Series qt4v44b5qn, Institute of Transportation Studies, UC Davis.
    5. Arcidiacono, Peter & Kinsler, Josh & Ransom, Tyler, 2022. "Asian American Discrimination in Harvard Admissions," European Economic Review, Elsevier, vol. 144(C).
    6. Y. Wu, 1998. "Redundancy and Firm Characteristics in Chinese State-owned Enterprises," Economics Discussion / Working Papers 98-17, The University of Western Australia, Department of Economics.
    7. Md Irteja Islam & Shah Saif Jahan & Mohammad Tawfique Hossain Chowdhury & Samia Naz Isha & Arup Kumar Saha & Sujan Kanti Nath & Mohammed Shahed Jahan & Md. Humayun Kabir & Ehsanul Hoque Apu & Russell , 2022. "Experience of Bangladeshi Dental Students towards Online Learning during the COVID-19 Pandemic: A Web-Based Cross-Sectional Study," IJERPH, MDPI, vol. 19(13), pages 1-13, June.
    8. Sengupta, Sanchita & Kurkalova, Lyubov A. & Kling, Catherine L., 2006. "Avoiding biases from data-dependent specification search: an application to a tillage choice model," 2006 Annual meeting, July 23-26, Long Beach, CA 21399, American Agricultural Economics Association (New Name 2008: Agricultural and Applied Economics Association).
    9. Corrado Giulietti & Guangjie Ning & Klaus F. Zimmermann, 2012. "Self‐employment of rural‐to‐urban migrants in China," International Journal of Manpower, Emerald Group Publishing Limited, vol. 33(1), pages 96-117, March.
    10. Pim Verbunt & Anne-Catherine Guio, 2019. "Explaining Differences Within and Between Countries in the Risk of Income Poverty and Severe Material Deprivation: Comparing Single and Multilevel Analyses," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 144(2), pages 827-868, July.
    11. Salvatore Ingrassia & Antonio Punzo, 2020. "Cluster Validation for Mixtures of Regressions via the Total Sum of Squares Decomposition," Journal of Classification, Springer;The Classification Society, vol. 37(2), pages 526-547, July.
    12. Gero Carletto & Alberto Zezza, 2006. "Being poor, feeling poorer: Combining objective and subjective measures of welfare in Albania," Journal of Development Studies, Taylor & Francis Journals, vol. 42(5), pages 739-760.
    13. Patrick A. Puhani, 2000. "On the Identification of Relative Wage Rigidity Dynamics," William Davidson Institute Working Papers Series 343, William Davidson Institute at the University of Michigan.
    14. Lindsay M. Tedds, 2005. "Keeping It Off The Books: An Empirical Investigation Into the Characteristics of Firms That Engage In Tax Non-Compliance," Department of Economics Working Papers 2005-01, McMaster University.
    15. Dirk Czarnitzki & Kornelius Kraft, 2007. "Are credit ratings valuable information?," Applied Financial Economics, Taylor & Francis Journals, vol. 17(13), pages 1061-1070.
    16. Joyce P. Jacobsen, 2003. "Do Women and Non-economists Add Diversity to Research in Industrial Relations and Labor Economics?," Eastern Economic Journal, Eastern Economic Association, vol. 29(4), pages 575-591, Fall.
    17. Frömmel, Michael & Midiliç, Murat, 2021. "Daily currency interventions in an emerging market: Incorporating reserve accumulation to the reaction function," Economic Modelling, Elsevier, vol. 97(C), pages 461-476.
    18. Rudolf Winter-Ebmer & Josef Zweimüller, 1999. "Do immigrants displace young native workers: The Austrian experience," Journal of Population Economics, Springer;European Society for Population Economics, vol. 12(2), pages 327-340.
    19. Rotte, Ralph & Zimmermann, Klaus F, 1998. "Fiscal Restraint and the Political Economy of EMU," Public Choice, Springer, vol. 94(3-4), pages 385-406, March.
    20. Biagio Simonetti & Pasquale Sarnacchiaro & M. Rosario González Rodríguez, 2017. "Goodness of fit measures for logistic regression model: an application for students’ evaluations of university teaching," Quality & Quantity: International Journal of Methodology, Springer, vol. 51(6), pages 2545-2554, November.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wly:apecpp:v:45:y:2023:i:3:p:1292-1331. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: https://doi.org/10.1002/(ISSN)2040-5804 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.