IDEAS home Printed from https://ideas.repec.org/p/osf/socarx/bka76.html
   My bibliography  Save this paper

Identifying and Improving Functional Form Complexity: A Machine Learning Framework

Author

Listed:
  • Verhagen, Mark D.

Abstract

`All models are wrong, but some are useful' is an often-used mantra, particularly when a model's ability to capture the full complexities of social life is questioned. However, an appropriate functional form is key to valid statistical inference, and under-estimating complexity can lead to biased results. Unfortunately, it is unclear a-priori what the appropriate complexity of a functional form should be. I propose to use methods from machine learning to identify the appropriate complexity of the functional form by i) generating an estimate of the fit potential of the outcome given a set of explanatory variables, ii) comparing this potential with the fit from the functional form originally hypothesized by the researcher, and iii) in case a lack of fit is identified, using recent advances in the field of explainable AI to generate understanding into the missing complexity. I illustrate the approach with a range of simulation and real-world examples.

Suggested Citation

  • Verhagen, Mark D., 2021. "Identifying and Improving Functional Form Complexity: A Machine Learning Framework," SocArXiv bka76, Center for Open Science.
  • Handle: RePEc:osf:socarx:bka76
    DOI: 10.31219/osf.io/bka76
    as

    Download full text from publisher

    File URL: https://osf.io/download/61a5f1655d085f093b0d9c88/
    Download Restriction: no

    File URL: https://libkey.io/10.31219/osf.io/bka76?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. J. Scott Long & Pravin K. Trivedi, 1992. "Some Specification Tests for the Linear Regression Model," Sociological Methods & Research, , vol. 21(2), pages 161-204, November.
    2. Jurgen A. Doornik & David F. Hendry & Steve Cook, 2015. "Statistical model selection with “Big Data”," Cogent Economics & Finance, Taylor & Francis Journals, vol. 3(1), pages 1045216-104, December.
    3. Gang-Zhi Fan & Seow Eng Ong & Hian Chye Koh, 2006. "Determinants of House Price: A Decision Tree Approach," Urban Studies, Urban Studies Journal Limited, vol. 43(12), pages 2301-2315, November.
    4. James J. Heckman & John Eric Humphries & Gregory Veramendi, 2018. "Returns to Education: The Causal Effects of Education on Earnings, Health, and Smoking," Journal of Political Economy, University of Chicago Press, vol. 126(S1), pages 197-246.
    5. Matthew J. Salganik & Ian Lundberg & Alexander T. Kindel & Caitlin E. Ahearn & Khaled Al-Ghoneim & Abdullah Almaatouq & Drew M. Altschul & Jennie E. Brand & Nicole Bohme Carnegie & Ryan James Compton , 2020. "Measuring the predictability of life outcomes with a scientific mass collaboration," Proceedings of the National Academy of Sciences, Proceedings of the National Academy of Sciences, vol. 117(14), pages 8398-8403, April.
    6. Can, Ayse, 1992. "Specification and estimation of hedonic housing price models," Regional Science and Urban Economics, Elsevier, vol. 22(3), pages 453-474, September.
    7. Mark R. Joslyn & Donald P. Haider-Markel & Michael Baggs & Andrew Bilbo, 2017. "Emerging Political Identities? Gun Ownership and Voting in Presidential Elections-super-," Social Science Quarterly, Southwestern Social Science Association, vol. 98(2), pages 382-396, June.
    8. Valerio Baćak & Edward H. Kennedy, 2019. "Principled Machine Learning Using the Super Learner: An Application to Predicting Prison Violence," Sociological Methods & Research, , vol. 48(3), pages 698-721, August.
    9. Xavier X. Sala-i-Martin, 1997. "I Just Ran Four Million Regressions," NBER Working Papers 6252, National Bureau of Economic Research, Inc.
    10. Vaart Aad W. van der & Dudoit Sandrine & Laan Mark J. van der, 2006. "Oracle inequalities for multi-fold cross validation," Statistics & Risk Modeling, De Gruyter, vol. 24(3), pages 351-371, December.
    11. Sebastian Lapuschkin & Stephan Wäldchen & Alexander Binder & Grégoire Montavon & Wojciech Samek & Klaus-Robert Müller, 2019. "Unmasking Clever Hans predictors and assessing what machines really learn," Nature Communications, Nature, vol. 10(1), pages 1-8, December.
    12. J. Elhorst, 2010. "Applied Spatial Econometrics: Raising the Bar," Spatial Economic Analysis, Taylor & Francis Journals, vol. 5(1), pages 9-28.
    13. Yatchew,Adonis, 2003. "Semiparametric Regression for the Applied Econometrician," Cambridge Books, Cambridge University Press, number 9780521012263, January.
    14. Yatchew, A., 1997. "An elementary estimator of the partial linear model," Economics Letters, Elsevier, vol. 57(2), pages 135-143, December.
    15. Susan Athey, 2018. "The Impact of Machine Learning on Economics," NBER Chapters, in: The Economics of Artificial Intelligence: An Agenda, pages 507-547, National Bureau of Economic Research, Inc.
    16. Yun Liao, 2017. "Machine Learning in Macro-Economic Series Forecasting," International Journal of Economics and Finance, Canadian Center of Science and Education, vol. 9(12), pages 71-76, December.
    17. Sala-i-Martin, Xavier, 1997. "I Just Ran Two Million Regressions," American Economic Review, American Economic Association, vol. 87(2), pages 178-183, May.
    18. Richard M. Golden & Steven S. Henley & Halbert White & T. Michael Kashner, 2016. "Generalized Information Matrix Tests for Detecting Model Misspecification," Econometrics, MDPI, vol. 4(4), pages 1-24, November.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Verhagen, Mark D., 2023. "Using machine learning to monitor the equity of large-scale policy interventions: The Dutch decentralisation of the Social Domain," SocArXiv qzm7y, Center for Open Science.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Todd Landman & T. Huw Edwards & Tulio Antonio-Cravo & David Kernohan, 2011. "Human Rights: The Effect of Neighbouring Countries," Discussion Paper Series 2011_01, Department of Economics, Loughborough University, revised Sep 2011.
    2. Hannah Druckenmiller & Solomon Hsiang, 2018. "Accounting for Unobservable Heterogeneity in Cross Section Using Spatial First Differences," Papers 1810.07216, arXiv.org, revised Aug 2019.
    3. Rao, B. Bhaskara, 2010. "Estimates of the steady state growth rates for selected Asian countries with an extended Solow model," Economic Modelling, Elsevier, vol. 27(1), pages 46-53, January.
    4. Cho, Seo-young & Vadlamannati, Krishna Chaitanya, 2010. "Compliance for big brothers: An empirical analysis on the impact of the anti-trafficking protocol," University of Göttingen Working Papers in Economics 118, University of Goettingen, Department of Economics.
    5. Jeffrey Frankel, 2014. "Mauritius: African Success Story," NBER Chapters, in: African Successes, Volume IV: Sustainable Growth, pages 295-342, National Bureau of Economic Research, Inc.
    6. Roger M. Cooke & Harry Joe & Bo Chang, 2020. "Vine copula regression for observational studies," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 104(2), pages 141-167, June.
    7. Balima, Hippolyte Weneyam, 2020. "Coups d’état and the cost of debt," Journal of Comparative Economics, Elsevier, vol. 48(3), pages 509-528.
    8. Saaed, A.A.J., 2007. "Inflation and Economic Growth in Kuwait: 1985-2005. Evidence from Co-Integration and Error Correction Model," Applied Econometrics and International Development, Euro-American Association of Economic Development, vol. 7(1).
    9. Chong, Alberto E., 2006. "Does It Matter How People Speak?," IDB Publications (Working Papers) 1946, Inter-American Development Bank.
    10. Arturo Galindo & Alberto Chong & César Calderón, 2001. "Structure and Development of Financial Institutions and Links with Trust: Cross-Country Evidence," Research Department Publications 4251, Inter-American Development Bank, Research Department.
    11. Vojtěch Roženský, 2012. "Mandatorní výdaje a flexibilita fiskální politiky v ČR [Mandatory Expenditure and the Flexibility of Fiscal Policy in the Czech Republic]," Politická ekonomie, Prague University of Economics and Business, vol. 2012(1), pages 40-57.
    12. Mothuti Gosego & Phiri Andrew, 2018. "Inflation-Growth Nexus in Botswana: Can Lower Inflation Really Spur Growth in the Country?," Global Economy Journal, De Gruyter, vol. 18(4), pages 1-11, December.
    13. B. Bhaskara Rao & Arusha Cooray, 2012. "How useful is growth literature for policies in the developing countries?," Applied Economics, Taylor & Francis Journals, vol. 44(6), pages 671-681, February.
    14. Sudip Ranjan Basu, 2005. "Correlating Growth with Well-Being during Economic Reforms Evidence from India and China," Development and Comp Systems 0509010, University Library of Munich, Germany.
    15. Niclas Berggren & Mikael Elinder, 2012. "Is tolerance good or bad for growth?," Public Choice, Springer, vol. 150(1), pages 283-308, January.
    16. Magdalena Osińska & Tadeusz Kufel & Marcin Błażejowski & Paweł Kufel, 2020. "Modeling mechanism of economic growth using threshold autoregression models," Empirical Economics, Springer, vol. 58(3), pages 1381-1430, March.
    17. Titarenko, Deniss, 2007. "Investīciju struktūra un ekonomikas izaugsme Latvijā [Investment Structure and Economic Growth in Latvia]," MPRA Paper 19341, University Library of Munich, Germany.
    18. Samargandi, Nahla & Fidrmuc, Jan & Ghosh, Sugata, 2015. "Is the Relationship Between Financial Development and Economic Growth Monotonic? Evidence from a Sample of Middle-Income Countries," World Development, Elsevier, vol. 68(C), pages 66-81.
    19. Chakraborty, Shankha, 2004. "Endogenous lifetime and economic growth," Journal of Economic Theory, Elsevier, vol. 116(1), pages 119-137, May.
    20. Tingting Zheng & Zongxuan Chai & Pengfei Zuo & Xinyu Wang, 2024. "The Effect of Multilateral Economic Cooperation on Sustainable Natural Resource Development," Sustainability, MDPI, vol. 16(17), pages 1-25, August.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:osf:socarx:bka76. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: OSF (email available below). General contact details of provider: https://arabixiv.org .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.