IDEAS home Printed from https://ideas.repec.org/a/sae/compsc/v26y2009i1p46-66.html
   My bibliography  Save this article

Return of the Phantom Menace

Author

Listed:
  • Kevin A. Clarke

    (University of Rochester, USA, kevin.clarke@rochester.edu)

Abstract

Scholars often assume that the danger posed by omitted variable bias can be ameliorated by the inclusion of large numbers of relevant control variables. However, there is nothing in the mathematics of regression analysis that supports this conclusion. This paper goes beyond textbook treatments of omitted variable bias and shows, both for OLS and for generalized linear models, that the inclusion of additional control variables may increase or decrease the bias, and we cannot know for sure which is the case in any particular situation. The last section of the paper shows how formal sensitivity analysis can be used to determine whether omitted variables are a problem. A substantive example demonstrates the method.

Suggested Citation

  • Kevin A. Clarke, 2009. "Return of the Phantom Menace," Conflict Management and Peace Science, Peace Science Society (International), vol. 26(1), pages 46-66, February.
    • Handle: RePEc:sae:compsc:v:26:y:2009:i:1:p:46-66
    DOI: 10.1177/0738894208097666
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.1177/0738894208097666
    Download Restriction: no
    File URL: https://libkey.io/10.1177/0738894208097666?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Joseph G. Altonji & Todd E. Elder & Christopher R. Taber, 2005. "Selection on Observed and Unobserved Variables: Assessing the Effectiveness of Catholic Schools," Journal of Political Economy, University of Chicago Press, vol. 113(1), pages 151-184, February.
    2. Guildo W. Imbens, 2003. "Sensitivity to Exogeneity Assumptions in Program Evaluation," American Economic Review, American Economic Association, vol. 93(2), pages 126-132, May.
    3. Michael A. Bailey & Brian Kamoie & Forrest Maltzman, 2005. "Signals from the Tenth Justice: The Political Role of the Solicitor General in Supreme Court Decision Making," American Journal of Political Science, John Wiley & Sons, vol. 49(1), pages 72-85, January.
    4. Gelpi, Christopher & Feaver, Peter D., 2002. "Speak Softly and Carry a Big Stick? Veterans in the Political Elite and the American Use of Force," American Political Science Review, Cambridge University Press, vol. 96(4), pages 779-793, December.
    5. Welch, Finis, 1975. "Human Capital Theory: Education, Discrimination, and Life Cycles," American Economic Review, American Economic Association, vol. 65(2), pages 63-73, May.
    6. Hendry, David F. & Richard, Jean-Francois, 1982. "On the formulation of empirical models in dynamic econometrics," Journal of Econometrics, Elsevier, vol. 20(1), pages 3-33, October.
    7. Thomas J. Rudolph & Jillian Evans, 2005. "Political Trust, Ideology, and Public Support for Government Spending," American Journal of Political Science, John Wiley & Sons, vol. 49(3), pages 660-671, July.
    8. Davidson, Russell & MacKinnon, James G., 1993. "Estimation and Inference in Econometrics," OUP Catalogue, Oxford University Press, number 9780195060119.
    9. Clarke, Kevin A., 2007. "A Simple Distribution-Free Test for Nonnested Model Selection," Political Analysis, Cambridge University Press, vol. 15(3), pages 347-363, July.
    10. Meyer, Bruce D, 1995. "Natural and Quasi-experiments in Economics," Journal of Business & Economic Statistics, American Statistical Association, vol. 13(2), pages 151-161, April.
    11. Ansolabehere, Stephen & Gerber, Alan & Snyder, Jim, 2002. "Equal Votes, Equal Money: Court-Ordered Redistricting and Public Expenditures in the American States," American Political Science Review, Cambridge University Press, vol. 96(4), pages 767-777, December.
    12. Vuong, Quang H, 1989. "Likelihood Ratio Tests for Model Selection and Non-nested Hypotheses," Econometrica, Econometric Society, vol. 57(2), pages 307-333, March.
    13. Krause, George A., 2003. "Coping with Uncertainty: Analyzing Risk Propensities of SEC Budgetary Decisions, 1949–97," American Political Science Review, Cambridge University Press, vol. 97(1), pages 171-188, February.
    14. Sims, Christopher A, 1980. "Macroeconomics and Reality," Econometrica, Econometric Society, vol. 48(1), pages 1-48, January.
    15. King, Gary & Honaker, James & Joseph, Anne & Scheve, Kenneth, 2001. "Analyzing Incomplete Political Science Data: An Alternative Algorithm for Multiple Imputation," American Political Science Review, Cambridge University Press, vol. 95(1), pages 49-69, March.
    16. Griliches, Zvi, 1977. "Estimating the Returns to Schooling: Some Econometric Problems," Econometrica, Econometric Society, vol. 45(1), pages 1-22, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Kevin A. Clarke, 2005. "The Phantom Menace: Omitted Variable Bias in Econometric Research," Conflict Management and Peace Science, Peace Science Society (International), vol. 22(4), pages 341-352, September.
    2. Adrian C. Darnell, 1994. "A Dictionary Of Econometrics," Books, Edward Elgar Publishing, number 118.
    3. Myoung-jae Lee, 2007. "Difference in Generalized-Differences with Panel Data: Effects of Moving from Private to Public School on Test Scores," Discussion Paper Series 0721, Institute of Economic Research, Korea University.
    4. KAMKOUM, Arnaud Cedric, 2023. "The Federal Reserve’s Response to the Global Financial Crisis and its Effects: An Interrupted Time-Series Analysis of the Impact of its Quantitative Easing Programs," Thesis Commons d7pvg, Center for Open Science.
    5. Seok, Sang Ik & Cho, Hoon & Ryu, Doojin, 2020. "The information content of funds from operations and net income in real estate investment trusts," The North American Journal of Economics and Finance, Elsevier, vol. 51(C).
    6. Zhang, Dalu, 2014. "Vine copulas and applications to the European Union sovereign debt analysis," International Review of Financial Analysis, Elsevier, vol. 36(C), pages 46-56.
    7. Michael A. Clemens & Claudio Montenegro & Lant Pritchett, 2016. "Bounding the Price Equivalent of Migration Barriers," Growth Lab Working Papers 67, Harvard's Growth Lab.
    8. O'Brien, Raymond & Patacchini, Eleonora, 2003. "Testing the exogeneity assumption in panel data models with "non classical" disturbances," Discussion Paper Series In Economics And Econometrics 0302, Economics Division, School of Social Sciences, University of Southampton.
    9. Scheiblecker, Marcus, 2013. "Between cointegration and multicointegration: Modelling time series dynamics by cumulative error correction models," Economic Modelling, Elsevier, vol. 31(C), pages 511-517.
    10. Erik Mellander & Sofia Sandgren‐Massih, 2008. "Proxying Ability by Family Background in Returns to Schooling Estimations is Generally a Bad Idea," Scandinavian Journal of Economics, Wiley Blackwell, vol. 110(4), pages 853-875, December.
    11. Geweke, J. & Joel Horowitz & Pesaran, M.H., 2006. "Econometrics: A Bird’s Eye View," Cambridge Working Papers in Economics 0655, Faculty of Economics, University of Cambridge.
    12. Greenstone, Michael & Gayer, Ted, 2009. "Quasi-experimental and experimental approaches to environmental economics," Journal of Environmental Economics and Management, Elsevier, vol. 57(1), pages 21-44, January.
    13. Imai, Masami, 2022. "Local economic impacts of legislative malapportionment," Journal of Urban Economics, Elsevier, vol. 131(C).
    14. Joshua D. Angrist & Jörn-Steffen Pischke, 2010. "The Credibility Revolution in Empirical Economics: How Better Research Design Is Taking the Con out of Econometrics," Journal of Economic Perspectives, American Economic Association, vol. 24(2), pages 3-30, Spring.
    15. Matthew A. Masten & Alexandre Poirier, 2020. "Inference on breakdown frontiers," Quantitative Economics, Econometric Society, vol. 11(1), pages 41-111, January.
    16. Montagnoli, Alberto & Taylor, Karl, 2024. "Who Cares about Investing Responsibly? Attitudes and Financial Decisions," IZA Discussion Papers 16952, Institute of Labor Economics (IZA).
    17. Inyoung Chae & Jihyeon Ha & David A. Schweidel, 2023. "Paywall Suspensions and Digital News Subscriptions," Marketing Science, INFORMS, vol. 42(4), pages 729-745, July.
    18. Gustavo J Bobonis & Roberto Castro & Juan S Morales, 2020. "Legal Reforms, Conditional Cash Transfers, and Intimate Partner Violence: Evidence from Mexico," Working Papers tecipa-678, University of Toronto, Department of Economics.
    19. Caliendo, Marco & Mahlstedt, Robert & Mitnik, Oscar A., 2017. "Unobservable, but unimportant? The relevance of usually unobserved variables for the evaluation of labor market policies," Labour Economics, Elsevier, vol. 46(C), pages 14-25.
    20. Andersen, Steffen & Harrison, Glenn W. & Lau, Morten Igel & Rutström, Elisabet E., 2010. "Behavioral econometrics for psychologists," Journal of Economic Psychology, Elsevier, vol. 31(4), pages 553-576, August.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:compsc:v:26:y:2009:i:1:p:46-66. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: http://pss.la.psu.edu/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.