IDEAS home Printed from https://ideas.repec.org/a/sae/compsc/v26y2009i1p46-66.html
   My bibliography  Save this article

Return of the Phantom Menace

Author

Listed:
  • Kevin A. Clarke

    (University of Rochester, USA, kevin.clarke@rochester.edu)

Abstract

Scholars often assume that the danger posed by omitted variable bias can be ameliorated by the inclusion of large numbers of relevant control variables. However, there is nothing in the mathematics of regression analysis that supports this conclusion. This paper goes beyond textbook treatments of omitted variable bias and shows, both for OLS and for generalized linear models, that the inclusion of additional control variables may increase or decrease the bias, and we cannot know for sure which is the case in any particular situation. The last section of the paper shows how formal sensitivity analysis can be used to determine whether omitted variables are a problem. A substantive example demonstrates the method.

Suggested Citation

  • Kevin A. Clarke, 2009. "Return of the Phantom Menace," Conflict Management and Peace Science, Peace Science Society (International), vol. 26(1), pages 46-66, February.
    • Handle: RePEc:sae:compsc:v:26:y:2009:i:1:p:46-66
    DOI: 10.1177/0738894208097666
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.1177/0738894208097666
    Download Restriction: no
    File URL: https://libkey.io/10.1177/0738894208097666?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Joseph G. Altonji & Todd E. Elder & Christopher R. Taber, 2005. "Selection on Observed and Unobserved Variables: Assessing the Effectiveness of Catholic Schools," Journal of Political Economy, University of Chicago Press, vol. 113(1), pages 151-184, February.
    2. Guildo W. Imbens, 2003. "Sensitivity to Exogeneity Assumptions in Program Evaluation," American Economic Review, American Economic Association, vol. 93(2), pages 126-132, May.
    3. Michael A. Bailey & Brian Kamoie & Forrest Maltzman, 2005. "Signals from the Tenth Justice: The Political Role of the Solicitor General in Supreme Court Decision Making," American Journal of Political Science, John Wiley & Sons, vol. 49(1), pages 72-85, January.
    4. Davidson, Russell & MacKinnon, James G., 1993. "Estimation and Inference in Econometrics," OUP Catalogue, Oxford University Press, number 9780195060119.
    5. Gelpi, Christopher & Feaver, Peter D., 2002. "Speak Softly and Carry a Big Stick? Veterans in the Political Elite and the American Use of Force," American Political Science Review, Cambridge University Press, vol. 96(4), pages 779-793, December.
    6. Vuong, Quang H, 1989. "Likelihood Ratio Tests for Model Selection and Non-nested Hypotheses," Econometrica, Econometric Society, vol. 57(2), pages 307-333, March.
    7. Clarke, Kevin A., 2007. "A Simple Distribution-Free Test for Nonnested Model Selection," Political Analysis, Cambridge University Press, vol. 15(3), pages 347-363, July.
    8. Welch, Finis, 1975. "Human Capital Theory: Education, Discrimination, and Life Cycles," American Economic Review, American Economic Association, vol. 65(2), pages 63-73, May.
    9. Krause, George A., 2003. "Coping with Uncertainty: Analyzing Risk Propensities of SEC Budgetary Decisions, 1949–97," American Political Science Review, Cambridge University Press, vol. 97(1), pages 171-188, February.
    10. Sims, Christopher A, 1980. "Macroeconomics and Reality," Econometrica, Econometric Society, vol. 48(1), pages 1-48, January.
    11. Meyer, Bruce D, 1995. "Natural and Quasi-experiments in Economics," Journal of Business & Economic Statistics, American Statistical Association, vol. 13(2), pages 151-161, April.
    12. Griliches, Zvi, 1977. "Estimating the Returns to Schooling: Some Econometric Problems," Econometrica, Econometric Society, vol. 45(1), pages 1-22, January.
    13. Hendry, David F. & Richard, Jean-Francois, 1982. "On the formulation of empirical models in dynamic econometrics," Journal of Econometrics, Elsevier, vol. 20(1), pages 3-33, October.
    14. Ansolabehere, Stephen & Gerber, Alan & Snyder, Jim, 2002. "Equal Votes, Equal Money: Court-Ordered Redistricting and Public Expenditures in the American States," American Political Science Review, Cambridge University Press, vol. 96(4), pages 767-777, December.
    15. Thomas J. Rudolph & Jillian Evans, 2005. "Political Trust, Ideology, and Public Support for Government Spending," American Journal of Political Science, John Wiley & Sons, vol. 49(3), pages 660-671, July.
    16. King, Gary & Honaker, James & Joseph, Anne & Scheve, Kenneth, 2001. "Analyzing Incomplete Political Science Data: An Alternative Algorithm for Multiple Imputation," American Political Science Review, Cambridge University Press, vol. 95(1), pages 49-69, March.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Kevin A. Clarke, 2005. "The Phantom Menace: Omitted Variable Bias in Econometric Research," Conflict Management and Peace Science, Peace Science Society (International), vol. 22(4), pages 341-352, September.
    2. Myoung-jae Lee, 2007. "Difference in Generalized-Differences with Panel Data: Effects of Moving from Private to Public School on Test Scores," Discussion Paper Series 0721, Institute of Economic Research, Korea University.
    3. Adrian C. Darnell, 1994. "A Dictionary Of Econometrics," Books, Edward Elgar Publishing, number 118.
    4. KAMKOUM, Arnaud Cedric, 2023. "The Federal Reserve’s Response to the Global Financial Crisis and its Effects: An Interrupted Time-Series Analysis of the Impact of its Quantitative Easing Programs," Thesis Commons d7pvg, Center for Open Science.
    5. Bierens, H.J. & Broersma, L., 1991. "The relation between unemployment and interest rate : some international evidence," Serie Research Memoranda 0112, VU University Amsterdam, Faculty of Economics, Business Administration and Econometrics.
    6. Seok, Sang Ik & Cho, Hoon & Ryu, Doojin, 2020. "The information content of funds from operations and net income in real estate investment trusts," The North American Journal of Economics and Finance, Elsevier, vol. 51(C).
    7. Mur, Jesús & Angulo, Ana, 2009. "Model selection strategies in a spatial setting: Some additional results," Regional Science and Urban Economics, Elsevier, vol. 39(2), pages 200-213, March.
    8. repec:wsr:wpaper:y:2010:i:057 is not listed on IDEAS
    9. Zhang, Dalu, 2014. "Vine copulas and applications to the European Union sovereign debt analysis," International Review of Financial Analysis, Elsevier, vol. 36(C), pages 46-56.
    10. Niklas Elert, 2014. "What determines entry? Evidence from Sweden," The Annals of Regional Science, Springer;Western Regional Science Association, vol. 53(1), pages 55-92, August.
    11. Michael A. Clemens & Claudio Montenegro & Lant Pritchett, 2016. "Bounding the Price Equivalent of Migration Barriers," Growth Lab Working Papers 67, Harvard's Growth Lab.
    12. O'Brien, Raymond & Patacchini, Eleonora, 2003. "Testing the exogeneity assumption in panel data models with "non classical" disturbances," Discussion Paper Series In Economics And Econometrics 0302, Economics Division, School of Social Sciences, University of Southampton.
    13. Antony W. Dnes & Raymond Swaray, 2020. "Criminalizing price‐fixing," Managerial and Decision Economics, John Wiley & Sons, Ltd., vol. 41(8), pages 1417-1430, December.
    14. In-Koo Cho & Kenneth Kasa, 2015. "Learning and Model Validation," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 82(1), pages 45-82.
    15. Scheiblecker, Marcus, 2013. "Between cointegration and multicointegration: Modelling time series dynamics by cumulative error correction models," Economic Modelling, Elsevier, vol. 31(C), pages 511-517.
    16. Erik Mellander & Sofia Sandgren‐Massih, 2008. "Proxying Ability by Family Background in Returns to Schooling Estimations is Generally a Bad Idea," Scandinavian Journal of Economics, Wiley Blackwell, vol. 110(4), pages 853-875, December.
    17. Genius, Margarita & Stefanou, Spiro E. & Tzouvelekas, Vangelis, 2012. "Measuring productivity growth under factor non-substitution: An application to US steam-electric power generation utilities," European Journal of Operational Research, Elsevier, vol. 220(3), pages 844-852.
    18. Tommaso Nannicini, 2007. "Simulation-based sensitivity analysis for matching estimators," Stata Journal, StataCorp LLC, vol. 7(3), pages 334-350, September.
    19. Stéphane Bonhomme & Martin Weidner, 2020. "Minimizing Sensitivity to Model Misspecification," CeMMAP working papers CWP37/20, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    20. Geweke, J. & Joel Horowitz & Pesaran, M.H., 2006. "Econometrics: A Bird’s Eye View," Cambridge Working Papers in Economics 0655, Faculty of Economics, University of Cambridge.
    21. Paul Glewwe, 2002. "Schools and Skills in Developing Countries: Education Policies and Socioeconomic Outcomes," Journal of Economic Literature, American Economic Association, vol. 40(2), pages 436-482, June.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:compsc:v:26:y:2009:i:1:p:46-66. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: http://pss.la.psu.edu/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.