IDEAS home Printed from https://ideas.repec.org/p/arx/papers/1912.08726.html
   My bibliography  Save this paper

Econometrics For Decision Making: Building Foundations Sketched By Haavelmo And Wald

Author

Listed:
  • Charles F. Manski

Abstract

Haavelmo (1944) proposed a probabilistic structure for econometric modeling, aiming to make econometrics useful for decision making. His fundamental contribution has become thoroughly embedded in subsequent econometric research, yet it could not answer all the deep issues that the author raised. Notably, Haavelmo struggled to formalize the implications for decision making of the fact that models can at most approximate actuality. In the same period, Wald (1939, 1945) initiated his own seminal development of statistical decision theory. Haavelmo favorably cited Wald, but econometrics did not embrace statistical decision theory. Instead, it focused on study of identification, estimation, and statistical inference. This paper proposes statistical decision theory as a framework for evaluation of the performance of models in decision making. I particularly consider the common practice of as-if optimization: specification of a model, point estimation of its parameters, and use of the point estimate to make a decision that would be optimal if the estimate were accurate. A central theme is that one should evaluate as-if optimization or any other model-based decision rule by its performance across the state space, listing all states of nature that one believes feasible, not across the model space. I apply the theme to prediction and treatment choice. Statistical decision theory is conceptually simple, but application is often challenging. Advancement of computation is the primary task to continue building the foundations sketched by Haavelmo and Wald.

Suggested Citation

  • Charles F. Manski, 2019. "Econometrics For Decision Making: Building Foundations Sketched By Haavelmo And Wald," Papers 1912.08726, arXiv.org, revised Feb 2021.
  • Handle: RePEc:arx:papers:1912.08726
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/1912.08726
    File Function: Latest version
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Manski, Charles F, 1990. "Nonparametric Bounds on Treatment Effects," American Economic Review, American Economic Association, vol. 80(2), pages 319-323, May.
    2. Charles F. Manski, 1989. "Anatomy of the Selection Problem," Journal of Human Resources, University of Wisconsin Press, vol. 24(3), pages 343-360.
    3. Stoye, Jörg, 2009. "Minimax regret treatment choice with finite samples," Journal of Econometrics, Elsevier, vol. 151(1), pages 70-81, July.
    4. Francis X. Diebold, 2015. "Comparing Predictive Accuracy, Twenty Years Later: A Personal Perspective on the Use and Abuse of Diebold-Mariano Tests," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 33(1), pages 1-1, January.
    5. Yi Cheng, 2003. "Choosing sample size for a clinical trial using decision analysis," Biometrika, Biometrika Trust, vol. 90(4), pages 923-936, December.
    6. Valentyn Litvin & Charles F. Manski, 2021. "Evaluating the maximum regret of statistical treatment rules with sample data on treatment response," Stata Journal, StataCorp LP, vol. 21(1), pages 97-122, March.
    7. Keisuke Hirano & Jack R. Porter, 2009. "Asymptotics for Statistical Treatment Rules," Econometrica, Econometric Society, vol. 77(5), pages 1683-1701, September.
    8. Bjerkholt, Olav, 2010. "The “Meteorological” and the “Engineering” Type of Econometric Inference: a 1943 Exchange between Trygve Haavelmo and Jakob Marschak," Memorandum 07/2010, Oslo University, Department of Economics.
    9. Bjerkholt, Olav, 2007. "Writing “The Probability Approach” With Nowhere To Go: Haavelmo In The United States, 1939–1944," Econometric Theory, Cambridge University Press, vol. 23(5), pages 775-837, October.
    10. Eric Mbakop & Max Tabord‐Meehan, 2021. "Model Selection for Treatment Choice: Penalized Welfare Maximization," Econometrica, Econometric Society, vol. 89(2), pages 825-848, March.
    11. Toru Kitagawa & Aleksey Tetenov, 2018. "Who Should Be Treated? Empirical Welfare Maximization Methods for Treatment Choice," Econometrica, Econometric Society, vol. 86(2), pages 591-616, March.
    12. Gary Chamberlain & Marcelo J. Moreira, 2009. "Decision Theory Applied to a Linear Panel Data Model," Econometrica, Econometric Society, vol. 77(1), pages 107-133, January.
    13. Bjerkholt, Olav, 2015. "Trygve Haavelmo At The Cowles Commission," Econometric Theory, Cambridge University Press, vol. 31(1), pages 1-84, February.
    14. Gary Chamberlain, 2007. "Decision Theory Applied to an Instrumental Variables Model," Econometrica, Econometric Society, vol. 75(3), pages 609-652, May.
    15. Charles F. Manski, 2004. "Statistical Treatment Rules for Heterogeneous Populations," Econometrica, Econometric Society, vol. 72(4), pages 1221-1246, July.
    16. Charles F. Manski & Aleksey Tetenov, 2014. "The Quantile Performance of Statistical Treatment Rules Using Hypothesis Tests to Allocate a Population to Two Treatments," CeMMAP working papers CWP44/14, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    17. Hausman, Jerry, 2015. "Specification tests in econometrics," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 38(2), pages 112-134.
    18. Charles F. Manski & Max Tabord-Meehan, 2017. "Evaluating the maximum MSE of mean estimators with missing data," Stata Journal, StataCorp LP, vol. 17(3), pages 723-735, September.
    19. Manski, Charles F., 2000. "Identification problems and decisions under ambiguity: Empirical analysis of treatment response and normative analysis of treatment choice," Journal of Econometrics, Elsevier, vol. 95(2), pages 415-442, April.
    20. Charles F Manski, 2007. "Adaptive Minimax-Regret Treatment Choice, with Application to Drug Approval," Levine's Working Paper Archive 122247000000001404, David K. Levine.
    21. Joshua D. Angrist & Kathryn Graddy & Guido W. Imbens, 2000. "The Interpretation of Instrumental Variables Estimators in Simultaneous Equations Models with an Application to the Demand for Fish," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 67(3), pages 499-527.
    22. Susan Athey & Stefan Wager, 2021. "Policy Learning With Observational Data," Econometrica, Econometric Society, vol. 89(1), pages 133-161, January.
    23. Charles F. Manski, 2019. "Treatment Choice With Trial Data: Statistical Decision Theory Should Supplant Hypothesis Testing," The American Statistician, Taylor & Francis Journals, vol. 73(S1), pages 296-304, March.
    24. Milton Friedman & L. J. Savage, 1948. "The Utility Analysis of Choices Involving Risk," Journal of Political Economy, University of Chicago Press, vol. 56(4), pages 279-279.
    25. Matthew A. Masten & Alexandre Poirier, 2021. "Salvaging Falsified Instrumental Variable Models," Econometrica, Econometric Society, vol. 89(3), pages 1449-1469, May.
    26. Imbens, Guido W & Angrist, Joshua D, 1994. "Identification and Estimation of Local Average Treatment Effects," Econometrica, Econometric Society, vol. 62(2), pages 467-475, March.
    27. Jeff Dominitz & Charles F. Manski, 2017. "More Data or Better Data? A Statistical Decision Problem," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 84(4), pages 1583-1605.
    28. Gilboa, Itzhak & Schmeidler, David, 1989. "Maxmin expected utility with non-unique prior," Journal of Mathematical Economics, Elsevier, vol. 18(2), pages 141-153, April.
    29. Andrew J. Patton, 2020. "Comparing Possibly Misspecified Forecasts," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 38(4), pages 796-809, October.
    30. Manski, Charles F., 2007. "Minimax-regret treatment choice with missing outcome data," Journal of Econometrics, Elsevier, vol. 139(1), pages 105-115, July.
    31. David J. Spiegelhalter & Laurence S. Freedman & Mahesh K. B. Parmar, 1994. "Bayesian Approaches to Randomized Trials," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 157(3), pages 357-387, May.
    32. Ben-Akiva, Moshe & McFadden, Daniel & Train, Kenneth, 2019. "Foundations of Stated Preference Elicitation: Consumer Behavior and Choice-based Conjoint Analysis," Foundations and Trends(R) in Econometrics, now publishers, vol. 10(1-2), pages 1-144, January.
    33. Stoye, Jörg, 2012. "Minimax regret treatment choice with covariates or with limited validity of experiments," Journal of Econometrics, Elsevier, vol. 166(1), pages 138-156.
    34. White, Halbert, 1982. "Maximum Likelihood Estimation of Misspecified Models," Econometrica, Econometric Society, vol. 50(1), pages 1-25, January.
    35. Charles F. Manski & Aleksey Tetenov, 2019. "Trial Size for Near-Optimal Choice Between Surveillance and Aggressive Treatment: Reconsidering MSLT-II," The American Statistician, Taylor & Francis Journals, vol. 73(S1), pages 305-311, March.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Timothy Christensen & Hyungsik Roger Moon & Frank Schorfheide, 2022. "Optimal Decision Rules when Payoffs are Partially Identified," Papers 2204.11748, arXiv.org, revised May 2023.
    2. Gloria González‐Rivera & C. Vladimir Rodríguez‐Caballero & Esther Ruiz, 2024. "Expecting the unexpected: Stressed scenarios for economic growth," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 39(5), pages 926-942, August.
    3. Karun Adusumilli, 2022. "How to sample and when to stop sampling: The generalized Wald problem and minimax policies," Papers 2210.15841, arXiv.org, revised Feb 2024.
    4. Maximilian Blesch & Philipp Eisenhauer, 2023. "Robust Decision-Making under Risk and Ambiguity," Rationality and Competition Discussion Paper Series 463, CRC TRR 190 Rationality and Competition.
    5. Manski, Charles F., 2023. "Probabilistic prediction for binary treatment choice: With focus on personalized medicine," Journal of Econometrics, Elsevier, vol. 234(2), pages 647-663.
    6. Charles F. Manski, 2023. "Using Limited Trial Evidence to Credibly Choose Treatment Dosage when Efficacy and Adverse Effects Weakly Increase with Dose," NBER Working Papers 31305, National Bureau of Economic Research, Inc.
    7. Charles F. Manski & Aleksey Tetenov, 2023. "Statistical decision theory respecting stochastic dominance," The Japanese Economic Review, Springer, vol. 74(4), pages 447-469, October.
    8. Xiaoyu Cheng, 2023. "Improving Robust Decisions with Data," Papers 2310.16281, arXiv.org, revised Jul 2024.
    9. Federico Crippa, 2024. "Regret Analysis in Threshold Policy Design," Papers 2404.11767, arXiv.org.
    10. Patrick Kline, 2023. "A Comment on: “Invidious Comparisons: Ranking and Selection as Compound Decisions” by Jiaying Gu and Roger Koenker," Econometrica, Econometric Society, vol. 91(1), pages 47-52, January.
    11. Philipp Eisenhauer & Jano's Gabler & Lena Janys & Christopher Walsh, 2021. "Structural models for policy-making: Coping with parametric uncertainty," Papers 2103.01115, arXiv.org, revised Jun 2022.
    12. Maximilian Blesch & Philipp Eisenhauer, 2021. "Robust decision-making under risk and ambiguity," Papers 2104.12573, arXiv.org, revised Oct 2021.
    13. Raffaella Giacomini & Sokbae Lee & Silvia Sarpietro, 2023. "A Robust Method for Microforecasting and Estimation of Random Effects," Papers 2308.01596, arXiv.org.
    14. Philipp Eisenhauer & Janos Gabler & Lena Janys, 2021. "Structural Models for Policy-Making: Coping with Parametric Uncertainty," ECONtribute Discussion Papers Series 082, University of Bonn and University of Cologne, Germany.
    15. Eisenhauer, Philipp & Gabler, Janos & Janys, Lena, 2021. "Structural Models for Policy-Making: Coping with Parametric Uncertainty," IZA Discussion Papers 14317, Institute of Labor Economics (IZA).
    16. Maximilian Blesch & Philipp Eisenhauer, 2021. "Robust Decision-Making Under Risk and Ambiguity," ECONtribute Discussion Papers Series 104, University of Bonn and University of Cologne, Germany.
    17. Gloria Gonzalez-Rivera & Vladimir Rodriguez-Caballero & Esther Ruiz, 2023. "Expecting the unexpected: Stressed scenarios for economic growth," Working Papers 202314, University of California at Riverside, Department of Economics.
    18. Toru Kitagawa & Sokbae Lee & Chen Qiu, 2022. "Treatment Choice with Nonlinear Regret," Papers 2205.08586, arXiv.org, revised Oct 2024.
    19. Charles F. Manski, 2022. "Identification and Statistical Decision Theory," Papers 2204.11318, arXiv.org, revised Mar 2024.
    20. Bernhard Kasberger & Kyle Woodward, 2021. "Bidding in Multi-Unit Auctions under Limited Information," Papers 2112.11320, arXiv.org, revised Apr 2023.
    21. Seungjin Han & Julius Owusu & Youngki Shin, 2022. "Statistical Treatment Rules under Social Interaction," Papers 2209.09077, arXiv.org, revised Nov 2022.
    22. Jeff Dominitz & Charles F. Manski, 2024. "Comprehensive OOS Evaluation of Predictive Algorithms with Statistical Decision Theory," Papers 2403.11016, arXiv.org, revised May 2024.
    23. Keisuke Hirano, 2023. "A Comment on: “Invidious Comparisons: Ranking and Selection as Compound Decisions” by Jiaying Gu and Roger Koenker," Econometrica, Econometric Society, vol. 91(1), pages 43-46, January.
    24. Philipp Eisenhauer & Lena Janys & Christopher Walsh & Janós Gabler, 2023. "Structural Models for Policy-Making," CRC TR 224 Discussion Paper Series crctr224_2023_484, University of Bonn and University of Mannheim, Germany.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Charles F. Manski, 2019. "Statistical inference for statistical decisions," Papers 1909.06853, arXiv.org.
    2. Manski, Charles F., 2023. "Probabilistic prediction for binary treatment choice: With focus on personalized medicine," Journal of Econometrics, Elsevier, vol. 234(2), pages 647-663.
    3. Toru Kitagawa & Sokbae Lee & Chen Qiu, 2022. "Treatment Choice with Nonlinear Regret," Papers 2205.08586, arXiv.org, revised Oct 2024.
    4. Daido Kido, 2023. "Locally Asymptotically Minimax Statistical Treatment Rules Under Partial Identification," Papers 2311.08958, arXiv.org.
    5. Thomas M. Russell, 2020. "Policy Transforms and Learning Optimal Policies," Papers 2012.11046, arXiv.org.
    6. Timothy Christensen & Hyungsik Roger Moon & Frank Schorfheide, 2022. "Optimal Decision Rules when Payoffs are Partially Identified," Papers 2204.11748, arXiv.org, revised May 2023.
    7. Kitagawa, Toru & Wang, Guanyi, 2023. "Who should get vaccinated? Individualized allocation of vaccines over SIR network," Journal of Econometrics, Elsevier, vol. 232(1), pages 109-131.
    8. Charles F. Manski, 2019. "Meta-Analysis for Medical Decisions," NBER Working Papers 25504, National Bureau of Economic Research, Inc.
    9. Yuchen Hu & Henry Zhu & Emma Brunskill & Stefan Wager, 2024. "Minimax-Regret Sample Selection in Randomized Experiments," Papers 2403.01386, arXiv.org, revised Jun 2024.
    10. Susan Athey & Stefan Wager, 2021. "Policy Learning With Observational Data," Econometrica, Econometric Society, vol. 89(1), pages 133-161, January.
    11. Augustine Denteh & Helge Liebert, 2022. "Who Increases Emergency Department Use? New Insights from the Oregon Health Insurance Experiment," Papers 2201.07072, arXiv.org, revised Apr 2023.
    12. Charles F. Manski & Aleksey Tetenov, 2015. "Clinical trial design enabling ε-optimal treatment rules," CeMMAP working papers 60/15, Institute for Fiscal Studies.
    13. Seungjin Han & Julius Owusu & Youngki Shin, 2022. "Statistical Treatment Rules under Social Interaction," Papers 2209.09077, arXiv.org, revised Nov 2022.
    14. Yuehao Bai & Azeem M. Shaikh & Max Tabord-Meehan, 2024. "A Primer on the Analysis of Randomized Experiments and a Survey of some Recent Advances," Papers 2405.03910, arXiv.org.
    15. Chunrong Ai & Yue Fang & Haitian Xie, 2024. "Data-driven Policy Learning for a Continuous Treatment," Papers 2402.02535, arXiv.org.
    16. Jeff Dominitz & Charles F. Manski, 2024. "Comprehensive OOS Evaluation of Predictive Algorithms with Statistical Decision Theory," Papers 2403.11016, arXiv.org, revised May 2024.
    17. Masahiro Kato & Masaaki Imaizumi & Takuya Ishihara & Toru Kitagawa, 2023. "Asymptotically Optimal Fixed-Budget Best Arm Identification with Variance-Dependent Bounds," Papers 2302.02988, arXiv.org, revised Jul 2023.
    18. Eric Mbakop & Max Tabord‐Meehan, 2021. "Model Selection for Treatment Choice: Penalized Welfare Maximization," Econometrica, Econometric Society, vol. 89(2), pages 825-848, March.
    19. Garbero, Alessandra & Sakos, Grayson & Cerulli, Giovanni, 2023. "Towards data-driven project design: Providing optimal treatment rules for development projects," Socio-Economic Planning Sciences, Elsevier, vol. 89(C).
    20. Guido W. Imbens & Jeffrey M. Wooldridge, 2009. "Recent Developments in the Econometrics of Program Evaluation," Journal of Economic Literature, American Economic Association, vol. 47(1), pages 5-86, March.

    More about this item

    JEL classification:

    • B23 - Schools of Economic Thought and Methodology - - History of Economic Thought since 1925 - - - Econometrics; Quantitative and Mathematical Studies
    • C1 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General
    • C5 - Mathematical and Quantitative Methods - - Econometric Modeling

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:1912.08726. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.