IDEAS home Printed from https://ideas.repec.org/p/fip/fedgfe/2019-13.html
   My bibliography  Save this paper

Test Questions, Economic Outcomes, and Inequality

Author

Abstract

Standard achievement scales aggregate test questions without considering their relationship to economic outcomes. This paper uses question-level data to improve the measurement of achievement in two ways. First, the paper constructs alternative achievement scales by relating individual questions directly to school completion and labor market outcomes. Second, the paper leverages the question data to construct multiple such scales in order to correct for biases stemming from measurement error. These new achievement scales rank students differently than standard scales and typically yield achievement gaps by race, gender, and household income that are larger by 0.1 to 0.5 standard deviations. Differential performance on test questions can fully explain black-white differences in both wages and lifetime earnings and can explain roughly half of the difference in these outcomes between youth from high- versus low-income households. By contrast, test questions do not explain gender differences in labor market outcomes.

Suggested Citation

  • Eric R. Nielsen, 2019. "Test Questions, Economic Outcomes, and Inequality," Finance and Economics Discussion Series 2019-013, Board of Governors of the Federal Reserve System (U.S.).
    • Handle: RePEc:fip:fedgfe:2019-13
    DOI: 10.17016/FEDS.2019.013
    as

    Download full text from publisher

    File URL: https://www.federalreserve.gov/econres/feds/files/2019013pap.pdf
    Download Restriction: no
    File URL: https://libkey.io/10.17016/FEDS.2019.013?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Schröder, Carsten & Yitzhaki, Shlomo, 2017. "Revisiting the evidence for cardinal treatment of ordinal variables," European Economic Review, Elsevier, vol. 92(C), pages 337-358.
    2. Arcidiacono, Peter, 2004. "Ability sorting and the returns to college major," Journal of Econometrics, Elsevier, vol. 121(1-2), pages 343-375.
    3. Thomas S. Dee, 2007. "Teachers and the Gender Gaps in Student Achievement," Journal of Human Resources, University of Wisconsin Press, vol. 42(3).
    4. Timothy N. Bond & Kevin Lang, 2013. "The Evolution of the Black-White Test Score Gap in Grades K–3: The Fragility of Results," The Review of Economics and Statistics, MIT Press, vol. 95(5), pages 1468-1479, December.
    5. Timothy N. Bond & Kevin Lang, 2018. "The Black–White Education Scaled Test-Score Gap in Grades K-7," Journal of Human Resources, University of Wisconsin Press, vol. 53(4), pages 891-917.
    6. Raj Chetty & John N. Friedman & Jonah E. Rockoff, 2014. "Measuring the Impacts of Teachers II: Teacher Value-Added and Student Outcomes in Adulthood," American Economic Review, American Economic Association, vol. 104(9), pages 2633-2679, September.
    7. Huong Thu Le & Ha Trong Nguyen, 2018. "The evolution of the gender test score gap through seventh grade: new insights from Australia using unconditional quantile regression and decomposition," IZA Journal of Labor Economics, Springer;Forschungsinstitut zur Zukunft der Arbeit GmbH (IZA), vol. 7(1), pages 1-42, December.
    8. Roland G. Fryer & Steven D. Levitt, 2010. "An Empirical Analysis of the Gender Gap in Mathematics," American Economic Journal: Applied Economics, American Economic Association, vol. 2(2), pages 210-240, April.
    9. Josh Kinsler & Ronni Pavan, 2015. "The Specificity of General Human Capital: Evidence from College Major Choice," Journal of Labor Economics, University of Chicago Press, vol. 33(4), pages 933-972.
    10. Schofield, Lynne Steuerle, 2014. "Measurement error in the AFQT in the NLSY79," Economics Letters, Elsevier, vol. 123(3), pages 262-265.
    11. Flavio Cunha & James J. Heckman, 2008. "Formulating, Identifying and Estimating the Technology of Cognitive and Noncognitive Skill Formation," Journal of Human Resources, University of Wisconsin Press, vol. 43(4).
    12. C. Kirabo Jackson, 2018. "What Do Test Scores Miss? The Importance of Teacher Effects on Non–Test Score Outcomes," Journal of Political Economy, University of Chicago Press, vol. 126(5), pages 2072-2107.
    13. Kevin Lang & Michael Manove, 2011. "Education and Labor Market Discrimination," American Economic Review, American Economic Association, vol. 101(4), pages 1467-1496, June.
    14. Solomon W. Polachek & Tirthatanmoy Das & Rewat Thamma-Apiroam, 2015. "Micro- and Macroeconomic Implications of Heterogeneity in the Production of Human Capital," Journal of Political Economy, University of Chicago Press, vol. 123(6), pages 1410-1455.
    15. Brian Jacob & Jesse Rothstein, 2016. "The Measurement of Student Ability in Modern Assessment Systems," Journal of Economic Perspectives, American Economic Association, vol. 30(3), pages 85-108, Summer.
    16. Neal, Derek A & Johnson, William R, 1996. "The Role of Premarket Factors in Black-White Wage Differences," Journal of Political Economy, University of Chicago Press, vol. 104(5), pages 869-895, October.
    17. Eric R. Nielsen, 2015. "Achievement Gap Estimates and Deviations from Cardinal Comparability," Finance and Economics Discussion Series 2015-40, Board of Governors of the Federal Reserve System (U.S.).
    18. Eric R. Nielsen, 2015. "The Income-Achievement Gap and Adult Outcome Inequality," Finance and Economics Discussion Series 2015-41, Board of Governors of the Federal Reserve System (U.S.).
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Evan Riehl & Meredith Welch, 2023. "Accountability, Test Prep Incentives, and the Design of Math and English Exams," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 42(1), pages 60-96, January.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Brian Jacob & Jesse Rothstein, 2016. "The Measurement of Student Ability in Modern Assessment Systems," Journal of Economic Perspectives, American Economic Association, vol. 30(3), pages 85-108, Summer.
    2. Rakshit, Sonali & Sahoo, Soham, 2023. "Biased teachers and gender gap in learning outcomes: Evidence from India," Journal of Development Economics, Elsevier, vol. 161(C).
    3. Domicolo, Carly & Nielsen, Eric, 2022. "Male–female achievement variance comparisons are not robust," Economics Letters, Elsevier, vol. 220(C).
    4. Loviglio, Annalisa, 2023. "School Quality beyond Test Scores: The Role of Schools in Shaping Educational Outcomes," IZA Discussion Papers 16111, Institute of Labor Economics (IZA).
    5. Bond, Timothy N. & Lehmann, Jee-Yeon K., 2018. "Prejudice and racial matches in employment," Labour Economics, Elsevier, vol. 51(C), pages 271-293.
    6. Jesse Rothstein, 2019. "Inequality of Educational Opportunity? Schools as Mediators of the Intergenerational Transmission of Income," Journal of Labor Economics, University of Chicago Press, vol. 37(S1), pages 85-123.
    7. Słoczyński, Tymon, 2012. "New Evidence on Linear Regression and Treatment Effect Heterogeneity," MPRA Paper 39524, University Library of Munich, Germany.
    8. Francesco Agostinelli & Matthew Wiswall, 2016. "Identification of Dynamic Latent Factor Models: The Implications of Re-Normalization in a Model of Child Development," NBER Working Papers 22441, National Bureau of Economic Research, Inc.
    9. Eric A. Hanushek & Jacob D. Light & Paul E. Peterson & Laura M. Talpey & Ludger Woessmann, 2022. "Long-run Trends in the U.S. SES-Achievement Gap," Education Finance and Policy, MIT Press, vol. 17(4), pages 608-640, Fall.
    10. Speer, Jamin D., 2017. "The gender gap in college major: Revisiting the role of pre-college factors," Labour Economics, Elsevier, vol. 44(C), pages 69-88.
    11. Nguyen, Ha Trong & Brinkman, Sally & Le, Huong Thu & Zubrick, Stephen R. & Mitrou, Francis, 2022. "Gender differences in time allocation contribute to differences in developmental outcomes in children and adolescents," Economics of Education Review, Elsevier, vol. 89(C).
    12. Gørtz, Mette & Johansen, Eva Rye & Simonsen, Marianne, 2018. "Academic achievement and the gender composition of preschool staff," Labour Economics, Elsevier, vol. 55(C), pages 241-258.
    13. Richard J. Murnane, 2013. "U.S. High School Graduation Rates: Patterns and Explanations," Journal of Economic Literature, American Economic Association, vol. 51(2), pages 370-422, June.
    14. Jo Blanden & Matthias Doepke & Jan Stuhler, 2022. "Education inequality," CEP Discussion Papers dp1849, Centre for Economic Performance, LSE.
    15. Naven, Matthew, 2019. "Human-Capital Formation During Childhood and Adolescence: Evidence from School Quality and Postsecondary Success in California," MPRA Paper 97716, University Library of Munich, Germany.
    16. Jeffrey R. Bloem & Andrew J. Oswald, 2022. "The Analysis of Human Feelings: A Practical Suggestion for a Robustness Test," Review of Income and Wealth, International Association for Research in Income and Wealth, vol. 68(3), pages 689-710, September.
    17. Naven, Matthew, 2020. "Within-School Heterogeneity in Quality: Do Schools Provide Equal Value Added to All Students?," MPRA Paper 100123, University Library of Munich, Germany.
    18. Moroni, Gloria & Nicoletti, Cheti & Tominey, Emma, 2019. "Child Socio-Emotional Skills: The Role of Parental Inputs," IZA Discussion Papers 12432, Institute of Labor Economics (IZA).
    19. Barrios-Fernández, Andrés & Riudavets-Barcons, Marc, 2024. "Teacher value-added and gender gaps in educational outcomes," Economics of Education Review, Elsevier, vol. 100(C).
    20. Sloczynski, Tymon, 2018. "Average Gaps and Oaxaca's Blinder Decompositions: A Cautionary Tale about Regression Estimates of Racial Differences in Labor Market Outcomes," IZA Discussion Papers 12041, Institute of Labor Economics (IZA).

    More about this item

    Keywords

    Human capital; Inequality; Achievement gaps; Measurement error;
    All these keywords.

    JEL classification:

    • C2 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables
    • I24 - Health, Education, and Welfare - - Education - - - Education and Inequality
    • I26 - Health, Education, and Welfare - - Education - - - Returns to Education

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:fip:fedgfe:2019-13. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Ryan Wolfslayer ; Keisha Fournillier (email available below). General contact details of provider: https://edirc.repec.org/data/frbgvus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.