IDEAS home Printed from https://ideas.repec.org/p/hbs/wpaper/16-065.html
   My bibliography  Save this paper

Big Data and Big Cities: The Promises and Limitations of Improved Measures of Urban Life

Author

Listed:
  • Edward L. Glaeser

    (Harvard University)

  • Scott Duke Kominers

    (Harvard Business School)

  • Michael Luca

    (Harvard Business School, Negotiation, Organizations & Markets Unit)

  • Nikhil Naik

    (Massachusetts Institute of Technology Media Lab)

Abstract

New, "big" data sources allow measurement of city characteristics and outcome variables higher frequencies and finer geographic scales than ever before. However, big data will not solve large urban social science questions on its own. Big data has the most value for the study of cities when it allows measurement of the previously opaque, or when it can be coupled with exogenous shocks to people or place. We describe a number of new urban data sources and illustrate how they can be used to improve the study and function of cities. We first show how Google Street View images can be used to predict income in New York City, suggesting that similar image data can be used to map wealth and poverty in previously unmeasured areas of the developing world. We then discuss how survey techniques can be improved to better measure willingness to pay for urban amenities. Finally, we explain how Internet data is being used to improve the quality of city services.

Suggested Citation

  • Edward L. Glaeser & Scott Duke Kominers & Michael Luca & Nikhil Naik, 2015. "Big Data and Big Cities: The Promises and Limitations of Improved Measures of Urban Life," Harvard Business School Working Papers 16-065, Harvard Business School.
    • Handle: RePEc:hbs:wpaper:16-065
    as

    Download full text from publisher

    File URL: http://www.hbs.edu/faculty/pages/download.aspx?name=16-065.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Edward L. Glaeser & Andrew Hillis & Scott Duke Kominers & Michael Luca, 2016. "Crowdsourcing City Government: Using Tournaments to Improve Inspection Accuracy," American Economic Review, American Economic Association, vol. 106(5), pages 114-118, May.
    2. Berry, Christopher R. & Glaeser, Edward L., 2005. "Divergence of Human Capital Levels across Cities," Working Paper Series rwp05-057, Harvard University, John F. Kennedy School of Government.
    3. Jon Kleinberg & Jens Ludwig & Sendhil Mullainathan & Ziad Obermeyer, 2015. "Prediction Policy Problems," American Economic Review, American Economic Association, vol. 105(5), pages 491-495, May.
    4. Naik, Nikhil & Kominers, Scott Duke & Raskar, Ramesh & Glaeser, Edward L. & Hidalgo, Cesar A., 2015. "Do People Shape Cities, or Do Cities Shape People? THe Co-evolution of Physical, Social and Economic Change in Five Major U.S. Cities," Working Paper Series 15-061, Harvard University, John F. Kennedy School of Government.
    5. Sandra E. Black, 1999. "Do Better Schools Matter? Parental Valuation of Elementary Education," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 114(2), pages 577-599.
    6. Gramlich, Edward M, 1994. "Infrastructure Investment: A Review Essay," Journal of Economic Literature, American Economic Association, vol. 32(3), pages 1176-1196, September.
    7. Roback, Jennifer, 1982. "Wages, Rents, and the Quality of Life," Journal of Political Economy, University of Chicago Press, vol. 90(6), pages 1257-1278, December.
    8. Pierre-Philippe Combes & Gilles Duranton & Laurent Gobillon & Sébastien Roux, 2010. "Estimating Agglomeration Economies with History, Geology, and Worker Effects," NBER Chapters, in: Agglomeration Economics, pages 15-66, National Bureau of Economic Research, Inc.
    9. Philip Salesses & Katja Schechtner & César A Hidalgo, 2013. "The Collaborative Image of The City: Mapping the Inequality of Urban Perception," PLOS ONE, Public Library of Science, vol. 8(7), pages 1-12, July.
    10. George A. Akerlof & Rachel E. Kranton, 2000. "Economics and Identity," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 115(3), pages 715-753.
    11. BK. Johnson & JC. Whitehead, 2000. "Value of public goods from sports stadiums: the CVM approach," Contemporary Economic Policy, Western Economic Association International, vol. 18(1), pages 48-58, January.
    12. David H. Autor & Christopher J. Palmer & Parag A. Pathak, 2014. "Housing Market Spillovers: Evidence from the End of Rent Control in Cambridge, Massachusetts," Journal of Political Economy, University of Chicago Press, vol. 122(3), pages 661-717.
    13. Kahneman, Daniel & Knetsch, Jack L., 1992. "Valuing public goods: The purchase of moral satisfaction," Journal of Environmental Economics and Management, Elsevier, vol. 22(1), pages 57-70, January.
    14. Stéphane Gregoir & Mathieu Hutin & Tristan-Pierre Maury & Genevièvre Prandi, 2012. "Measuring Local Individual Housing Returns from a Large Transaction Database," Annals of Economics and Statistics, GENES, issue 107-108, pages 93-131.
    15. Nikhil Naik & Ramesh Raskar & César A. Hidalgo, 2016. "Cities Are Physical Too: Using Computer Vision to Measure the Quality and Impact of Urban Appearance," American Economic Review, American Economic Association, vol. 106(5), pages 128-132, May.
    16. Glaeser, Edward L. & Hanushek, Eric A. & Quigley, John M., 2004. "Opportunities, race, and urban location: the influence of John Kain," Journal of Urban Economics, Elsevier, vol. 56(1), pages 70-79, July.
    17. Edward L. Glaeser & Joseph Gyourko & Raven E. Saks, 2005. "Why Have Housing Prices Gone Up?," American Economic Review, American Economic Association, vol. 95(2), pages 329-333, May.
    18. Janet Currie & Reed Walker, 2011. "Traffic Congestion and Infant Health: Evidence from E-ZPass," American Economic Journal: Applied Economics, American Economic Association, vol. 3(1), pages 65-90, January.
    19. Michael Greenstone & Richard Hornbeck & Enrico Moretti, 2010. "Identifying Agglomeration Spillovers: Evidence from Winners and Losers of Large Plant Openings," Journal of Political Economy, University of Chicago Press, vol. 118(3), pages 536-598, June.
    20. Matias Busso & Patrick Kline, 2008. "Do Local Economic Development Programs Work? Evidence from the Federal Empowerment Zone Program," Cowles Foundation Discussion Papers 1639, Cowles Foundation for Research in Economics, Yale University.
    21. repec:adr:anecst:y:2012:i:107-108:p:4 is not listed on IDEAS
    22. Ciccone, Antonio & Hall, Robert E, 1996. "Productivity and the Density of Economic Activity," American Economic Review, American Economic Association, vol. 86(1), pages 54-70, March.
    23. Epple, Dennis, 1987. "Hedonic Prices and Implicit Markets: Estimating Demand and Supply Functions for Differentiated Products," Journal of Political Economy, University of Chicago Press, vol. 95(1), pages 59-80, February.
    24. Thomas J. Holmes, 1998. "The Effect of State Policies on the Location of Manufacturing: Evidence from State Borders," Journal of Political Economy, University of Chicago Press, vol. 106(4), pages 667-705, August.
    25. Glaeser, Edward L & Gyourko, Joseph & Saks, Raven, 2005. "Why Is Manhattan So Expensive? Regulation and the Rise in Housing Prices," Journal of Law and Economics, University of Chicago Press, vol. 48(2), pages 331-369, October.
    26. Mohammad Arzaghi & J. Vernon Henderson, 2008. "Networking off Madison Avenue," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 75(4), pages 1011-1038.
    27. Lawrence F. Katz & Jeffrey R. Kling & Jeffrey B. Liebman, 2001. "Moving to Opportunity in Boston: Early Results of a Randomized Mobility Experiment," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 116(2), pages 607-654.
    28. Richard Carson & Theodore Groves, 2007. "Incentive and informational properties of preference questions," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 37(1), pages 181-210, May.
    29. Ginger Zhe Jin & Phillip Leslie, 2003. "The Effect of Information on Product Quality: Evidence from Restaurant Hygiene Grade Cards," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 118(2), pages 409-451.
    30. Jeremy Ginsberg & Matthew H. Mohebbi & Rajan S. Patel & Lynnette Brammer & Mark S. Smolinski & Larry Brilliant, 2009. "Detecting influenza epidemics using search engine query data," Nature, Nature, vol. 457(7232), pages 1012-1014, February.
    31. Keith Finlay, 2009. "Effect of Employer Access to Criminal History Data on the Labor Market Outcomes of Ex-Offenders and Non-Offenders," NBER Chapters, in: Studies of Labor Market Intermediation, pages 89-125, National Bureau of Economic Research, Inc.
    32. Glaeser, Edward L & Mare, David C, 2001. "Cities and Skills," Journal of Labor Economics, University of Chicago Press, vol. 19(2), pages 316-342, April.
    33. Combes, Pierre-Philippe & Duranton, Gilles & Gobillon, Laurent, 2008. "Spatial wage disparities: Sorting matters!," Journal of Urban Economics, Elsevier, vol. 63(2), pages 723-742, March.
    34. David H. Autor, 2009. "Studies of Labor Market Intermediation," NBER Books, National Bureau of Economic Research, Inc, number auto07-1.
    35. Rauch James E., 1993. "Productivity Gains from Geographic Concentration of Human Capital: Evidence from the Cities," Journal of Urban Economics, Elsevier, vol. 34(3), pages 380-400, November.
    36. Edward L. Glaeser & Joshua D. Gottlieb, 2008. "The Economics of Place-Making Policies," Brookings Papers on Economic Activity, Economic Studies Program, The Brookings Institution, vol. 39(1 (Spring), pages 155-253.
    37. Peter A. Diamond & Jerry A. Hausman, 1994. "Contingent Valuation: Is Some Number Better than No Number?," Journal of Economic Perspectives, American Economic Association, vol. 8(4), pages 45-64, Fall.
    38. Nathaniel Baum-Snow, 2007. "Did Highways Cause Suburbanization?," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 122(2), pages 775-805.
    39. John G. Matsusaka, 2005. "Direct Democracy Works," Journal of Economic Perspectives, American Economic Association, vol. 19(2), pages 185-206, Spring.
    40. Raj Chetty & Nathaniel Hendren & Lawrence F. Katz, 2016. "The Effects of Exposure to Better Neighborhoods on Children: New Evidence from the Moving to Opportunity Experiment," American Economic Review, American Economic Association, vol. 106(4), pages 855-902, April.
    41. Moretti, Enrico, 2004. "Human capital externalities in cities," Handbook of Regional and Urban Economics, in: J. V. Henderson & J. F. Thisse (ed.), Handbook of Regional and Urban Economics, edition 1, volume 4, chapter 51, pages 2243-2291, Elsevier.
    42. Christopher R. Berry & Edward L. Glaeser, 2005. "The divergence of human capital levels across cities," Papers in Regional Science, Wiley Blackwell, vol. 84(3), pages 407-444, August.
    43. Jerry Hausman, 2012. "Contingent Valuation: From Dubious to Hopeless," Journal of Economic Perspectives, American Economic Association, vol. 26(4), pages 43-56, Fall.
    44. Christopher R. Berry & Edward L. Glaeser, 2005. "The Divergence of Human Capital Levels across Cities," Harvard Institute of Economic Research Working Papers 2091, Harvard - Institute of Economic Research.
    45. Christopher R. Berry & Edward L. Glaeser, 2005. "The Divergence of Human Capital Levels Across Cities," NBER Working Papers 11617, National Bureau of Economic Research, Inc.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Benjamin Austin & Edward Glaeser & Lawrence Summers, 2018. "Jobs for the Heartland: Place-Based Policies in 21st-Century America," Brookings Papers on Economic Activity, Economic Studies Program, The Brookings Institution, vol. 49(1 (Spring), pages 151-255.
    2. Edward L. Glaeser & Joshua D. Gottlieb, 2008. "The Economics of Place-Making Policies," Brookings Papers on Economic Activity, Economic Studies Program, The Brookings Institution, vol. 39(1 (Spring), pages 155-253.
    3. Duranton, Gilles & Puga, Diego, 2014. "The Growth of Cities," Handbook of Economic Growth, in: Philippe Aghion & Steven Durlauf (ed.), Handbook of Economic Growth, edition 1, volume 2, chapter 5, pages 781-853, Elsevier.
    4. Combes, Pierre-Philippe & Duranton, Gilles & Gobillon, Laurent & Roux, Sébastien, 2012. "Sorting and local wage and skill distributions in France," Regional Science and Urban Economics, Elsevier, vol. 42(6), pages 913-930.
    5. Moretti, Enrico, 2011. "Local Labor Markets," Handbook of Labor Economics, in: O. Ashenfelter & D. Card (ed.), Handbook of Labor Economics, edition 1, volume 4, chapter 14, pages 1237-1313, Elsevier.
    6. Gilles Duranton & Diego Puga, 2020. "The Economics of Urban Density," Journal of Economic Perspectives, American Economic Association, vol. 34(3), pages 3-26, Summer.
    7. Edward L. Glaeser & Joshua D. Gottlieb, 2009. "The Wealth of Cities: Agglomeration Economies and Spatial Equilibrium in the United States," Journal of Economic Literature, American Economic Association, vol. 47(4), pages 983-1028, December.
    8. Gabriel M. Ahlfeldt & Stephen J. Redding & Daniel M. Sturm & Nikolaus Wolf, 2015. "The Economics of Density: Evidence From the Berlin Wall," Econometrica, Econometric Society, vol. 83, pages 2127-2189, November.
    9. Arntz, Melanie & Brüll, Eduard & Lipowski, Cäcilia, 2021. "Do preferences for urban amenities really differ by skill?," ZEW Discussion Papers 21-045, ZEW - Leibniz Centre for European Economic Research.
    10. Ahrend, Rudiger & Farchy, Emily & Kaplanis, Ioannis & Lembcke, Alexander C., 2016. "What Makes Cities More Productive? Evidence from 5 OECD Countries on the Role of Urban Governance," Beiträge zur Jahrestagung 2016 (Witten/Herdecke) 175187, Verein für Socialpolitik, Ausschuss für Wirtschaftssysteme und Institutionenökonomik.
    11. De la Roca, Jorge, 2017. "Selection in initial and return migration: Evidence from moves across Spanish cities," Journal of Urban Economics, Elsevier, vol. 100(C), pages 33-53.
    12. Casey Dougal & Christopher A. Parsons & Sheridan Titman, 2014. "Urban Vibrancy and Corporate Growth," NBER Working Papers 20350, National Bureau of Economic Research, Inc.
    13. Rudiger Ahrend & Emily Farchy & Ioannis Kaplanis & Alexander C. Lembcke, 2015. "What Makes Cities More Productive? Agglomeration Economies and the Role of Urban Governance: Evidence from 5 OECD Countries," SERC Discussion Papers 0178, Centre for Economic Performance, LSE.
    14. Edward L. Glaeser, 2012. "Urban Public Finance," NBER Working Papers 18244, National Bureau of Economic Research, Inc.
    15. Rudiger Ahrend & Emily Farchy & Ioannis Kaplanis & Alexander C. Lembcke, 2017. "What Makes Cities More Productive? Evidence From Five Oecd Countries On The Role Of Urban Governance," Journal of Regional Science, Wiley Blackwell, vol. 57(3), pages 385-410, June.
    16. Matthias Wrede, 2013. "Heterogeneous skills and homogeneous land: segmentation and agglomeration," Journal of Economic Geography, Oxford University Press, vol. 13(5), pages 767-798, September.
    17. Jorge De La Roca & Diego Puga, 2017. "Learning by Working in Big Cities," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 84(1), pages 106-142.
    18. Rosenthal, Stuart S. & Strange, William C., 2008. "The attenuation of human capital spillovers," Journal of Urban Economics, Elsevier, vol. 64(2), pages 373-389, September.
    19. Diego Puga, 2017. "The changing distribution of firms and workers across cities," Development Working Papers 418, Centro Studi Luca d'Agliano, University of Milano.
    20. Baum-Snow, Nathaniel & Ferreira, Fernando, 2015. "Causal Inference in Urban and Regional Economics," Handbook of Regional and Urban Economics, in: Gilles Duranton & J. V. Henderson & William C. Strange (ed.), Handbook of Regional and Urban Economics, edition 1, volume 5, chapter 0, pages 3-68, Elsevier.

    More about this item

    JEL classification:

    • C18 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Methodolical Issues: General
    • C55 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Large Data Sets: Modeling and Analysis
    • C80 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - General
    • C83 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - Survey Methods; Sampling Methods
    • R10 - Urban, Rural, Regional, Real Estate, and Transportation Economics - - General Regional Economics - - - General
    • R11 - Urban, Rural, Regional, Real Estate, and Transportation Economics - - General Regional Economics - - - Regional Economic Activity: Growth, Development, Environmental Issues, and Changes
    • R23 - Urban, Rural, Regional, Real Estate, and Transportation Economics - - Household Analysis - - - Regional Migration; Regional Labor Markets; Population

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:hbs:wpaper:16-065. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: HBS (email available below). General contact details of provider: https://edirc.repec.org/data/harbsus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.