IDEAS home Printed from https://ideas.repec.org/a/sae/urbstu/v58y2021i9p1831-1845.html
   My bibliography  Save this article

Real and fake data in Shanghai’s informal rental housing market: Groundtruthing data scraped from the internet

Author

Listed:
  • Julia Gabriele Harten

    (University of Southern California, USA)

  • Annette M Kim

    (University of Southern California, USA)

  • J Cressica Brazier

    (Massachusetts Institute of Technology, USA)

Abstract

China’s planned mega-cities contain hidden, informal housing markets. We analyse Shanghai’s ‘group rental’ market in which formal commercial and residential units have been illegally converted into extremely crowded dormitories. In 2016, we collected more than 33,000 online classified advertisements for beds in group rental apartments and find that this market serves a specific demographic with robust preference order patterns. Furthermore, groundtruthing fieldwork revealed that the scraped online data misrepresented the market. Therefore, we also collected a second set of ‘real’ market data for comparative analysis. The study highlights both the exciting possibilities and the limitations of using online content to study informality.

Suggested Citation

  • Julia Gabriele Harten & Annette M Kim & J Cressica Brazier, 2021. "Real and fake data in Shanghai’s informal rental housing market: Groundtruthing data scraped from the internet," Urban Studies, Urban Studies Journal Limited, vol. 58(9), pages 1831-1845, July.
    • Handle: RePEc:sae:urbstu:v:58:y:2021:i:9:p:1831-1845
    DOI: 10.1177/0042098020918196
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.1177/0042098020918196
    Download Restriction: no
    File URL: https://libkey.io/10.1177/0042098020918196?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Alasdair Rae, 2015. "Online Housing Search and the Geography of Submarkets," Housing Studies, Taylor & Francis Journals, vol. 30(3), pages 453-472, June.
    2. Weiping Wu, 2004. "Sources of Migrant Housing Disadvantage in Urban China," Environment and Planning A, , vol. 36(7), pages 1285-1304, July.
    3. Yang Shen, 2015. "Why Does the Government Fail to Improve the Living Conditions of Migrant Workers in Shanghai? Reflections on the Policies and the Implementations of Public Rental Housing under Neoliberalism," Asia and the Pacific Policy Studies, Wiley Blackwell, vol. 2(1), pages 58-74, January.
    4. Patrick Bayer & Fernando Ferreira & Robert McMillan, 2007. "A Unified Framework for Measuring Preferences for Schools and Neighborhoods," Journal of Political Economy, University of Chicago Press, vol. 115(4), pages 588-638, August.
    5. Geoff Boeing, 2020. "Online rental housing market representation and the digital reproduction of urban inequality," Environment and Planning A, , vol. 52(2), pages 449-468, March.
    6. Sheng Li & Lanlan Wang & Kuo-Liang Chang, 2018. "Do internal migrants suffer from housing extreme overcrowding in urban China?," Housing Studies, Taylor & Francis Journals, vol. 33(5), pages 708-733, July.
    7. Rosen, Sherwin, 1974. "Hedonic Prices and Implicit Markets: Product Differentiation in Pure Competition," Journal of Political Economy, University of Chicago Press, vol. 82(1), pages 34-55, Jan.-Feb..
    8. Fulong Wu, 2016. "Housing in Chinese Urban Villages: The Dwellers, Conditions and Tenancy Informality," Housing Studies, Taylor & Francis Journals, vol. 31(7), pages 852-870, October.
    9. Yang Shen, 2015. "Why Does the Government Fail to Improve the Living Conditions of Migrant Workers in Shanghai? Reflections on the Policies and the Implementations of Public Rental Housing under Neoliberalism," Asia and the Pacific Policy Studies 201506, Crawford School of Public Policy, The Australian National University.
    10. Redfearn, Christian L., 2009. "How informative are average effects? Hedonic regression and amenity capitalization in complex urban housing markets," Regional Science and Urban Economics, Elsevier, vol. 39(3), pages 297-306, May.
    11. Boeing, Geoff, 2017. "New Insights into Rental Housing Markets across the United States: Web Scraping and Analyzing Craigslist Rental Listings," SocArXiv v54w4, Center for Open Science.
    12. Yan Song & Yves Zenou & Chengri Ding, 2008. "Let's Not Throw the Baby Out with the Bath Water: The Role of Urban Villages in Housing Rural Migrants in China," Urban Studies, Urban Studies Journal Limited, vol. 45(2), pages 313-330, February.
    13. Hu, Lirong & He, Shenjing & Han, Zixuan & Xiao, He & Su, Shiliang & Weng, Min & Cai, Zhongliang, 2019. "Monitoring housing rental prices based on social media:An integrated approach of machine-learning algorithms and hedonic modeling to inform equitable housing policies," Land Use Policy, Elsevier, vol. 82(C), pages 657-673.
    14. Guihaire, Valérie & Hao, Jin-Kao, 2008. "Transit network design and scheduling: A global review," Transportation Research Part A: Policy and Practice, Elsevier, vol. 42(10), pages 1251-1273, December.
    15. Zan Yang & Jie Chen, 2014. "Housing Reform and the Housing Market in Urban China," SpringerBriefs in Economics, in: Housing Affordability and Housing Policy in Urban China, edition 127, chapter 0, pages 15-43, Springer.
    16. Eli Beracha & M. Babajide Wintoki, 2013. "Forecasting Residential Real Estate Price Changes from Online Search Activity," Journal of Real Estate Research, American Real Estate Society, vol. 35(3), pages 283-312.
    17. Li, Si-ming & Liu, Yi, 2016. "The jobs-housing relationship and commuting in Guangzhou, China: Hukou and dual structure," Journal of Transport Geography, Elsevier, vol. 54(C), pages 286-294.
    18. Chengdong Yi & Youqin Huang, 2014. "Housing Consumption and Housing Inequality in Chinese Cities During the First Decade of the Twenty-First Century," Housing Studies, Taylor & Francis Journals, vol. 29(2), pages 291-311, March.
    19. Zan Yang & Jie Chen, 2014. "Housing Affordability and Housing Policy in Urban China," SpringerBriefs in Economics, Springer, edition 127, number 978-3-642-54044-8, October.
    20. Lisa Schweitzer, 2014. "Planning and Social Media: A Case Study of Public Transit and Stigma on Twitter," Journal of the American Planning Association, Taylor & Francis Journals, vol. 80(3), pages 218-238, July.
    21. Kim, Annette M., 2007. "North versus South: The Impact of Social Norms in the Market Pricing of Private Property Rights in Vietnam," World Development, Elsevier, vol. 35(12), pages 2079-2095, December.
    22. Prashant Das & Alan Ziobrowski & N. Coulson, 2015. "Online Information Search, Market Fundamentals and Apartment Real Estate," The Journal of Real Estate Finance and Economics, Springer, vol. 51(4), pages 480-502, November.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Zhengyuan Chai & Yi Yang & Yangyang Zhao & Yonghu Fu & Ling Hao, 2021. "Exploring the Effects of Contextual Factors on Residential Land Prices Using an Extended Geographically and Temporally Weighted Regression Model," Land, MDPI, vol. 10(11), pages 1-20, October.
    2. Jon Bannister & Anthony O’Sullivan, 2021. "Big Data in the city," Urban Studies, Urban Studies Journal Limited, vol. 58(15), pages 3061-3070, November.
    3. Fernando Fernandez-Monge & Sarah Barns & Rainer Kattel & Francesca Bria, 2024. "Reclaiming data for improved city governance: Barcelona’s New Data Deal," Urban Studies, Urban Studies Journal Limited, vol. 61(7), pages 1291-1307, May.
    4. Gregory F Randolph & Michael Storper, 2023. "Is urbanisation in the Global South fundamentally different? Comparative global urban analysis for the 21st century," Urban Studies, Urban Studies Journal Limited, vol. 60(1), pages 3-25, January.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Hu, Lirong & He, Shenjing & Luo, Yun & Su, Shiliang & Xin, Jing & Weng, Min, 2020. "A social-media-based approach to assessing the effectiveness of equitable housing policy in mitigating education accessibility induced social inequalities in Shanghai, China," Land Use Policy, Elsevier, vol. 94(C).
    2. Juan Ming & Jiachun Liu & Zicheng Wang, 2020. "Does the Homeownership Gap Between Rural–Urban Migrants and Urban–Urban Migrants in China Vary by Income?," SAGE Open, , vol. 10(4), pages 21582440209, November.
    3. Xiao, Yue & Wen, Haizhen & Hui, Eddie C.M. & Zhou, Ganghua, 2022. "Dynamic capitalization effects of educational facilities during different market stages: An empirical study in Hangzhou, China," Land Use Policy, Elsevier, vol. 122(C).
    4. Cankun Wei & Meichen Fu & Li Wang & Hanbing Yang & Feng Tang & Yuqing Xiong, 2022. "The Research Development of Hedonic Price Model-Based Real Estate Appraisal in the Era of Big Data," Land, MDPI, vol. 11(3), pages 1-30, February.
    5. Geoff Boeing & Max Besbris & Ariela Schachter & John Kuk, 2021. "Housing Search in the Age of Big Data: Smarter Cities or the Same Old Blind Spots?," Housing Policy Debate, Taylor & Francis Journals, vol. 31(1), pages 112-126, January.
    6. Sylvia Y He, 2017. "A hierarchical estimation of school quality capitalisation in house prices in Orange County, California," Urban Studies, Urban Studies Journal Limited, vol. 54(14), pages 3337-3359, November.
    7. Yuting Cao & Ran Liu & Wei Qi & Jin Wen, 2020. "Spatial Heterogeneity of Housing Space Consumption in Urban China: Locals vs. Inter-and Intra-Provincial Migrants," Sustainability, MDPI, vol. 12(12), pages 1-26, June.
    8. Hu, Lirong & He, Shenjing & Han, Zixuan & Xiao, He & Su, Shiliang & Weng, Min & Cai, Zhongliang, 2019. "Monitoring housing rental prices based on social media:An integrated approach of machine-learning algorithms and hedonic modeling to inform equitable housing policies," Land Use Policy, Elsevier, vol. 82(C), pages 657-673.
    9. Yuting Cao & Ran Liu & Wei Qi & Jin Wen, 2020. "Urban Land Regulation and Heterogeneity of Housing Conditions of Inter-Provincial Migrants in China," Land, MDPI, vol. 9(11), pages 1-21, November.
    10. Song, Yan & Zenou, Yves, 2012. "Urban villages and housing values in China," Regional Science and Urban Economics, Elsevier, vol. 42(3), pages 495-505.
    11. Nuri Hacıevliyagil & Krzysztof Drachal & Ibrahim Halil Eksi, 2022. "Predicting House Prices Using DMA Method: Evidence from Turkey," Economies, MDPI, vol. 10(3), pages 1-27, March.
    12. Gautier, Pieter & van Vuuren, Aico & Siegmann, Arjen, 2007. "The Effect of the Theo van Gogh Murder on House Prices in Amsterdam," CEPR Discussion Papers 6175, C.E.P.R. Discussion Papers.
    13. Charles Ka Yui Leung & Joe Cho Yiu Ng, 2018. "Macro Aspects of Housing," GRU Working Paper Series GRU_2018_016, City University of Hong Kong, Department of Economics and Finance, Global Research Unit.
    14. Wong, Maisy, 2010. "The Relationship between Marginal Willingness-to-Pay in the Hedonic and Discrete Choice Models," MPRA Paper 51218, University Library of Munich, Germany.
    15. Patrick Bayer & Robert McMillan & Kim Rueben, 2004. "An Equilibrium Model of Sorting in an Urban Housing Market," NBER Working Papers 10865, National Bureau of Economic Research, Inc.
    16. Marco Helbich & Wolfgang Brunauer & Eric Vaz & Peter Nijkamp, 2014. "Spatial Heterogeneity in Hedonic House Price Models: The Case of Austria," Urban Studies, Urban Studies Journal Limited, vol. 51(2), pages 390-411, February.
    17. Nicolai V. Kuminoff & Jaren C. Pope, 2014. "Do “Capitalization Effects” For Public Goods Reveal The Public'S Willingness To Pay?," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 55(4), pages 1227-1250, November.
    18. Christopher R. Gustafson & Travis J. Lybbert & Daniel A. Sumner, 2016. "Consumer sorting and hedonic valuation of wine attributes: exploiting data from a field experiment," Agricultural Economics, International Association of Agricultural Economists, vol. 47(1), pages 91-103, January.
    19. Dröes, Martijn I. & Koster, Hans R.A., 2016. "Renewable energy and negative externalities: The effect of wind turbines on house prices," Journal of Urban Economics, Elsevier, vol. 96(C), pages 121-141.
    20. Gabriel Ahlfeldt & Pantelis Koutroumpis & Tommaso Valletti, 2017. "Speed 2.0: Evaluating Access to Universal Digital Highways," Journal of the European Economic Association, European Economic Association, vol. 15(3), pages 586-625.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:urbstu:v:58:y:2021:i:9:p:1831-1845. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: http://www.gla.ac.uk/departments/urbanstudiesjournal .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.