IDEAS home Printed from https://ideas.repec.org/p/osf/osfxxx/fs76e_v1.html
   My bibliography  Save this paper

Transforming Urban Planning through Machine Learning: A Study on Planning Application Classification using Natural Language Processing

Author

Listed:
  • Lin, Yang
  • Thackway, William
  • Soundararaj, Balamurugan
  • Eagleson, Serryn
  • Han, Hoon
  • Pettit, Christopher

Abstract

Planning for sustainable urban growth is a pressing challenge facing many cities. Investigating proposed changes to the built environment can provide planners and policymakers information to understand future urban development trends and related infrastructure requirements. It is in this context we have developed a novel urban analytics approach that utilises planning applications (PAs) data and Natural Language Processing (NLP) techniques to forecast the housing supply pipeline in Australia. Firstly, we implement a data processing pipeline which scrapes, geocodes, and filters PA data from council websites and planning portals to provide the first nationally available daily dataset of PAs that are currently under consideration. Secondly, we classify the collected PAs into four distinct urban development categories, selected based on infrastructure planning provisioning requirements. Of the five model architectures tested, we found that the fine-tuned DeBERTA-v3 model achieves the best performance with an accuracy and F1-score of 0.944. This demonstrates the suitability of fine-tuned Pre-trained Language Models (PLMs) for planning text classification tasks. Finally, the model is applied to classify and map urban development trends in Australia’s two largest cities, Sydney and Melbourne, from 2021-2022 and 2023-2024. The mapping affirms a face-validation test of the classification model and demonstrates the utility of PA insights for planners. Holistically, the paper demonstrates the potential for NLP to enrich urban analytics through the integration of previously inaccessible planning text data into planning analysis and decisions.

Suggested Citation

  • Lin, Yang & Thackway, William & Soundararaj, Balamurugan & Eagleson, Serryn & Han, Hoon & Pettit, Christopher, 2024. "Transforming Urban Planning through Machine Learning: A Study on Planning Application Classification using Natural Language Processing," OSF Preprints fs76e_v1, Center for Open Science.
    • Handle: RePEc:osf:osfxxx:fs76e_v1
    DOI: 10.31219/osf.io/fs76e_v1
    as

    Download full text from publisher

    File URL: https://osf.io/download/67186ce8b01db62d188702d8/
    Download Restriction: no
    File URL: https://libkey.io/10.31219/osf.io/fs76e_v1?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Yingjie Hu & Chengbin Deng & Zhou Zhou, 2019. "A Semantic and Sentiment Analysis on Online Neighborhood Reviews for Understanding the Perceptions of People toward Their Living Environments," Annals of the American Association of Geographers, Taylor & Francis Journals, vol. 109(4), pages 1052-1073, July.
    2. Edward Glaeser & Joseph Gyourko, 2018. "The Economic Implications of Housing Supply," Journal of Economic Perspectives, American Economic Association, vol. 32(1), pages 3-30, Winter.
    3. Peter Phibbs & Nicole Gurran, 2021. "The role and significance of planning in the determination of house prices in Australia: Recent policy debates," Environment and Planning A, , vol. 53(3), pages 457-479, May.
    4. Murray, Cameron, 2023. "Explainer: Planning and building approvals," OSF Preprints 8tb7v, Center for Open Science.
    5. Biktimirov, Ernest N. & Sokolyk, Tatyana & Ayanso, Anteneh, 2024. "What is behind housing sentiment?," Finance Research Letters, Elsevier, vol. 60(C).
    6. Jessica Ferm & Ben Clifford & Patricia Canelas & Nicola Livingstone, 2021. "Emerging problematics of deregulating the urban: The case of permitted development in England," Urban Studies, Urban Studies Journal Limited, vol. 58(10), pages 2040-2058, August.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Lin, Yang & Thackway, William & Soundararaj, Balamurugan & Eagleson, Serryn & Han, Hoon & Pettit, Christopher, 2024. "Transforming Urban Planning through Machine Learning: A Study on Planning Application Classification using Natural Language Processing," OSF Preprints fs76e, Center for Open Science.
    2. Charles Ka Yui Leung & Joe Cho Yiu Ng & Edward Tang, 2020. "Why is the Hong Kong Housing Market Unaffordable? Some Stylized Facts and Estimations," Globalization Institute Working Papers 380, Federal Reserve Bank of Dallas.
    3. Gyourko, Joseph & Hartley, Jonathan S. & Krimmel, Jacob, 2021. "The local residential land use regulatory environment across U.S. housing markets: Evidence from a new Wharton index," Journal of Urban Economics, Elsevier, vol. 124(C).
    4. Gyourko, Joe & Krimmel, Jacob, 2021. "The impact of local residential land use restrictions on land values across and within single family housing markets," Journal of Urban Economics, Elsevier, vol. 126(C).
    5. Yong Gao & Yuanyuan Chen & Lan Mu & Shize Gong & Pengcheng Zhang & Yu Liu, 2022. "Measuring urban sentiments from social media data: a dual-polarity metric approach," Journal of Geographical Systems, Springer, vol. 24(2), pages 199-221, April.
    6. Ian Chng & Jonathan Reades & Phil Hubbard, 2024. "Planning deregulation as solution to the housing crisis: The affordability, amenity and adequacy of Permitted Development in London," Environment and Planning A, , vol. 56(3), pages 961-978, May.
    7. Tirthatanmoy Das & Kabir Dasgupta, 2018. "Evaluating the Impact of Mothers' Self-esteem on Early Childhood Home Environment: Evidence from NLSY," Working Papers 2018-03 JEL Classificatio, Auckland University of Technology, Department of Economics, revised Oct 2019.
    8. Behrens, Kristian & Kichko, Sergei & Thisse, Jacques-Francois, 2024. "Working from home: Too much of a good thing?," Regional Science and Urban Economics, Elsevier, vol. 105(C).
    9. Francisco Gomes & Michael Haliassos & Tarun Ramadorai, 2021. "Household Finance," Journal of Economic Literature, American Economic Association, vol. 59(3), pages 919-1000, September.
    10. Lin, Chuanhao, 2024. "Do households value lower density: Theory, evidence, and implications from Washington, DC," Regional Science and Urban Economics, Elsevier, vol. 108(C).
    11. Eric Fesselmeyer & Haoming Liu & Louisa Poco, 2024. "Within‐development density and housing prices in Singapore," Journal of Regional Science, Wiley Blackwell, vol. 64(2), pages 406-427, March.
    12. Murray, Cameron & Gordon, Josh, 2021. "Land as airspace: How rezoning privatizes public space (and why governments should not give it away for free)," OSF Preprints v89fg, Center for Open Science.
    13. Rossi-Hansberg, Esteban & Sarte, Pierre-Daniel & Schwartzman, Felipe, 2019. "Cognitive Hubs and Spatial Redistribution," CEPR Discussion Papers 14000, C.E.P.R. Discussion Papers.
    14. Jose Maria Barrero & Nicholas Bloom & Steven J. Davis, 2020. "COVID-19 Is Also a Reallocation Shock," Brookings Papers on Economic Activity, Economic Studies Program, The Brookings Institution, vol. 51(2 (Summer), pages 329-383.
    15. Mitre-Becerril, David & MacDonald, John M., 2024. "Does urban development influence crime? Evidence from Philadelphia’s new zoning regulations," Journal of Urban Economics, Elsevier, vol. 142(C).
    16. Murray, Cameron K., 2020. "Time is money: How landbanking constrains housing supply," Journal of Housing Economics, Elsevier, vol. 49(C).
    17. Alla Koblyakova & Larisa Fleishman & Orly Furman, 2022. "Accuracy of Households’ Dwelling Valuations, Housing Demand and Mortgage Decisions: Israeli Case," The Journal of Real Estate Finance and Economics, Springer, vol. 65(1), pages 48-74, July.
    18. Elliott Sclar, 2021. "The Infinite Elasticity of Air: New York City’s Financialization of Transferable Development Rights," American Journal of Economics and Sociology, Wiley Blackwell, vol. 80(2), pages 353-380, March.
    19. Adam Found, 2021. "Development Charges and Housing Affordability: A False Dichotomy?," IMFG Papers 56, University of Toronto, Institute on Municipal Finance and Governance.
    20. Edward Shepherd & Matthew Wargent, 2024. "Embedding the land market: Polanyi, urban planning and regulation," Environment and Planning A, , vol. 56(3), pages 905-926, May.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:osf:osfxxx:fs76e_v1. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: OSF (email available below). General contact details of provider: https://osf.io/preprints/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.