IDEAS home Printed from https://ideas.repec.org/p/ags/aaea15/205737.html
   My bibliography  Save this paper

Forecasting Urban Water Demand in California: Rethinking Model Evaluation

Author

Listed:
  • Buck, Steven
  • Soldati, Hilary
  • Sunding, David L.

Abstract

Urban water managers rely heavily on forecasts of water consumption to determine management decisions and investment choices. Typical forecasts rely on simple models whose criteria for selection has little to do with their performance in predicting out-of-sample consumption levels. We demonstrate this issue by comparing forecast models selected on the basis of their ability to perform well in-sample versus out-of-sample. Our results highlight the benefits of developing out-of-sample evaluation criteria to ascertain model performance. Using annual data on single-family residential water consumption in Southern California we illustrate how prediction ability varies according to model evaluation method. Using a training dataset, this analysis finds that models ranking highly on in-sample performance significantly over-estimated consumption (10% − 25%) five years out from the end of the training dataset relative to observed demands five years out from the end of the training dataset. Whereas, the top models selected using our out-of-sample criteria, came within 1% of the actual total consumption. Notably, projections of future demand for the in-sample models indicate increasing aggregate water consumption over a 25-year period, which contrasts against the downward trend predicted by the out-of-sample models.

Suggested Citation

  • Buck, Steven & Soldati, Hilary & Sunding, David L., 2015. "Forecasting Urban Water Demand in California: Rethinking Model Evaluation," 2015 AAEA & WAEA Joint Annual Meeting, July 26-28, San Francisco, California 205737, Agricultural and Applied Economics Association.
  • Handle: RePEc:ags:aaea15:205737
    DOI: 10.22004/ag.econ.205737
    as

    Download full text from publisher

    File URL: https://ageconsearch.umn.edu/record/205737/files/buck%20et%20al_forecasting%20water%20demand_aaea2015.pdf
    Download Restriction: no

    File URL: https://libkey.io/10.22004/ag.econ.205737?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Maximilian Auffhammer & Ralf Steinhauser, 2012. "Forecasting The Path of U.S. CO_2 Emissions Using State-Level Information," The Review of Economics and Statistics, MIT Press, vol. 94(1), pages 172-185, February.
    2. Auffhammer, Maximilian & Carson, Richard T., 2008. "Forecasting the path of China's CO2 emissions using province-level information," Journal of Environmental Economics and Management, Elsevier, vol. 55(3), pages 229-247, May.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Nemati, Mehdi & Buck, Steven & Soldati, Hilary, 2017. "The Effect of Social and Consumption Analytics on Residential Water Demand," 2017 Annual Meeting, February 4-7, 2017, Mobile, Alabama 252738, Southern Agricultural Economics Association.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Du, Limin & Hanley, Aoife & Wei, Chu, 2015. "Estimating the Marginal Abatement Cost Curve of CO2 Emissions in China: Provincial Panel Data Analysis," Energy Economics, Elsevier, vol. 48(C), pages 217-229.
    2. Doupe, Patrick, 2014. "The costs of error in setting reference rates for reduced deforestation," Working Papers 249497, Australian National University, Centre for Climate Economics & Policy.
    3. Michael Cary, 2020. "Have greenhouse gas emissions from US energy production peaked? State level evidence from six subsectors," Environment Systems and Decisions, Springer, vol. 40(1), pages 125-134, March.
    4. Patrick Doupe, 2014. "The Costs of Error in Setting Reference Rates for Reduced Deforestation," CCEP Working Papers 1415, Centre for Climate & Energy Policy, Crawford School of Public Policy, The Australian National University.
    5. Xueting Zhao & J. Burnett, 2014. "Forecasting province-level $${\text {CO}}_{2}$$ CO 2 emissions in China," Letters in Spatial and Resource Sciences, Springer, vol. 7(3), pages 171-183, October.
    6. Yang, Haisheng & He, Jie & Chen, Shaoling, 2015. "The fragility of the Environmental Kuznets Curve: Revisiting the hypothesis with Chinese data via an “Extreme Bound Analysis”," Ecological Economics, Elsevier, vol. 109(C), pages 41-58.
    7. Fujii, Hidemichi & Managi, Shunsuke, 2013. "Which industry is greener? An empirical study of nine industries in OECD countries," Energy Policy, Elsevier, vol. 57(C), pages 381-388.
    8. Chen, Shuai & Chen, Xiaoguang & Xu, Jintao, 2013. "Impacts of Climate Change on Corn and Soybean Yields in China," 2013 Annual Meeting, August 4-6, 2013, Washington, D.C. 149739, Agricultural and Applied Economics Association.
    9. Zhao, Xiaoli & Li, Shujie & Zhang, Sufang & Yang, Rui & Liu, Suwei, 2016. "The effectiveness of China's wind power policy: An empirical analysis," Energy Policy, Elsevier, vol. 95(C), pages 269-279.
    10. Ling Xiong & Shaozhou Qi, 2018. "Financial Development And Carbon Emissions In Chinese Provinces: A Spatial Panel Data Analysis," The Singapore Economic Review (SER), World Scientific Publishing Co. Pte. Ltd., vol. 63(02), pages 447-464, March.
    11. Chen, Cuicui & Zeckhauser, Richard, 2018. "Collective action in an asymmetric world," Journal of Public Economics, Elsevier, vol. 158(C), pages 103-112.
    12. Yanan Liu & Yixuan Gao & Yu Hao & Hua Liao, 2016. "The Relationship between Residential Electricity Consumption and Income: A Piecewise Linear Model with Panel Data," Energies, MDPI, vol. 9(10), pages 1-11, October.
    13. Jalil, Abdul & Mahmud, Syed F., 2009. "Environment Kuznets curve for CO2 emissions: A cointegration analysis for China," Energy Policy, Elsevier, vol. 37(12), pages 5167-5172, December.
    14. Ren, Xiaohang & Lu, Zudi & Cheng, Cheng & Shi, Yukun & Shen, Jian, 2019. "On dynamic linkages of the state natural gas markets in the USA: Evidence from an empirical spatio-temporal network quantile analysis," Energy Economics, Elsevier, vol. 80(C), pages 234-252.
    15. Zheng, Jiali & Mi, Zhifu & Coffman, D'Maris & Milcheva, Stanimira & Shan, Yuli & Guan, Dabo & Wang, Shouyang, 2019. "Regional development and carbon emissions in China," Energy Economics, Elsevier, vol. 81(C), pages 25-36.
    16. Zhang, Lin, 2017. "Correcting the uneven burden sharing of emission reduction across provinces in China," Energy Economics, Elsevier, vol. 64(C), pages 335-345.
    17. Yu, Wei & Pagani, Roberto & Huang, Lei, 2012. "CO2 emission inventories for Chinese cities in highly urbanized areas compared with European cities," Energy Policy, Elsevier, vol. 47(C), pages 298-308.
    18. Richard T. Carson, 2010. "The Environmental Kuznets Curve: Seeking Empirical Regularity and Theoretical Structure," Review of Environmental Economics and Policy, Association of Environmental and Resource Economists, vol. 4(1), pages 3-23, Winter.
    19. Eddy Bekkers & Joseph F. Francois & Hugo Rojas†Romagosa, 2018. "Melting Ice Caps and the Economic Impact of Opening the Northern Sea Route," Economic Journal, Royal Economic Society, vol. 128(610), pages 1095-1127, May.
    20. Siqi Zheng & Rui Wang & Edward L. Glaeser & Matthew E. Kahn, 2011. "The greenness of China: household carbon dioxide emissions and urban development," Journal of Economic Geography, Oxford University Press, vol. 11(5), pages 761-792, September.

    More about this item

    Keywords

    Demand and Price Analysis; Environmental Economics and Policy; Research Methods/ Statistical Methods; Resource/Energy Economics and Policy;
    All these keywords.

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ags:aaea15:205737. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: AgEcon Search (email available below). General contact details of provider: https://edirc.repec.org/data/aaeaaea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.