IDEAS home Printed from https://ideas.repec.org/a/bla/stanee/v72y2018i4p553-573.html
   My bibliography  Save this article

Solving large‐data consistency problems at Statistics Netherlands using macro‐integration techniques

Author

Listed:
  • Nino Mushkudiani
  • Jacco Daalmans
  • Reinier Bikker

Abstract

The generalized multivariate Denton model for achieving consistency between large accounting frameworks developed at Statistics Netherlands (SN) is originally intended for benchmarking of supply and use (SU) tables of national accounts. The success of this application in the production process triggered using the model for other processes within the office. Currently, at SN, many production processes of national accounts, but also other departments, use the modifications of this optimization model for achieving consistency of data obtained from different sources. These include reconciliation and benchmarking of SU tables and of institutional sector accounts, ESA (European system of accounts), revisions of SU tables, benchmarking of gross fixed capital formation, Population Census tables, and energy statistics figures. The mathematical model is based on a quadratic optimization function and combines different features, such as linear constraints, ratio constraints, weights, soft and hard constraints, and inequalities. The optimization problems we deal with can be very large, consisting of 500,000 variables and over 100,000 constraints. This optimization problem is solved using the commercially available software tool XPRESS and the free software tool R. For the reconciliation of trade and transport statistics, similar optimization techniques are used. In this paper, we give an overview of production processes at SN using macro‐integration techniques.

Suggested Citation

  • Nino Mushkudiani & Jacco Daalmans & Reinier Bikker, 2018. "Solving large‐data consistency problems at Statistics Netherlands using macro‐integration techniques," Statistica Neerlandica, Netherlands Society for Statistics and Operations Research, vol. 72(4), pages 553-573, November.
    • Handle: RePEc:bla:stanee:v:72:y:2018:i:4:p:553-573
    DOI: 10.1111/stan.12158
    as

    Download full text from publisher

    File URL: https://doi.org/10.1111/stan.12158
    Download Restriction: no
    File URL: https://libkey.io/10.1111/stan.12158?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. repec:bla:revinw:v:46:y:2000:i:3:p:329-50 is not listed on IDEAS
    2. Reinier Bikker & Jacco Daalmans & Nino Mushkudiani, 2013. "Benchmarking Large Accounting Frameworks: A Generalized Multivariate Model," Economic Systems Research, Taylor & Francis Journals, vol. 25(4), pages 390-408, December.
    3. Baoline Chen, 2007. "An Empirical Comparison of Methods for Temporal Distribution and Interpolation at the National Accounts," BEA Papers 0077, Bureau of Economic Analysis.
    4. Tommaso di Fonzo & Marco Marini, 2005. "Benchmarking Systems of Seasonally Adjusted Time Series," Journal of Business Cycle Measurement and Analysis, OECD Publishing, Centre for International Research on Economic Tendency Surveys, vol. 2005(1), pages 89-123.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Baoline Chen & Tommaso Di Fonzo & Thomas Howells & Marco Marini, 2018. "The statistical reconciliation of time series of accounts between two benchmark revisions," Statistica Neerlandica, Netherlands Society for Statistics and Operations Research, vol. 72(4), pages 533-552, November.
    2. Umed Temursho, 2018. "Entropy‐based benchmarking methods," Statistica Neerlandica, Netherlands Society for Statistics and Operations Research, vol. 72(4), pages 421-446, November.
    3. Enrique M. Quilis, 2018. "Temporal disaggregation of economic time series: The view from the trenches," Statistica Neerlandica, Netherlands Society for Statistics and Operations Research, vol. 72(4), pages 447-470, November.
    4. Vega-Lacorte, Juliana E. & Watkins-Fassler, Karen., 2013. "Crédito al consumo en Argentina durante periodos normales y de crisis económicas," Panorama Económico, Escuela Superior de Economía, Instituto Politécnico Nacional, vol. 0(16), pages 51-76, primer se.
    5. Travaglini, Guido, 2010. "Supervised Principal Components and Factor Instrumental Variables. An Application to Violent CrimeTrends in the US, 1982-2005," MPRA Paper 22077, University Library of Munich, Germany.
    6. Cyriac Guillaumin & Salem Boubakri & Alexandre Silanine, 2020. "Do commodity price volatilities impact currency misalignments in commodity-exporting countries?," Economics Bulletin, AccessEcon, vol. 40(2), pages 1727-1739.
    7. Klaus Abberger & Michael Graff & Boriss Siliverstovs & Jan-Egbert Sturm, 2014. "The KOF Economic Barometer, Version 2014," KOF Working papers 14-353, KOF Swiss Economic Institute, ETH Zurich.
    8. Luboš Marek & Stanislava Hronová & Richard Hindls, 2017. "Option For Predicting The Czech Republic'S Foreign Trade Time Series As Components In Gross Domestic Product," Statistics in Transition New Series, Polish Statistical Association, vol. 18(3), pages 481-500, September.
    9. Luke Mosley & Idris A. Eckley & Alex Gibberd, 2022. "Sparse temporal disaggregation," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 185(4), pages 2203-2233, October.
    10. Mateusz Pipień & Sylwia Roszkowska, 2015. "Szacunki kwartalnego PKB w polskich województwach," Gospodarka Narodowa. The Polish Journal of Economics, Warsaw School of Economics, issue 5, pages 145-169.
    11. Okrent, Abigail M. & Elitzak, Howard & Park, Timothy & Rehkamp, Sarah, 2018. "Measuring the Value of the U.S. Food System: Revisions to the Food Expenditure Series," Technical Bulletins 277568, United States Department of Agriculture, Economic Research Service.
    12. Kazemier Brugt & van Veen Michel & IJmker Sander, 2019. "The unobserved economy and the Dutch national accounts after the benchmark revision 2015," Central European Economic Journal, Sciendo, vol. 6(53), pages 1-24, January.
    13. Ton de Waal & Arnout van Delden & Sander Scholtus, 2020. "Multi‐source Statistics: Basic Situations and Methods," International Statistical Review, International Statistical Institute, vol. 88(1), pages 203-228, April.
    14. Matthias Uhl, 2014. "State Fiscal Policies and Regional Economic Activity," MAGKS Papers on Economics 201446, Philipps-Universität Marburg, Faculty of Business Administration and Economics, Department of Economics (Volkswirtschaftliche Abteilung).
    15. Maximiliano Gómez Aguirre & Ariel David Krysa, 2023. "Consumer Loans Dynamics in 2020 in Argentina: An Approach Using Error Correction Models," Ensayos Económicos, Central Bank of Argentina, Economic Research Department, vol. 1(81), pages 111-158, May.
    16. Baoline Chen & Tommaso Di Fonzo & Thomas Howells & Marco Marini, 2014. "The Statistical Reconciliation of Time Series of Accounts after a Benchmark Revision," BEA Working Papers 0117, Bureau of Economic Analysis.
    17. Athanasopoulos, George & Hyndman, Rob J. & Kourentzes, Nikolaos & Panagiotelis, Anastasios, 2024. "Forecast reconciliation: A review," International Journal of Forecasting, Elsevier, vol. 40(2), pages 430-456.
    18. Michael Graff & Dominik Studer, 2018. "Konstruktion von Sammelindikatoren für den Konjunkturverlauf bei prekärer Datenlage am Beispiel Montenegros," KOF Analysen, KOF Swiss Economic Institute, ETH Zurich, vol. 12(3), pages 81-91, October.
    19. Iacoviello, Matteo & Navarro, Gaston, 2019. "Foreign effects of higher U.S. interest rates," Journal of International Money and Finance, Elsevier, vol. 95(C), pages 232-250.
    20. Maximiliano Gomez Aguirre & Ariel Krysa, 2022. "Consumer Loans Dynamics in 2020 in Argentina: An Approach Using Error Correction Models," BCRA Working Paper Series 202298, Central Bank of Argentina, Economic Research Department.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:stanee:v:72:y:2018:i:4:p:553-573. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: http://www.blackwellpublishing.com/journal.asp?ref=0039-0402 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.