IDEAS home Printed from https://ideas.repec.org/p/pra/mprapa/7231.html
   My bibliography  Save this paper

Microdata Adjustment by the Minimum Information Loss Principle

Author

Listed:
  • Merz, Joachim

Abstract

Microdata have become increasingly important for economic and social analyses. One striking problem with almost any practical analysis of microdata, microdata as a singular cross or longitudinal sample or within (static) microsimulation, is to achieve representative results. In this study a consistent solution of the microdata adjustment problem - that is to achieve representative results by re-weighting microdata to fit aggregate control data - is presented based on the Minimum Information Loss (MIL) principle. Based on information theory this principle satisfies the desired positivity constraint on the weighting factors to be computed. For the consistent solution which simultaneously adjusts hierarchical microdata (e.g. household and personal information), a fast numerical solution by a specific modified Newton-Raphson (MN) procedure with a global exponential approximation is proposed. Practical experiences for large microdata sets in a pension reform analysis with e.g. more than 60.000 households and 240 restrictions simultaneously to be achieved within the Sfb 3 microsimulation model show that this MN procedure was able to rather largely reduce the computional expenses by 75%. The available efficient PC-computer program ADJUST is also succesfully applied in a described microsimulation analyses of the recent 1990 German tax reform investigating the impacts on market and non-market labour supply within the formal and informal economy, and in a recent firm microsimulation analysion explaining factors of successful firms in the German engineering industry.

Suggested Citation

  • Merz, Joachim, 1994. "Microdata Adjustment by the Minimum Information Loss Principle," MPRA Paper 7231, University Library of Munich, Germany.
  • Handle: RePEc:pra:mprapa:7231
    as

    Download full text from publisher

    File URL: https://mpra.ub.uni-muenchen.de/7231/1/MPRA_paper_7231.pdf
    File Function: original version
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Merz, Joachim, 1994. "Microsimulation - A Survey of Methods and Applications for Analyzing Economic and Social Policy," MPRA Paper 7232, University Library of Munich, Germany.
    2. Merz, Joachim, 1993. "Microsimulation as an Instrument to Evaluate Economic and Social Programmes," MPRA Paper 7236, University Library of Munich, Germany.
    3. repec:bla:revinw:v:39:y:1993:i:2:p:177-94 is not listed on IDEAS
    4. Merz, Joachim, 1991. "Microsimulation -- A survey of principles, developments and applications," International Journal of Forecasting, Elsevier, vol. 7(1), pages 77-104, May.
    5. Finke, Renate & Theil, Henri, 1984. "An extended version of minimum information estimation of allocation models," Economics Letters, Elsevier, vol. 15(3-4), pages 229-233.
    6. Theil, Henri & Finke, Renate & Flood, Lennart R., 1984. "Minimum information estimation of allocation models," Economics Letters, Elsevier, vol. 15(3-4), pages 251-256.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Agenor, Pierre-Richard & Chen, Derek H.C. & Grimm, Michael, 2004. "Linking representative household models with household surveys for poverty analysis : a comparison of alternative methodologies," Policy Research Working Paper Series 3343, The World Bank.
    2. Joachim Merz & Henning Stolze, 2005. "Representative Time Use Data and Calibration of the American Time Use Studies 1965-1999," FFB-Discussionpaper 54, Research Institute on Professions (Forschungsinstitut Freie Berufe (FFB)), LEUPHANA University Lüneburg, revised Jan 2006.
    3. Grösche, Peter & Schröder, Carsten, 2011. "Eliciting public support for greening the electricity mix using random parameter techniques," Energy Economics, Elsevier, vol. 33(2), pages 363-370, March.
    4. Peter Grösche & Carsten Schröder, 2010. "Eliciting Public Support for Greening the Electricity Mix Using Random Parameter Techniques," Ruhr Economic Papers 0233, Rheinisch-Westfälisches Institut für Wirtschaftsforschung, Ruhr-Universität Bochum, Universität Dortmund, Universität Duisburg-Essen.
    5. Merz, Joachim & Lang, Rainer, 1997. "Preferred vs. Actual Working Hours - A Ten Years Paneleconometric Analysis for Professions, Entrepreneurs and Employees in Germany," MPRA Paper 7142, University Library of Munich, Germany.
    6. Anders Klevmarken, 2022. "Statistical Inference in Micro-simulation Models: Incorporating External Information," International Journal of Microsimulation, International Microsimulation Association, vol. 15(1), pages 111-120.
    7. repec:zbw:rwirep:0233 is not listed on IDEAS
    8. Joachim Merz & Henning Stolze, 2008. "Representative time use data and new harmonised calibration of the American Heritage Time Use Data (AHTUD) 1965-1999," electronic International Journal of Time Use Research, Research Institute on Professions (Forschungsinstitut Freie Berufe (FFB)) and The International Association for Time Use Research (IATUR), vol. 5(1), pages 90-126, November.
    9. Christof Schatz & Joachim Merz, 2000. "Die Rentenreform in der Diskussion Ein Mikrosimulationsmodell für die Altersvorsorge in Deutschland (AVID-PRO)," FFB-Discussionpaper 28, Research Institute on Professions (Forschungsinstitut Freie Berufe (FFB)), LEUPHANA University Lüneburg.
    10. Boysen-Hogrefe, Jens & Göttert, Marcell & Jäger, Philipp & Jessen, Robin, 2020. "Der Einfluss der Lohnspreizung und der Haushaltszusammensetzung auf die Lohnsteuereinnahmen," Kieler Beiträge zur Wirtschaftspolitik 25, Kiel Institute for the World Economy (IfW Kiel).
    11. Gijs Dekkers, 2015. "The simulation properties of microsimulation models with static and dynamic ageing a brief guide into choosing one type of model over the other," International Journal of Microsimulation, International Microsimulation Association, vol. 8(1), pages 97-109.
    12. Joachim Merz & Dominik Hanglberger & Rafael Rucha, 2010. "The Timing of Daily Demand for Goods and Services—Microsimulation Policy Results of an Aging Society, Increasing Labour Market Flexibility, and Extended Public Childcare in Germany," Journal of Consumer Policy, Springer, vol. 33(2), pages 119-141, June.
    13. Ulrich Widmaier & Hiltrud Niggemann & Joachim Merz, 1994. "What makes the Difference between Unsuccessful and Successful Firms in the German Mechanical Engineering Industry?," FFB-Discussionpaper 11, Research Institute on Professions (Forschungsinstitut Freie Berufe (FFB)), LEUPHANA University Lüneburg.
    14. Joachim Merz, 1993. "Market and Non-market Labor Supply and Recent German Tax Reform Impacts - Behavioral Response in a Combined Dynamic and Static Microsimulation Model," FFB-Discussionpaper 06, Research Institute on Professions (Forschungsinstitut Freie Berufe (FFB)), LEUPHANA University Lüneburg.
    15. Joachim Merz & Lars Rusch, 2015. "MICSIM-4j - A General Microsimulation Model User Guide (Version 1.1)," FFB-Discussionpaper 100, Research Institute on Professions (Forschungsinstitut Freie Berufe (FFB)), LEUPHANA University Lüneburg.
    16. Nicola Branson, 2009. "Re-weighting the OHS and LFS National household Survey Data to create a consistent series over time: A Cross Entropy Estimation Approach," SALDRU Working Papers 38, Southern Africa Labour and Development Research Unit, University of Cape Town.
    17. Joachim Merz & Dominik Hanglberger & Rafael Rucha, 2009. "The Timing of Daily Demand for Goods and Services – Multivariate Probit Estimates and Microsimulation Results for an Aged Population with German Time Use Diary Data," FFB-Discussionpaper 77, Research Institute on Professions (Forschungsinstitut Freie Berufe (FFB)), LEUPHANA University Lüneburg.
    18. Merz, Joachim, 1995. "MICSIM : Concept, Developments and Applications of a PC-Microsimulation Model for Research and Teaching," MPRA Paper 16029, University Library of Munich, Germany.
    19. Joachim Merz, 2002. "Zur Kumulation von Haushaltsstichproben," FFB-Discussionpaper 37, Research Institute on Professions (Forschungsinstitut Freie Berufe (FFB)), LEUPHANA University Lüneburg.
    20. Joachim Merz & Paul Böhm & Dominik Hanglberger & J.F. Rafael Rucha & Henning Stolze, 2007. "Wann werden Serviceleistungen nachgefragt? Ein Mikrosimulationsmodell alternativer Ladenöffnungszeiten mit Daten der Zeitbudgeterhebung ServSim," FFB-Discussionpaper 70, Research Institute on Professions (Forschungsinstitut Freie Berufe (FFB)), LEUPHANA University Lüneburg.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Joachim Merz & Henning Stolze, 2005. "Representative Time Use Data and Calibration of the American Time Use Studies 1965-1999," FFB-Discussionpaper 54, Research Institute on Professions (Forschungsinstitut Freie Berufe (FFB)), LEUPHANA University Lüneburg, revised Jan 2006.
    2. Merz, Joachim, 1995. "MICSIM : Concept, Developments and Applications of a PC-Microsimulation Model for Research and Teaching," MPRA Paper 16029, University Library of Munich, Germany.
    3. Joachim Merz & Henning Stolze, 2008. "Representative time use data and new harmonised calibration of the American Heritage Time Use Data (AHTUD) 1965-1999," electronic International Journal of Time Use Research, Research Institute on Professions (Forschungsinstitut Freie Berufe (FFB)) and The International Association for Time Use Research (IATUR), vol. 5(1), pages 90-126, November.
    4. Ulrich Widmaier & Hiltrud Niggemann & Joachim Merz, 1994. "What makes the Difference between Unsuccessful and Successful Firms in the German Mechanical Engineering Industry?," FFB-Discussionpaper 11, Research Institute on Professions (Forschungsinstitut Freie Berufe (FFB)), LEUPHANA University Lüneburg.
    5. Merz, Joachim, 2002. "Zur Kumulation von Haushaltsstichproben," MPRA Paper 5991, University Library of Munich, Germany.
    6. C. A. de Kam & J. de Haan & C. Giles & A. Manresa & E. Berenguer & S. Calonge & J. Merz, 1996. "Who pays the taxes?," FFB-Discussionpaper 18, Research Institute on Professions (Forschungsinstitut Freie Berufe (FFB)), LEUPHANA University Lüneburg.
      • de Kam, C. A. & de Haan, J. & Giles, C. & Manresa, A. & Berenguer, E. & Calonge, S., 1996. "Who pays the taxes?," MPRA Paper 7146, University Library of Munich, Germany.
    7. Joachim Merz & Lars Rusch, 2015. "MICSIM-4j - A General Microsimulation Model User Guide (Version 1.1)," FFB-Discussionpaper 100, Research Institute on Professions (Forschungsinstitut Freie Berufe (FFB)), LEUPHANA University Lüneburg.
    8. Chen, Dongling & Seale, James L., Jr., 2003. "The Informational Fit and Maximum Likelihood in a Pooled Cross-Country Demand System with Autocorrelation," Journal of Agricultural and Applied Economics, Southern Agricultural Economics Association, vol. 35(Supplemen), pages 1-7.
    9. Franziska Gassmann & Cecile Cherrier & Andrés Mideros Mora & Pierre Mohnen, 2013. "Making the Investment Case for Social Protection: Methodological challenges with lessons learnt from a recent study in Cambodia," Papers inwopa694, Innocenti Working Papers.
    10. Merz, Joachim, 1993. "Microsimulation as an Instrument to Evaluate Economic and Social Programmes," MPRA Paper 7236, University Library of Munich, Germany.
    11. Herwig Immervoll & Cathal O'Donoghue, 2009. "Towards a multi-purpose framework for tax-benefit microsimulation: lessons from EUROMOD," International Journal of Microsimulation, International Microsimulation Association, vol. 2(2), pages 43-54.
    12. Martin Spielauer & René Houle, 2004. "Sample size and statistical significance of hazard regression parameters. An exploration by means of Monte Carlo simulation of four transition models based on Hungarian GGS data," MPIDR Working Papers WP-2004-020, Max Planck Institute for Demographic Research, Rostock, Germany.
    13. Barros, Carlos Pestana & Prieto-Rodriguez, Juan, 2008. "A revenue-neutral tax reform to increase demand for public transport services," Transportation Research Part A: Policy and Practice, Elsevier, vol. 42(4), pages 659-672, May.
    14. Sadettin Erksoy, 1994. "The Effects of Higher Unemployment on the Distribution of Income in Canada: 1981-1987," Canadian Public Policy, University of Toronto Press, vol. 20(3), pages 318-328, September.
    15. Roantree, Barra & Regan, Mark & Callan, Tim & Savage, Michael & Walsh, John R., 2019. "Housing Assistance Payment: potential impacts on financial incentives to work," Papers WP610, Economic and Social Research Institute (ESRI).
    16. Thomas Brenner & Claudia Werker, 2007. "A Taxonomy of Inference in Simulation Models," Computational Economics, Springer;Society for Computational Economics, vol. 30(3), pages 227-244, October.
    17. Aksana Chyzheuskaya & Cathal O'Donoghue & Cathal Buckley & Mary Ryan & Stuart Green, 2012. "Modelling the Marginal Abatement Cost of Mitigating Nitrogen Loss from Agricultural Land," Working Papers 1205, Rural Economy and Development Programme,Teagasc.
    18. Merz, Joachim & Stolze, Henning & Zwick, Markus, 2006. "Wirkungen alternativer Steuerreformmodelle auf die Einkommensverteilung von Freien und anderen Berufen," MPRA Paper 5844, University Library of Munich, Germany.
    19. Joachim Merz & Dominik Hanglberger & Rafael Rucha, 2010. "The Timing of Daily Demand for Goods and Services—Microsimulation Policy Results of an Aging Society, Increasing Labour Market Flexibility, and Extended Public Childcare in Germany," Journal of Consumer Policy, Springer, vol. 33(2), pages 119-141, June.
    20. Martin Spielauer, 2007. "Dynamic microsimulation of health care demand, health care finance and the economic impact of health behaviours: survey and review," International Journal of Microsimulation, International Microsimulation Association, vol. 1(1), pages 35-53.

    More about this item

    Keywords

    Microdata Adjustment; Microanalyses; Microsimulation; Minimum Information Loss; Modified Newton- Raphson Algorithm; PC program package ADJUST;
    All these keywords.

    JEL classification:

    • C81 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - Methodology for Collecting, Estimating, and Organizing Microeconomic Data; Data Access
    • C80 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - General

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:pra:mprapa:7231. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Joachim Winter (email available below). General contact details of provider: https://edirc.repec.org/data/vfmunde.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.