IDEAS home Printed from https://ideas.repec.org/a/kap/compec/v25y2005i4p343-379.html
   My bibliography  Save this article

Solving Finite Mixture Models: Efficient Computation in Economics Under Serial and Parallel Execution

Author

Listed:
  • Christopher Ferrall

Abstract

Many economic models are completed by finding a parameter vector θ that optimizes a function f(θ), a task that can only be accomplished by iterating from a starting vector θ 0 . Use of a generic iterative optimizer to carry out this task can waste enormous amounts of computation when applied to a class of problems defined here as finite mixture models. The finite mixture class is large and important in economics and eliminating wasted computations requires only limited changes to standard code. Further, the approach described here greatly increases gains from parallel execution and opens possibilities for re-writing objective functions to make further efficiency gains. Copyright Springer Science + Business Media, Inc. 2005

Suggested Citation

  • Christopher Ferrall, 2005. "Solving Finite Mixture Models: Efficient Computation in Economics Under Serial and Parallel Execution," Computational Economics, Springer;Society for Computational Economics, vol. 25(4), pages 343-379, June.
    • Handle: RePEc:kap:compec:v:25:y:2005:i:4:p:343-379
    DOI: 10.1007/s10614-005-6413-3
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1007/s10614-005-6413-3
    Download Restriction: Access to full text is restricted to subscribers.
    File URL: https://libkey.io/10.1007/s10614-005-6413-3?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Heckman, James & Singer, Burton, 1984. "A Method for Minimizing the Impact of Distributional Assumptions in Econometric Models for Duration Data," Econometrica, Econometric Society, vol. 52(2), pages 271-320, March.
    2. Peter Arcidiacono & John Bailey Jones, 2003. "Finite Mixture Distributions, Sequential Likelihood and the EM Algorithm," Econometrica, Econometric Society, vol. 71(3), pages 933-946, May.
    3. Victor Aguirregabiria & Pedro Mira, 2002. "Swapping the Nested Fixed Point Algorithm: A Class of Estimators for Discrete Markov Decision Models," Econometrica, Econometric Society, vol. 70(4), pages 1519-1543, July.
    4. V. Joseph Hotz & Robert A. Miller, 1993. "Conditional Choice Probabilities and the Estimation of Dynamic Models," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 60(3), pages 497-529.
    5. Donghoon Lee, 2005. "An Estimable Dynamic General Equilibrium Model Of Work, Schooling, And Occupational Choice," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 46(1), pages 1-34, February.
    6. Nagurney, Anna, 1996. "Parallel computation," Handbook of Computational Economics, in: H. M. Amman & D. A. Kendrick & J. Rust (ed.), Handbook of Computational Economics, edition 1, volume 1, chapter 7, pages 335-404, Elsevier.
    7. Daniel McFadden & Kenneth Train, 2000. "Mixed MNL models for discrete response," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 15(5), pages 447-470.
    8. H. M. Amman & D. A. Kendrick & J. Rust (ed.), 1996. "Handbook of Computational Economics," Handbook of Computational Economics, Elsevier, edition 1, volume 1, number 1.
    9. Swann, Christopher A, 2002. "Maximum Likelihood Estimation Using Parallel Computing: An Introduction to MPI," Computational Economics, Springer;Society for Computational Economics, vol. 19(2), pages 145-178, April.
    10. Christopher A. Swann, 2001. "Software for parallel computing: the LAM implementation of MPI," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 16(2), pages 185-194.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Aguirregabiria, Victor & Mira, Pedro, 2010. "Dynamic discrete choice structural models: A survey," Journal of Econometrics, Elsevier, vol. 156(1), pages 38-67, May.
    2. José Dias Curto, 2024. "Recalculate Without Recomputing," Computational Economics, Springer;Society for Computational Economics, vol. 64(6), pages 3279-3294, December.
    3. Michael Creel & William Goffe, 2008. "Multi-core CPUs, Clusters, and Grid Computing: A Tutorial," Computational Economics, Springer;Society for Computational Economics, vol. 32(4), pages 353-382, November.
    4. Alexander W. Cappelen & James Konow & Erik ?. S?rensen & Bertil Tungodden, 2013. "Just Luck: An Experimental Study of Risk-Taking and Fairness," American Economic Review, American Economic Association, vol. 103(4), pages 1398-1413, June.
    5. Donghoon Lee & Matthew Wiswall, 2007. "A Parallel Implementation of the Simplex Function Minimization Routine," Computational Economics, Springer;Society for Computational Economics, vol. 30(2), pages 171-187, September.
    6. Christopher Ferrall, 2020. "Object Oriented (Dynamic) Programming: Replication, Innovation and "Structural" Estimation," Working Paper 1432, Economics Department, Queen's University.
    7. Alexander W. Cappelen & Astri Drange Hole & Erik Ø Sørensen & Bertil Tungodden, 2007. "The Pluralism of Fairness Ideals: An Experimental Approach," American Economic Review, American Economic Association, vol. 97(3), pages 818-827, June.
    8. Christopher Ferrall, 2023. "Object Oriented (Dynamic) Programming: Closing the “Structural” Estimation Coding Gap," Computational Economics, Springer;Society for Computational Economics, vol. 62(3), pages 761-816, October.
    9. Cappelen, Alexander W. & Sørensen, Erik Ø. & Tungodden, Bertil, 2010. "Responsibility for what? Fairness and individual responsibility," European Economic Review, Elsevier, vol. 54(3), pages 429-441, April.
    10. Kyle Klein & Julian Neira, 2014. "Nelder-Mead Simplex Optimization Routine for Large-Scale Problems: A Distributed Memory Implementation," Computational Economics, Springer;Society for Computational Economics, vol. 43(4), pages 447-461, April.
    11. Alexander W. Cappelen & Karl Ove Moene & Erik Ø. Sørensen & Bertil Tungodden, 2008. "Rich meets Poor - An International Fairness Experiment," Tinbergen Institute Discussion Papers 08-098/3, Tinbergen Institute.
    12. Christopher Ferrall, 2012. "Explaining and Forecasting Results of the Self-sufficiency Project," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 79(4), pages 1495-1526.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Aguirregabiria, Victor & Mira, Pedro, 2010. "Dynamic discrete choice structural models: A survey," Journal of Econometrics, Elsevier, vol. 156(1), pages 38-67, May.
    2. Peter Arcidiacono & Paul B. Ellickson, 2011. "Practical Methods for Estimation of Dynamic Discrete Choice Models," Annual Review of Economics, Annual Reviews, vol. 3(1), pages 363-394, September.
    3. Sebastian Galiani & Juan Pantano, 2021. "Structural Models: Inception and Frontier," NBER Working Papers 28698, National Bureau of Economic Research, Inc.
    4. Christopher Ferrall, 2003. "Solving Finite Mixture Models in Parallel," Computational Economics 0303003, University Library of Munich, Germany.
    5. Keane, Michael P. & Todd, Petra E. & Wolpin, Kenneth I., 2011. "The Structural Estimation of Behavioral Models: Discrete Choice Dynamic Programming Methods and Applications," Handbook of Labor Economics, in: O. Ashenfelter & D. Card (ed.), Handbook of Labor Economics, edition 1, volume 4, chapter 4, pages 331-461, Elsevier.
    6. Peter Arcidiacono & Robert A. Miller, 2011. "Conditional Choice Probability Estimation of Dynamic Discrete Choice Models With Unobserved Heterogeneity," Econometrica, Econometric Society, vol. 79(6), pages 1823-1867, November.
    7. Peter Arcidiacono & Holger Sieg & Frank Sloan, 2007. "Living Rationally Under The Volcano? An Empirical Analysis Of Heavy Drinking And Smoking," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 48(1), pages 37-65, February.
    8. Mario Fiorini, 2012. "Fostering Educational Enrolment Through Subsidies: The Issue Of Timing," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 27(5), pages 741-772, August.
    9. Belzil, Christian, 2007. "The return to schooling in structural dynamic models: a survey," European Economic Review, Elsevier, vol. 51(5), pages 1059-1105, July.
    10. Victor Aguirregabiria & Cesar Alonso-Borrego, 2014. "Labor Contracts And Flexibility: Evidence From A Labor Market Reform In Spain," Economic Inquiry, Western Economic Association International, vol. 52(2), pages 930-957, April.
    11. Thibaut Lamadon & Elena Manresa & Stephane Bonhomme, 2016. "Discretizing Unobserved Heterogeneity," 2016 Meeting Papers 1536, Society for Economic Dynamics.
    12. Victor Aguirregabiria & Arvind Magesan, 2013. "Euler Equations for the Estimation of Dynamic Discrete Choice Structural Models," Advances in Econometrics, in: Structural Econometric Models, volume 31, pages 3-44, Emerald Group Publishing Limited.
    13. Elena Mattana & Juanna Joensen, 2014. "Student Aid, Academic Achievement, and Labor Market Behavior: Grants or Loans?," 2014 Meeting Papers 707, Society for Economic Dynamics.
    14. Hiroyuki Kasahara & Katsumi Shimotsu, 2006. "Nonparametric Identification And Estimation Of Finite Mixture Models Of Dynamic Discrete Choices," Working Paper 1092, Economics Department, Queen's University.
    15. Peter Arcidiacono, Holger Sieg, Frank Sloan, 2001. "Living Rationally Under the Volcano? Heavy Drinking and Smoking Among the Elderly," Computing in Economics and Finance 2001 207, Society for Computational Economics.
    16. Scott, Paul, 2014. "Dynamic Discrete Choice Estimation of Agricultural Land Use," TSE Working Papers 14-526, Toulouse School of Economics (TSE).
    17. Magali Beffy & Denis Fougère & Arnaud Maurel, 2012. "Choosing the Field of Study in Postsecondary Education: Do Expected Earnings Matter?," The Review of Economics and Statistics, MIT Press, vol. 94(1), pages 334-347, February.
    18. Victor Aguirregabiria & Pedro Mira, 2002. "Swapping the Nested Fixed Point Algorithm: A Class of Estimators for Discrete Markov Decision Models," Econometrica, Econometric Society, vol. 70(4), pages 1519-1543, July.
    19. Odran Bonnet & Alfred Galichon & Yu-Wei Hsieh & Keith O’Hara & Matt Shum, 2022. "Yogurts Choose Consumers? Estimation of Random-Utility Models via Two-Sided Matching," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 89(6), pages 3085-3114.
    20. Michael Creel & William Goffe, 2008. "Multi-core CPUs, Clusters, and Grid Computing: A Tutorial," Computational Economics, Springer;Society for Computational Economics, vol. 32(4), pages 353-382, November.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:kap:compec:v:25:y:2005:i:4:p:343-379. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.