IDEAS home Printed from https://ideas.repec.org/p/zbw/caseps/200427.html
   My bibliography  Save this paper

Parallel computing techniques

Author

Listed:
  • Nakano, Junji

Abstract

Parallel computing means to divide a job into several tasks and use more than one processor simultaneously to perform these tasks. Assume you have developed a new estimation method for the parameters of a complicated statistical model. After you prove the asymptotic characteristics of the method (for instance, asymptotic distribution of the estimator), you wish to perform many simulations to assure the goodness of the method for reasonable numbers of data values and for different values of parameters. You must generate simulated data, for example, 100 000 times for each length and parameter value. The total simulation work requires a huge number of random number generations and takes a long time on your PC. If you use 100 PCs in your institute to run these simulations simultaneously, you may expect that the total execution time will be 1/100. This is the simple idea of parallel computing.

Suggested Citation

  • Nakano, Junji, 2004. "Parallel computing techniques," Papers 2004,27, Humboldt University of Berlin, Center for Applied Statistics and Economics (CASE).
    • Handle: RePEc:zbw:caseps:200427
    as

    Download full text from publisher

    File URL: https://www.econstor.eu/bitstream/10419/22200/1/27_jn.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Racine, Jeff, 2002. "Parallel distributed kernel estimation," Computational Statistics & Data Analysis, Elsevier, vol. 40(2), pages 293-302, August.
    2. Swann, Christopher A, 2002. "Maximum Likelihood Estimation Using Parallel Computing: An Introduction to MPI," Computational Economics, Springer;Society for Computational Economics, vol. 19(2), pages 145-178, April.
    3. Murphy, K. & Clint, M. & Perrott, R. H., 1999. "Re-engineering statistical software for efficient parallel execution," Computational Statistics & Data Analysis, Elsevier, vol. 31(4), pages 441-456, October.
    4. Jones, H. & Mitra, G. & Parkinson, D. & Spinks, T., 1999. "A parallel implementation of the maximum likelihood method in positron emission tomography image reconstruction," Computational Statistics & Data Analysis, Elsevier, vol. 31(4), pages 417-439, October.
    5. Christofides, A. & Tanyi, B. & Christofides, S. & Whobrey, D. & Christofides, N., 1999. "The optimal discretization of probability density functions," Computational Statistics & Data Analysis, Elsevier, vol. 31(4), pages 475-486, October.
    6. Bull, J. M. & Riley, G. D. & Rasbash, J. & Goldstein, H., 1999. "Parallel implementation of a multilevel modelling package," Computational Statistics & Data Analysis, Elsevier, vol. 31(4), pages 457-474, October.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Michael Creel, 2005. "User-Friendly Parallel Computations with Econometric Examples," Computational Economics, Springer;Society for Computational Economics, vol. 26(2), pages 107-128, October.
    2. Michael Creel, 2016. "A Note on Julia and MPI, with Code Examples," Computational Economics, Springer;Society for Computational Economics, vol. 48(3), pages 535-546, October.
    3. Casarin, Roberto & Grassi, Stefano & Ravazzolo, Francesco & van Dijk, Herman K., 2015. "Parallel Sequential Monte Carlo for Efficient Density Combination: The DeCo MATLAB Toolbox," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 68(i03).
    4. Yi-Ting Chen & Edward W. Sun & Yi-Bing Lin, 2020. "Machine learning with parallel neural networks for analyzing and forecasting electricity demand," Computational Economics, Springer;Society for Computational Economics, vol. 56(2), pages 569-597, August.
    5. Christopher Ferrall, 2005. "Solving Finite Mixture Models: Efficient Computation in Economics Under Serial and Parallel Execution," Computational Economics, Springer;Society for Computational Economics, vol. 25(4), pages 343-379, June.
    6. Ichimura, Tsuyoshi & Fukuda, Daisuke, 2010. "A fast algorithm for computing least-squares cross-validations for nonparametric conditional kernel density functions," Computational Statistics & Data Analysis, Elsevier, vol. 54(12), pages 3404-3410, December.
    7. Langseth, Helge & Nielsen, Thomas D. & Rumí, Rafael & Salmerón, Antonio, 2009. "Inference in hybrid Bayesian networks," Reliability Engineering and System Safety, Elsevier, vol. 94(10), pages 1499-1509.
    8. Kyle Klein & Julian Neira, 2014. "Nelder-Mead Simplex Optimization Routine for Large-Scale Problems: A Distributed Memory Implementation," Computational Economics, Springer;Society for Computational Economics, vol. 43(4), pages 447-461, April.
    9. Michael Creel & William Goffe, 2008. "Multi-core CPUs, Clusters, and Grid Computing: A Tutorial," Computational Economics, Springer;Society for Computational Economics, vol. 32(4), pages 353-382, November.
    10. Bound, John & Stinebrickner, Todd & Waidmann, Timothy, 2010. "Health, economic resources and the work decisions of older men," Journal of Econometrics, Elsevier, vol. 156(1), pages 106-129, May.
    11. Michael Creel, 2008. "Estimation of Dynamic Latent Variable Models Using Simulated Nonparametric Moments," UFAE and IAE Working Papers 725.08, Unitat de Fonaments de l'Anàlisi Econòmica (UAB) and Institut d'Anàlisi Econòmica (CSIC), revised 02 Jun 2008.
    12. Jurgen A. Doornik & Neil Shephard & David F. Hendry, 2004. "Parallel Computation in Econometrics: A Simplified Approach," Economics Papers 2004-W16, Economics Group, Nuffield College, University of Oxford.
    13. Michael S. Delgado & Christopher F. Parmeter, 2013. "Embarrassingly Easy Embarrassingly Parallel Processing in R: Implementation and Reproducibility," Working Papers 2013-06, University of Miami, Department of Economics.
    14. Michael Creel, 2004. "ParallelKnoppix - Rapid Deployment of a Linux Cluster for MPI Parallel Processing Using Non-Dedicated Computers," UFAE and IAE Working Papers 625.04, Unitat de Fonaments de l'Anàlisi Econòmica (UAB) and Institut d'Anàlisi Econòmica (CSIC).
    15. Donghoon Lee & Matthew Wiswall, 2007. "A Parallel Implementation of the Simplex Function Minimization Routine," Computational Economics, Springer;Society for Computational Economics, vol. 30(2), pages 171-187, September.
    16. McNicholas, P.D. & Murphy, T.B. & McDaid, A.F. & Frost, D., 2010. "Serial and parallel implementations of model-based clustering via parsimonious Gaussian mixture models," Computational Statistics & Data Analysis, Elsevier, vol. 54(3), pages 711-723, March.
    17. Mathur, Sudhanshu & Morozov, Sergei, 2009. "Massively Parallel Computation Using Graphics Processors with Application to Optimal Experimentation in Dynamic Control," MPRA Paper 16721, University Library of Munich, Germany.
    18. Morozov, Sergei & Mathur, Sudhanshu, 2009. "Massively parallel computation using graphics processors with application to optimal experimentation in dynamic control," MPRA Paper 30298, University Library of Munich, Germany, revised 04 Apr 2011.
    19. Sergei Morozov & Sudhanshu Mathur, 2012. "Massively Parallel Computation Using Graphics Processors with Application to Optimal Experimentation in Dynamic Control," Computational Economics, Springer;Society for Computational Economics, vol. 40(2), pages 151-182, August.
    20. John Bound & Todd Stinebrickner & Timothy Waidman, 2004. "Using a Structural Retirement Model to Simulate the Effect of Changes to the OASDI and Medicare Programs," Working Papers wp091, University of Michigan, Michigan Retirement Research Center.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:zbw:caseps:200427. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: ZBW - Leibniz Information Centre for Economics (email available below). General contact details of provider: https://edirc.repec.org/data/cahubde.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.