IDEAS home Printed from https://ideas.repec.org/a/eee/matcom/v161y2019icp66-75.html
   My bibliography  Save this article

Checking the quality of approximation of p-values in statistical tests for random number generators by using a three-level test

Author

Listed:
  • Haramoto, Hiroshi
  • Matsumoto, Makoto

Abstract

Statistical tests of pseudorandom number generators (PRNGs) are applicable to any type of random number generators and are indispensable for evaluation. While several practical packages for statistical tests of randomness exist, they may suffer from a lack of reliability: for some tests, the amount of approximation error can be deemed significant. Reducing this error by finding a better approximation is necessary, but it generally requires an enormous amount of effort. In this paper, we introduce an experimental method for revealing defects in statistical tests by using a three-level test proposed by Okutomi and Nakamura. In particular, we investigate the NIST test suite and the test batteries in TestU01, which are widely used statistical packages. Furthermore, we show the efficiency of several modifications for some tests.

Suggested Citation

  • Haramoto, Hiroshi & Matsumoto, Makoto, 2019. "Checking the quality of approximation of p-values in statistical tests for random number generators by using a three-level test," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 161(C), pages 66-75.
    • Handle: RePEc:eee:matcom:v:161:y:2019:i:c:p:66-75
    DOI: 10.1016/j.matcom.2018.08.005
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0378475418302039
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.matcom.2018.08.005?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Pierre L'Écuyer & Jean-François Cordeau & Richard Simard, 2000. "Close-Point Spatial Tests and Their Application to Random Number Generators," Operations Research, INFORMS, vol. 48(2), pages 308-317, April.
    2. Simard, Richard & L'Ecuyer, Pierre, 2011. "Computing the Two-Sided Kolmogorov-Smirnov Distribution," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 39(i11).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Talwar, Manish & Talwar, Shalini & Kaur, Puneet & Tripathy, Naliniprava & Dhir, Amandeep, 2021. "Has financial attitude impacted the trading activity of retail investors during the COVID-19 pandemic?," Journal of Retailing and Consumer Services, Elsevier, vol. 58(C).
    2. Song-Hee Kim & Ward Whitt, 2014. "Are Call Center and Hospital Arrivals Well Modeled by Nonhomogeneous Poisson Processes?," Manufacturing & Service Operations Management, INFORMS, vol. 16(3), pages 464-480, July.
    3. Jorino van Rhijn & Cornelis W. Oosterlee & Lech A. Grzelak & Shuaiqiang Liu, 2021. "Monte Carlo Simulation of SDEs using GANs," Papers 2104.01437, arXiv.org.
    4. Jiahang He & Toshiyuki Yamamoto, 2020. "Characterization of Daily Travel Distance of a University Car Fleet for the Purpose of Replacing Conventional Vehicles with Electric Vehicles," Sustainability, MDPI, vol. 12(2), pages 1-12, January.
    5. Wu, Zhongqi & Jiang, Hui & Liang, Xiaoyu & Zhou, Yangye, 2024. "Multi-period distributionally robust emergency medical service location model with customized ambiguity sets," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 181(C).
    6. Rokhsareh Khashtabeh & Morteza Akbari & Mahdi Kolahi & Ali Talebanfard, 2021. "Assessing the effects of desertification control projects using socio-economic indicators in the arid regions of eastern Iran," Environment, Development and Sustainability: A Multidisciplinary Approach to the Theory and Practice of Sustainable Development, Springer, vol. 23(7), pages 10455-10469, July.
    7. Harase, Shin, 2019. "Conversion of Mersenne Twister to double-precision floating-point numbers," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 161(C), pages 76-83.
    8. Haoran Hu & Xinjun Wang & Site Feng & Zhongli Xu & Jing Liu & Elisa Heidrich-O’Hare & Yanshuo Chen & Molin Yue & Lang Zeng & Ziqi Rong & Tianmeng Chen & Timothy Billiar & Ying Ding & Heng Huang & Rich, 2024. "A unified model-based framework for doublet or multiplet detection in single-cell multiomics data," Nature Communications, Nature, vol. 15(1), pages 1-16, December.
    9. Fernando Freire Vasconcelos & Renato Máximo Sátiro & Luiz Paulo Lopes Fávero & Gabriela Troyano Bortoloto & Hamilton Luiz Corrêa, 2023. "Analysis of Judiciary Expenditure and Productivity Using Machine Learning Techniques," Mathematics, MDPI, vol. 11(14), pages 1-19, July.
    10. Tanvir Uddin Chowdhury & Peter Y. Park & Kevin Gingerich, 2022. "Estimation of Appropriate Acceleration Lane Length for Safe and Efficient Truck Platooning Operation on Freeway Merge Areas," Sustainability, MDPI, vol. 14(19), pages 1-25, October.
    11. Delbaz, Reza & Ebrahimian, Hamed & Abbasi, Fariborz & Ghameshlou, Arezoo N. & Liaghat, Abdolmajid & Ranazadeh, Dariush, 2023. "A global meta-analysis on surface and drip fertigation for annual crops under different fertilization levels," Agricultural Water Management, Elsevier, vol. 289(C).
    12. Sloot Henrik, 2022. "Implementing Markovian models for extendible Marshall–Olkin distributions," Dependence Modeling, De Gruyter, vol. 10(1), pages 308-343, January.
    13. Li, Penghua & Zhang, Zijian & Grosu, Radu & Deng, Zhongwei & Hou, Jie & Rong, Yujun & Wu, Rui, 2022. "An end-to-end neural network framework for state-of-health estimation and remaining useful life prediction of electric vehicle lithium batteries," Renewable and Sustainable Energy Reviews, Elsevier, vol. 156(C).
    14. Hossein Hassani & Emmanuel Sirimal Silva, 2015. "A Kolmogorov-Smirnov Based Test for Comparing the Predictive Accuracy of Two Sets of Forecasts," Econometrics, MDPI, vol. 3(3), pages 1-20, August.
    15. Talwar, Shalini & Srivastava, Shalini & Sakashita, Mototaka & Islam, Nazrul & Dhir, Amandeep, 2022. "Personality and travel intentions during and after the COVID-19 pandemic: An artificial neural network (ANN) approach," Journal of Business Research, Elsevier, vol. 142(C), pages 400-411.
    16. Abbas Mahmoudabadi & Fatemeh Pourhossein Ghazimahalleh, 2023. "Investigating the Effect of Drivers' Training Courses on Commercial Drivers' Success Rate for Qualification," International Journal of Management Science and Business Administration, Inovatus Services Ltd., vol. 9(4), pages 35-41, May.
    17. Grace, Adam W. & Wood, Ian A., 2012. "Approximating the tail of the Anderson–Darling distribution," Computational Statistics & Data Analysis, Elsevier, vol. 56(12), pages 4301-4311.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:matcom:v:161:y:2019:i:c:p:66-75. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/mathematics-and-computers-in-simulation/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.