IDEAS home Printed from https://ideas.repec.org/a/gam/jdataj/v5y2020i3p84-d413006.html
   My bibliography  Save this article

Information Loss Due to the Data Reduction of Sample Data from Discrete Distributions

Author

Listed:
  • Maryam Moghimi

    (Center on Stochastic Modeling, Optimization, and Statistics (COSMOS), the University of Texas at Arlington, Arlington, TX 76013, USA
    This paper was part of the author’s doctoral dissertation of May 2020.
    The two authors contributed equally to this paper.)

  • Herbert W. Corley

    (Center on Stochastic Modeling, Optimization, and Statistics (COSMOS), the University of Texas at Arlington, Arlington, TX 76013, USA
    The two authors contributed equally to this paper.)

Abstract

In this paper, we study the information lost when a real-valued statistic is used to reduce or summarize sample data from a discrete random variable with a one-dimensional parameter. We compare the probability that a random sample gives a particular data set to the probability of the statistic’s value for this data set. We focus on sufficient statistics for the parameter of interest and develop a general formula independent of the parameter for the Shannon information lost when a data sample is reduced to such a summary statistic. We also develop a measure of entropy for this lost information that depends only on the real-valued statistic but neither the parameter nor the data. Our approach would also work for non-sufficient statistics, but the lost information and associated entropy would involve the parameter. The method is applied to three well-known discrete distributions to illustrate its implementation.

Suggested Citation

  • Maryam Moghimi & Herbert W. Corley, 2020. "Information Loss Due to the Data Reduction of Sample Data from Discrete Distributions," Data, MDPI, vol. 5(3), pages 1-18, September.
    • Handle: RePEc:gam:jdataj:v:5:y:2020:i:3:p:84-:d:413006
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2306-5729/5/3/84/pdf
    Download Restriction: no
    File URL: https://www.mdpi.com/2306-5729/5/3/84/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Frank Arute & Kunal Arya & Ryan Babbush & Dave Bacon & Joseph C. Bardin & Rami Barends & Rupak Biswas & Sergio Boixo & Fernando G. S. L. Brandao & David A. Buell & Brian Burkett & Yu Chen & Zijun Chen, 2019. "Quantum supremacy using a programmable superconducting processor," Nature, Nature, vol. 574(7779), pages 505-510, October.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Tong Liu & Shang Liu & Hekang Li & Hao Li & Kaixuan Huang & Zhongcheng Xiang & Xiaohui Song & Kai Xu & Dongning Zheng & Heng Fan, 2023. "Observation of entanglement transition of pseudo-random mixed states," Nature Communications, Nature, vol. 14(1), pages 1-7, December.
    2. Sofia Priazhkina & Samuel Palmer & Pablo Martín-Ramiro & Román Orús & Samuel Mugel & Vladimir Skavysh, 2024. "Digital Payments in Firm Networks: Theory of Adoption and Quantum Algorithm," Staff Working Papers 24-17, Bank of Canada.
    3. X. L. He & Yong Lu & D. Q. Bao & Hang Xue & W. B. Jiang & Z. Wang & A. F. Roudsari & Per Delsing & J. S. Tsai & Z. R. Lin, 2023. "Fast generation of Schrödinger cat states using a Kerr-tunable superconducting resonator," Nature Communications, Nature, vol. 14(1), pages 1-10, December.
    4. Hu, Jie-Ru & Zhang, Zuo-Yuan & Liu, Jin-Ming, 2024. "Implementation of three-qubit Deutsch-Jozsa algorithm with pendular states of polar molecules by optimal control," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 635(C).
    5. Huang, Fangyu & Tan, Xiaoqing & Huang, Rui & Xu, Qingshan, 2022. "Variational convolutional neural networks classifiers," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 605(C).
    6. Jesús Fernández-Villaverde & Isaiah J. Hull, 2023. "Dynamic Programming on a Quantum Annealer: Solving the RBC Model," NBER Working Papers 31326, National Bureau of Economic Research, Inc.
    7. Abha Naik & Esra Yeniaras & Gerhard Hellstern & Grishma Prasad & Sanjay Kumar Lalta Prasad Vishwakarma, 2023. "From Portfolio Optimization to Quantum Blockchain and Security: A Systematic Review of Quantum Computing in Finance," Papers 2307.01155, arXiv.org.
    8. Xianchuang Pan & Yuxuan Zhou & Haolan Yuan & Lifu Nie & Weiwei Wei & Libo Zhang & Jian Li & Song Liu & Zhi Hao Jiang & Gianluigi Catelani & Ling Hu & Fei Yan & Dapeng Yu, 2022. "Engineering superconducting qubits to reduce quasiparticles and charge noise," Nature Communications, Nature, vol. 13(1), pages 1-7, December.
    9. Ducuara, Andrés F. & Susa, Cristian E. & Reina, John H., 2022. "Emergence of maximal hidden quantum correlations and its trade-off with the filtering probability in dissipative two-qubit systems," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 594(C).
    10. Nikolaos Schetakis & Davit Aghamalyan & Michael Boguslavsky & Agnieszka Rees & Marc Rakotomalala & Paul Robert Griffin, 2024. "Quantum Machine Learning for Credit Scoring," Mathematics, MDPI, vol. 12(9), pages 1-12, May.
    11. Jake Rochman & Tian Xie & John G. Bartholomew & K. C. Schwab & Andrei Faraon, 2023. "Microwave-to-optical transduction with erbium ions coupled to planar photonic and superconducting resonators," Nature Communications, Nature, vol. 14(1), pages 1-9, December.
    12. Reis, Mauricio & Oliveira, Adelcio C., 2022. "A complementary resource relation of concurrence and roughness for a two-qubit state," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 608(P2).
    13. Jin Ming Koh & Tommy Tai & Ching Hua Lee, 2024. "Realization of higher-order topological lattices on a quantum computer," Nature Communications, Nature, vol. 15(1), pages 1-14, December.
    14. T. Brown & E. Doucet & D. Ristè & G. Ribeill & K. Cicak & J. Aumentado & R. Simmonds & L. Govia & A. Kamal & L. Ranzani, 2022. "Trade off-free entanglement stabilization in a superconducting qutrit-qubit system," Nature Communications, Nature, vol. 13(1), pages 1-7, December.
    15. Daniel Christian Lawo & Rana Abu Bakar & Abraham Cano Aguilera & Filippo Cugini & José Luis Imaña & Idelfonso Tafur Monroy & Juan Jose Vegas Olmos, 2024. "Wireless and Fiber-Based Post-Quantum-Cryptography-Secured IPsec Tunnel," Future Internet, MDPI, vol. 16(8), pages 1-22, August.
    16. Yulin Chi & Jieshan Huang & Zhanchuan Zhang & Jun Mao & Zinan Zhou & Xiaojiong Chen & Chonghao Zhai & Jueming Bao & Tianxiang Dai & Huihong Yuan & Ming Zhang & Daoxin Dai & Bo Tang & Yan Yang & Zhihua, 2022. "A programmable qudit-based quantum processor," Nature Communications, Nature, vol. 13(1), pages 1-10, December.
    17. Thorsten B. Wahl & Bo Han & Benjamin Béri, 2024. "Topologically ordered time crystals," Nature Communications, Nature, vol. 15(1), pages 1-8, December.
    18. Elies Gil-Fuster & Jens Eisert & Carlos Bravo-Prieto, 2024. "Understanding quantum machine learning also requires rethinking generalization," Nature Communications, Nature, vol. 15(1), pages 1-12, December.
    19. Ryan Snodgrass & Vincent Kotsubo & Scott Backhaus & Joel Ullom, 2024. "Dynamic acoustic optimization of pulse tube refrigerators for rapid cooldown," Nature Communications, Nature, vol. 15(1), pages 1-8, December.
    20. Fazal Raheman, 2022. "The Future of Cybersecurity in the Age of Quantum Computers," Future Internet, MDPI, vol. 14(11), pages 1-12, November.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jdataj:v:5:y:2020:i:3:p:84-:d:413006. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.