IDEAS home Printed from https://ideas.repec.org/p/arx/papers/1603.09060.html
   My bibliography  Save this paper

The Perfect Marriage and Much More: Combining Dimension Reduction, Distance Measures and Covariance

Author

Listed:
  • Ravi Kashyap

Abstract

We develop a novel methodology based on the marriage between the Bhattacharyya distance, a measure of similarity across distributions of random variables, and the Johnson-Lindenstrauss Lemma, a technique for dimension reduction. The resulting technique is a simple yet powerful tool that allows comparisons between data-sets representing any two distributions. The degree to which different entities, (markets, universities, hospitals, cities, groups of securities, etc.), have different distance measures of their corresponding distributions tells us the extent to which they are different, aiding participants looking for diversification or looking for more of the same thing. We demonstrate a relationship between covariance and distance measures based on a generic extension of Stein's Lemma. We consider an asset pricing application and then briefly discuss how this methodology lends itself to numerous market-structure studies and even applications outside the realm of finance / social sciences by illustrating a biological application. We provide numerical illustrations using security prices, volumes and volatilities of both these variables from six different countries.

Suggested Citation

  • Ravi Kashyap, 2016. "The Perfect Marriage and Much More: Combining Dimension Reduction, Distance Measures and Covariance," Papers 1603.09060, arXiv.org, revised Jul 2019.
  • Handle: RePEc:arx:papers:1603.09060
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/1603.09060
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Rubinstein, Mark E, 1973. "A Comparative Statics Analysis of Risk Premiums," The Journal of Business, University of Chicago Press, vol. 46(4), pages 605-615, October.
    2. K. C. John Wei & Cheng F. Lee, 1988. "The Generalized Stein/Rubinstein Covariance Formula and Its Application to Estimate Real Systematic Risk," Management Science, INFORMS, vol. 34(10), pages 1266-1270, October.
    3. Peter Frankl & Hiroshi Maehara, 1990. "Some geometric applications of the beta distribution," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 42(3), pages 463-474, September.
    4. James E. Smith, 1993. "Moment Methods for Decision Analysis," Management Science, INFORMS, vol. 39(3), pages 340-358, March.
    5. Losq, Etienne & Chateau, John Peter D., 1982. "A Generalization of the CAPM Based on a Property of the Covariance Operator," Journal of Financial and Quantitative Analysis, Cambridge University Press, vol. 17(5), pages 783-797, December.
    6. Engle, Robert F., 1984. "Wald, likelihood ratio, and Lagrange multiplier tests in econometrics," Handbook of Econometrics, in: Z. Griliches† & M. D. Intriligator (ed.), Handbook of Econometrics, edition 1, volume 2, chapter 13, pages 775-826, Elsevier.
    7. Clark, Peter K, 1973. "A Subordinated Stochastic Process Model with Finite Variance for Speculative Prices," Econometrica, Econometric Society, vol. 41(1), pages 135-155, January.
    8. Jurgen A. Doornik & Henrik Hansen, 2008. "An Omnibus Test for Univariate and Multivariate Normality," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 70(s1), pages 927-939, December.
    9. Jarque, Carlos M. & Bera, Anil K., 1980. "Efficient tests for normality, homoscedasticity and serial independence of regression residuals," Economics Letters, Elsevier, vol. 6(3), pages 255-259.
    10. Tauchen, George E & Pitts, Mark, 1983. "The Price Variability-Volume Relationship on Speculative Markets," Econometrica, Econometric Society, vol. 51(2), pages 485-505, March.
    11. Mark Rubinstein, 1976. "The Valuation of Uncertain Income Streams and the Pricing of Options," Bell Journal of Economics, The RAND Corporation, vol. 7(2), pages 407-425, Autumn.
    12. Donald L. Keefer & Samuel E. Bodily, 1983. "Three-Point Approximations for Continuous Random Variables," Management Science, INFORMS, vol. 29(5), pages 595-609, May.
    13. Horrace, William C., 2005. "Some results on the multivariate truncated normal distribution," Journal of Multivariate Analysis, Elsevier, vol. 94(1), pages 209-221, May.
    14. Allen C. Miller, III & Thomas R. Rice, 1983. "Discrete Approximations of Probability Distributions," Management Science, INFORMS, vol. 29(3), pages 352-362, March.
    15. Kumar Kattumannil, Sudheesh, 2009. "On Stein's identity and its applications," Statistics & Probability Letters, Elsevier, vol. 79(12), pages 1444-1449, June.
    16. Kiani, M & Panaretos, J & Psarakis, S & Saleem, M, 2008. "Approximations to the Normal Distribution Function and An Extended Table for the Mean Range of the Normal Variables," MPRA Paper 68045, University Library of Munich, Germany.
    17. Liu, Jun S., 1994. "Siegel's formula via Stein's identities," Statistics & Probability Letters, Elsevier, vol. 21(3), pages 247-251, October.
    18. Minxian Yang, 2008. "Normal log-normal mixture, leptokurtosis and skewness," Applied Economics Letters, Taylor & Francis Journals, vol. 15(9), pages 737-742.
    19. Szekely, Gábor J. & Rizzo, Maria L., 2005. "A new test for multivariate normality," Journal of Multivariate Analysis, Elsevier, vol. 93(1), pages 58-80, March.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Kashyap, Ravi, 2021. "Artificial Intelligence: A Child’s Play," Technological Forecasting and Social Change, Elsevier, vol. 166(C).
    2. Kashyap Ravi, 2020. "The Economics of Enlightenment: Time Value of Knowledge and the Net Present Value (NPV) of Knowledge Machines, A Proposed Approach Adapted from Finance," The B.E. Journal of Economic Analysis & Policy, De Gruyter, vol. 20(2), pages 1-23, April.
    3. Kashyap Ravi, 2020. "The Economics of Enlightenment: Time Value of Knowledge and the Net Present Value (NPV) of Knowledge Machines, A Proposed Approach Adapted from Finance," The B.E. Journal of Economic Analysis & Policy, De Gruyter, vol. 20(2), pages 1-23, April.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Kashyap, Ravi, 2019. "The perfect marriage and much more: Combining dimension reduction, distance measures and covariance," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 536(C).
    2. Kashyap, Ravi, 2021. "Artificial Intelligence: A Child’s Play," Technological Forecasting and Social Change, Elsevier, vol. 166(C).
    3. Thomas W. Keelin & Bradford W. Powley, 2011. "Quantile-Parameterized Distributions," Decision Analysis, INFORMS, vol. 8(3), pages 206-219, September.
    4. Tanaka, Ken'ichiro & Toda, Alexis Akira, 2015. "Discretizing Distributions with Exact Moments: Error Estimate and Convergence Analysis," University of California at San Diego, Economics Working Paper Series qt7g23r5kh, Department of Economics, UC San Diego.
    5. Robert K. Hammond & J. Eric Bickel, 2013. "Reexamining Discrete Approximations to Continuous Distributions," Decision Analysis, INFORMS, vol. 10(1), pages 6-25, March.
    6. Yijing Li & Prakash P. Shenoy, 2012. "A Framework for Solving Hybrid Influence Diagrams Containing Deterministic Conditional Distributions," Decision Analysis, INFORMS, vol. 9(1), pages 55-75, March.
    7. Tak Siu, 2006. "Option Pricing Under Autoregressive Random Variance Models," North American Actuarial Journal, Taylor & Francis Journals, vol. 10(2), pages 62-75.
    8. Andersen, Torben G. & Bollerslev, Tim & Dobrev, Dobrislav, 2007. "No-arbitrage semi-martingale restrictions for continuous-time volatility models subject to leverage effects, jumps and i.i.d. noise: Theory and testable distributional implications," Journal of Econometrics, Elsevier, vol. 138(1), pages 125-180, May.
    9. Tomasz Górecki & Lajos Horváth & Piotr Kokoszka, 2020. "Tests of Normality of Functional Data," International Statistical Review, International Statistical Institute, vol. 88(3), pages 677-697, December.
    10. K. Lebedeva, 2015. "An Empirical Analysis of the Russian Financial Markets’ Liquidity and Returns," Review of Business and Economics Studies // Review of Business and Economics Studies, Финансовый Университет // Financial University, vol. 3(3), pages 5-31.
    11. Luc Bauwens & Dagfinn Rime & Genaro Sucarrat, 2008. "Exchange rate volatility and the mixture of distribution hypothesis," Studies in Empirical Economics, in: Luc Bauwens & Winfried Pohlmeier & David Veredas (ed.), High Frequency Financial Econometrics, pages 7-29, Springer.
    12. Woodruff, Joshua & Dimitrov, Nedialko B., 2018. "Optimal discretization for decision analysis," Operations Research Perspectives, Elsevier, vol. 5(C), pages 288-305.
    13. Mensi, Walid & Beljid, Makram & Boubaker, Adel & Managi, Shunsuke, 2013. "Correlations and volatility spillovers across commodity and stock markets: Linking energies, food, and gold," Economic Modelling, Elsevier, vol. 32(C), pages 15-22.
    14. Konstantin Pavlikov & Stan Uryasev, 2018. "CVaR distance between univariate probability distributions and approximation problems," Annals of Operations Research, Springer, vol. 262(1), pages 67-88, March.
    15. Arago, Vicent & Nieto, Luisa, 2005. "Heteroskedasticity in the returns of the main world stock exchange indices: volume versus GARCH effects," Journal of International Financial Markets, Institutions and Money, Elsevier, vol. 15(3), pages 271-284, July.
    16. Siwen Zhou, 2021. "Exploring the driving forces of the Bitcoin currency exchange rate dynamics: an EGARCH approach," Empirical Economics, Springer, vol. 60(2), pages 557-606, February.
    17. Kashyap, Ravi, 2020. "David vs Goliath (You against the Markets), A dynamic programming approach to separate the impact and timing of trading costs," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 545(C).
    18. Soltani, Mohamad & Samorani, Michele & Kolfal, Bora, 2019. "Appointment scheduling with multiple providers and stochastic service times," European Journal of Operational Research, Elsevier, vol. 277(2), pages 667-683.
    19. Bollerslev, Tim & Engle, Robert F. & Nelson, Daniel B., 1986. "Arch models," Handbook of Econometrics, in: R. F. Engle & D. McFadden (ed.), Handbook of Econometrics, edition 1, volume 4, chapter 49, pages 2959-3038, Elsevier.
    20. Rime, Dagfinn & Sucarrat, Genaro, 2007. "Exchange rate variability, market activity and heterogeneity," UC3M Working papers. Economics we077039, Universidad Carlos III de Madrid. Departamento de Economía.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:1603.09060. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.