IDEAS home Printed from https://ideas.repec.org/p/eca/wpaper/2013-260378.html
   My bibliography  Save this paper

Detecting the Direction of a Signal on High-dimensional Spheres: Non-null and Le Cam Optimality Results

Author

Listed:
  • Davy Paindaveine
  • Thomas Verdebout

Abstract

We consider one of the most important problems in directional statistics, namely the problem of testing the null hypothesis that the spike direction theta of a Fisher-von Mises-Langevin distribution on the p-dimensional unit hypersphere is equal to a given direction theta_0. After a reduction through invariance arguments, we derive local asymptotic normality (LAN) results in a general high-dimensional framework where the dimension p_n goes to infinity at an arbitrary rate with the sample size n, and where the concentration kappa_n behaves in a completely free way with n, which offers a spectrum of problems ranging from arbitrarily easy to arbitrarily challenging ones. We identify seven asymptotic regimes, depending on the convergence/divergence properties of (kappa_n), that yield different contiguity rates and different limiting experiments. In each regime, we derive Le Cam optimal tests under specified kappa_n and we compute, from the Le Cam third lemma, asymptotic powers of the classical Watson test under contiguous alternatives. We further establish LAN results with respect to both spike direction and concentration, which allows us to discuss optimality also under unspecified kappa_n. To obtain a full understanding of the non-null behavior of the Watson test, we use martingale CLTs to derive its local asymptotic powers in the broader, semiparametric, model of rotationally symmetric distributions. A Monte Carlo study shows that the finite-sample behaviors of the various tests remarkably agree with our asymptotic results.

Suggested Citation

  • Davy Paindaveine & Thomas Verdebout, 2017. "Detecting the Direction of a Signal on High-dimensional Spheres: Non-null and Le Cam Optimality Results," Working Papers ECARES ECARES 2017-40, ULB -- Universite Libre de Bruxelles.
  • Handle: RePEc:eca:wpaper:2013/260378
    as

    Download full text from publisher

    File URL: https://dipot.ulb.ac.be/dspace/bitstream/2013/260378/3/2017-40-PAINDAVEINE_VERDEBOUT-detecting.pdf
    File Function: Full text for the whole work, or for a work part
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. R. Arnold & P. E. Jupp, 2013. "Statistics of orthogonal axial frames," Biometrika, Biometrika Trust, vol. 100(3), pages 571-586.
    2. Hornik, Kurt & Grün, Bettina, 2014. "movMF: An R Package for Fitting Mixtures of von Mises-Fisher Distributions," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 58(i10).
    3. P. V. Larsen, 2002. "Improved likelihood ratio tests on the von Mises--Fisher distribution," Biometrika, Biometrika Trust, vol. 89(4), pages 947-951, December.
    4. Davy Paindaveine & Thomas Verdebout, 2013. "Optimal Rank-Based Tests for the Location Parameter of a Rotationally Symmetric Distribution on the Hypersphere," Working Papers ECARES ECARES 2013-36, ULB -- Universite Libre de Bruxelles.
    5. Ley, Christophe & Paindaveine, Davy & Verdebout, Thomas, 2015. "High-dimensional tests for spherical location and spiked covariance," Journal of Multivariate Analysis, Elsevier, vol. 139(C), pages 79-91.
    6. T. D. Downs, 2003. "Spherical regression," Biometrika, Biometrika Trust, vol. 90(3), pages 655-668, September.
    7. Christine Cutting & Davy Paindaveine & Thomas Verdebout, 2015. "Testing Uniformity on High-Dimensional Spheres against Contiguous Rotationally Symmetric Alternatives," Working Papers ECARES ECARES 2015-04, ULB -- Universite Libre de Bruxelles.
    8. Chikuse, Yasuko, 1991. "High dimensional limit theorems and matrix decompositions on the Stiefel manifold," Journal of Multivariate Analysis, Elsevier, vol. 36(2), pages 145-162, February.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Arthur Pewsey & Eduardo García-Portugués, 2021. "Recent advances in directional statistics," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 30(1), pages 1-58, March.
    2. Christine Cutting & Davy Paindaveine & Thomas Verdebout, 2015. "Tests of Concentration for Low-Dimensional and High-Dimensional Directional Data," Working Papers ECARES ECARES 2015-05, ULB -- Universite Libre de Bruxelles.
    3. Anders Bredahl Kock & David Preinerstorfer, 2019. "Power in High‐Dimensional Testing Problems," Econometrica, Econometric Society, vol. 87(3), pages 1055-1069, May.
    4. Davy Paindaveine & Thomas Verdebout, 2019. "Inference for Spherical Location under High Concentration," Working Papers ECARES 2019-02, ULB -- Universite Libre de Bruxelles.
    5. Davy Paindaveine & Thomas Verdebout, 2013. "Universal Asymptotics for High-Dimensional Sign Tests," Working Papers ECARES ECARES 2013-40, ULB -- Universite Libre de Bruxelles.
    6. Zhu, Changbo & Müller, Hans-Georg, 2024. "Spherical autoregressive models, with application to distributional and compositional time series," Journal of Econometrics, Elsevier, vol. 239(2).
    7. Christophe Ley & Thomas Verdebout, 2014. "Skew-rotsymmetric Distributions on Unit Spheres and Related Efficient Inferential Proceedures," Working Papers ECARES ECARES 2014-46, ULB -- Universite Libre de Bruxelles.
    8. Dong, Aqi & Melnykov, Volodymyr, 2024. "Contaminated Kent mixture model for clustering non-spherical directional data with heavy tails or scatter," Statistics & Probability Letters, Elsevier, vol. 208(C).
    9. Christophe Ley & Thomas Verdebout, 2014. "Local Powers of Optimal One-sample and Multi-sample Tests for the Concentration of Fisher-von Mises-Langevin Distributions," International Statistical Review, International Statistical Institute, vol. 82(3), pages 440-456, December.
    10. Soukissian, Takvor H. & Karathanasi, Flora E., 2017. "On the selection of bivariate parametric models for wind data," Applied Energy, Elsevier, vol. 188(C), pages 280-304.
    11. Hemangi V. Kulkarni & Ashis SenGupta, 2022. "An Efficient Test for Homogeneity of Mean Directions on the Hyper‐sphere," International Statistical Review, International Statistical Institute, vol. 90(1), pages 41-61, April.
    12. Laha, A. K. & Putatunda, Sayan, 2017. "Real Time Location Prediction with Taxi-GPS Data Streams," IIMA Working Papers WP 2017-03-02, Indian Institute of Management Ahmedabad, Research and Publication Department.
    13. Adelaide Figueiredo, 2017. "Clustering Directions Based on the Estimation of a Mixture of Von Mises-Fisher Distributions," The Open Statistics and Probability Journal, Bentham Open, vol. 8(1), pages 39-52, December.
    14. Christine Cutting & Davy Paindaveine & Thomas Verdebout, 2015. "Testing Uniformity on High-Dimensional Spheres against Contiguous Rotationally Symmetric Alternatives," Working Papers ECARES ECARES 2015-04, ULB -- Universite Libre de Bruxelles.
    15. Marco Bee & Roberto Benedetti & Giuseppe Espa, 2015. "Approximate likelihood inference for the Bingham distribution," DEM Working Papers 2015/02, Department of Economics and Management.
    16. Vaidehi Dixit & Ryan Martin, 2022. "Estimating a Mixing Distribution on the Sphere Using Predictive Recursion," Sankhya B: The Indian Journal of Statistics, Springer;Indian Statistical Institute, vol. 84(2), pages 596-626, November.
    17. Xavier Bry & Lionel Cucala, 2022. "A von Mises–Fisher mixture model for clustering numerical and categorical variables," Advances in Data Analysis and Classification, Springer;German Classification Society - Gesellschaft für Klassifikation (GfKl);Japanese Classification Society (JCS);Classification and Data Analysis Group of the Italian Statistical Society (CLADAG);International Federation of Classification Societies (IFCS), vol. 16(2), pages 429-455, June.
    18. Ley, Christophe & Paindaveine, Davy & Verdebout, Thomas, 2015. "High-dimensional tests for spherical location and spiked covariance," Journal of Multivariate Analysis, Elsevier, vol. 139(C), pages 79-91.
    19. Felix Mbuga & Cristina Tortora, 2021. "Spectral Clustering of Mixed-Type Data," Stats, MDPI, vol. 5(1), pages 1-11, December.
    20. Kanti V. Mardia, 2021. "Comments on: Recent advances in directional statistics," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 30(1), pages 59-63, March.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eca:wpaper:2013/260378. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Benoit Pauwels (email available below). General contact details of provider: https://edirc.repec.org/data/arulbbe.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.