IDEAS home Printed from https://ideas.repec.org/p/azt/cemmap/14-24.html
   My bibliography  Save this paper

Testing sign congruence between two parameters

Author

Listed:
  • Douglas L. Miller
  • Francesca Molinari
  • Jorg Stoye

Abstract

We test the null hypothesis that two parameters (μ1,μ2) have the same sign, assuming that (asymptotically) normal estimators (ˆμ1, ˆμ2) are available. Examples of this problem include the analysis of heterogeneous treatment effects, causal interpretation of reduced-form estimands, meta-studies, and mediation analysis. A number of tests were recently proposed. We recommend a test that is simple and rejects more often than many of these recent proposals. Like all other tests in the literature, it is conservative if the truth is near (0, 0) and therefore also biased. To clarify whether these features are avoidable, we also provide a test that is unbiased and has exact size control on the boundary of the null hypothesis, but which has counterintuitive properties and hence we do not recommend. We use the test to improve p-values in Kowalski (2022) from information contained in that paper’s main text and to establish statistical significance of some key estimates in Dippel et al. (2021).

Suggested Citation

  • Douglas L. Miller & Francesca Molinari & Jorg Stoye, 2024. "Testing sign congruence between two parameters," CeMMAP working papers 14/24, Institute for Fiscal Studies.
    • Handle: RePEc:azt:cemmap:14/24
    DOI: 10.47004/wp.cem.2024.1424
    as

    Download full text from publisher

    File URL: https://www.cemmap.ac.uk/wp-content/uploads/2024/06/CWP1424-Testing-sign-congruence-between-two-parameters.pdf
    Download Restriction: no
    File URL: https://libkey.io/10.47004/wp.cem.2024.1424?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    Other versions of this item:

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:azt:cemmap:14/24. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    We have no bibliographic references for this item. You can help adding them by using this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Dermot Watson (email available below). General contact details of provider: https://edirc.repec.org/data/ifsssuk.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.