IDEAS home Printed from https://ideas.repec.org/p/osf/osfxxx/auq24.html
   My bibliography  Save this paper

An Empirical Unravelling of Lord's Paradox

Author

Listed:
  • Xiao, ZhiMin

    (University of Exeter)

  • Higgins, Steve
  • Kasim, Adetayo

Abstract

Lord's Paradox occurs when a continuous covariate is statistically controlled for and the relationship between a continuous outcome and group status indicator changes in both magnitude and direction. This phenomenon poses a challenge to the notion of evidence-based policy, where data are supposed to be self-evident. We examined 50 effect size estimates from 34 large-scale educational interventions, and found that impact estimates are affected in magnitude, with or without reversal in sign, when there is substantial baseline imbalance. We also demonstrated that multilevel modelling can ameliorate the divergence in sign and/or magnitude of effect estimation, which, together with project specific knowledge, promises to help those who are presented with conflicting or confusing evidence in decision making.

Suggested Citation

  • Xiao, ZhiMin & Higgins, Steve & Kasim, Adetayo, 2017. "An Empirical Unravelling of Lord's Paradox," OSF Preprints auq24, Center for Open Science.
    • Handle: RePEc:osf:osfxxx:auq24
    DOI: 10.31219/osf.io/auq24
    as

    Download full text from publisher

    File URL: https://osf.io/download/598f40f36c613b0259f3f194/
    Download Restriction: no
    File URL: https://libkey.io/10.31219/osf.io/auq24?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Kimmo Eriksson & Olle Häggström, 2014. "Lord’s Paradox in a Continuous Setting and a Regression Artifact in Numerical Cognition Research," PLOS ONE, Public Library of Science, vol. 9(4), pages 1-7, April.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.

      More about this item

      Statistics

      Access and download statistics

      Corrections

      All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:osf:osfxxx:auq24. See general information about how to correct material in RePEc.

      If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

      If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

      If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

      For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: OSF (email available below). General contact details of provider: https://osf.io/preprints/ .

      Please note that corrections may take a couple of weeks to filter through the various RePEc services.

      IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.